2024-04-01T16:10:23.505 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T16:10:23.506 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind} --owner scheduled_vshankar@teuthology --name vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958 --verbose -- /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958/orig.config.yaml 2024-04-01T16:10:23.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T16:10:23.646 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958 branch: wip-vshankar-testing-20240330.170739 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind} email: vshankar@redhat.com first_in_suite: false job_id: '7633958' kernel: flavor: default kdb: true sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240330.170739 ceph: cephfs: session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow request - SLOW_OPS - MON_DOWN sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240330.170739 sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 6891 sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 sleep_before_teardown: 0 subset: 932/1024 suite: fs suite_branch: wip-vshankar-testing-20240330.170739 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJNvpDfk19B0IUi/Ydj37n1HFdeQY3OxFWAhXFZv1fl8FYopydoy5Ji0WHVb26kKxtbbjpwS0aUGEumLQtbfZk= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJyTDvOq7o62e63FZnD5vzScSY0bwTAzRp4xkzsYzrKUQ5o6ZKPGwWm1wdvoi5OnOWlSxfi0Az3Ty0BGDfgi440= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-04-01_14:09:42 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-01T16:10:23.646 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa; will attempt to use it 2024-04-01T16:10:23.647 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks 2024-04-01T16:10:23.647 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-01T16:10:23.648 INFO:teuthology.task.internal:Checking packages... 2024-04-01T16:10:23.671 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2271579d5e735cfd6d436b8349c004f06527cb0' 2024-04-01T16:10:23.671 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T16:10:23.672 INFO:teuthology.packaging:ref: None 2024-04-01T16:10:23.672 INFO:teuthology.packaging:tag: None 2024-04-01T16:10:23.672 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240330.170739 2024-04-01T16:10:23.672 INFO:teuthology.packaging:sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T16:10:23.672 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240330.170739 2024-04-01T16:10:23.814 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2574.gd2271579 2024-04-01T16:10:23.815 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-01T16:10:23.828 INFO:teuthology.task.internal:no buildpackages task found 2024-04-01T16:10:23.828 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-01T16:10:23.862 INFO:teuthology.task.internal:Saving configuration 2024-04-01T16:10:23.878 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-01T16:10:23.895 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T16:10:23.920 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 16:04:20.263931', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJNvpDfk19B0IUi/Ydj37n1HFdeQY3OxFWAhXFZv1fl8FYopydoy5Ji0WHVb26kKxtbbjpwS0aUGEumLQtbfZk='} 2024-04-01T16:10:23.940 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 16:04:20.265381', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJyTDvOq7o62e63FZnD5vzScSY0bwTAzRp4xkzsYzrKUQ5o6ZKPGwWm1wdvoi5OnOWlSxfi0Az3Ty0BGDfgi440='} 2024-04-01T16:10:23.940 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-01T16:10:23.951 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-01T16:10:23.952 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-01T16:10:23.952 INFO:teuthology.run_tasks:Running task console_log... 2024-04-01T16:10:24.044 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1a9ff8a160>, signals=[15]) 2024-04-01T16:10:24.045 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-01T16:10:24.056 INFO:teuthology.task.internal:Opening connections... 2024-04-01T16:10:24.056 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2024-04-01T16:10:24.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:10:24.148 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-04-01T16:10:24.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:10:24.236 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-01T16:10:24.245 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-04-01T16:10:24.263 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-04-01T16:10:24.263 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-04-01T16:10:24.317 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-04-01T16:10:24.317 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2024-04-01T16:10:24.318 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-04-01T16:10:24.318 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:10:24.318 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2024-04-01T16:10:24.318 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:10:24.318 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:10:24.318 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-04-01T16:10:24.318 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:10:24.318 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:10:24.318 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:10:24.318 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:10:24.318 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:10:24.318 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:10:24.319 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-04-01T16:10:24.339 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-04-01T16:10:24.356 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-04-01T16:10:24.356 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-04-01T16:10:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-04-01T16:10:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-04-01T16:10:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-04-01T16:10:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-04-01T16:10:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-04-01T16:10:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-04-01T16:10:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T16:10:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-04-01T16:10:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-04-01T16:10:24.414 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T16:10:24.414 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-04-01T16:10:24.414 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T16:10:24.414 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T16:10:24.414 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T16:10:24.414 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-04-01T16:10:24.439 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-01T16:10:24.453 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-01T16:10:24.486 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-01T16:10:24.486 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2024-04-01T16:10:24.489 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-04-01T16:10:24.504 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-01T16:10:24.517 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-01T16:10:24.517 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2024-04-01T16:10:24.544 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-04-01T16:10:24.647 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-01T16:10:24.705 INFO:teuthology.run_tasks:Running task kernel... 2024-04-01T16:10:24.724 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'} 2024-04-01T16:10:24.724 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, timeout 300 2024-04-01T16:10:24.724 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T16:10:24.725 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T16:10:24.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T16:10:24.741 DEBUG:teuthology.task.kernel:sha1 for mon.a is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T16:10:24.741 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-04-01T16:10:24.741 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-04-01T16:10:24.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T16:10:24.742 DEBUG:teuthology.task.kernel:sha1 for mon.b is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T16:10:24.742 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-04-01T16:10:24.743 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-04-01T16:10:24.795 INFO:teuthology.orchestra.run.smithi163.stdout:5.14.0-361.el9.x86_64 2024-04-01T16:10:24.795 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T16:10:24.795 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-01T16:10:24.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T16:10:24.799 INFO:teuthology.orchestra.run.smithi189.stdout:5.14.0-361.el9.x86_64 2024-04-01T16:10:24.799 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T16:10:24.800 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-01T16:10:24.800 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T16:10:25.092 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum upgrade -y linux-firmware 2024-04-01T16:10:25.093 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum upgrade -y linux-firmware 2024-04-01T16:10:27.694 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS-9 - AppStream 6.6 MB/s | 6.7 MB 00:01 2024-04-01T16:10:27.775 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS-9 - AppStream 6.7 MB/s | 6.7 MB 00:01 2024-04-01T16:10:29.528 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS-9 - BaseOS 2.7 MB/s | 2.0 MB 00:00 2024-04-01T16:10:29.617 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS-9 - BaseOS 2.7 MB/s | 2.0 MB 00:00 2024-04-01T16:10:32.350 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.0 MB 00:02 2024-04-01T16:10:38.082 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 19 MB 00:04 2024-04-01T16:10:41.436 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - BaseOS 711 kB/s | 8.0 MB 00:11 2024-04-01T16:10:45.796 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 19 MB 00:03 2024-04-01T16:10:46.703 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 1.2 MB/s | 6.1 MB 00:05 2024-04-01T16:10:49.209 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 16 kB 00:01 2024-04-01T16:10:52.777 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 6.0 MB/s | 21 MB 00:03 2024-04-01T16:10:57.465 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - CRB 768 kB/s | 6.1 MB 00:08 2024-04-01T16:10:57.793 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-01T16:10:58.940 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-04-01T16:11:00.111 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-04-01T16:11:00.120 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2024-04-01T16:11:00.120 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-04-01T16:11:00.120 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2024-04-01T16:11:00.120 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-04-01T16:11:00.120 INFO:teuthology.orchestra.run.smithi189.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-04-01T16:11:00.120 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:11:00.120 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-04-01T16:11:00.120 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2024-04-01T16:11:00.121 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 1 Package 2024-04-01T16:11:00.121 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:11:00.121 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 375 M 2024-04-01T16:11:00.121 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-04-01T16:11:08.044 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 2.3 MB/s | 21 MB 00:08 2024-04-01T16:11:13.032 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-04-01T16:11:15.359 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-01T16:11:15.369 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-01T16:11:15.369 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-01T16:11:15.369 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-01T16:11:15.369 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrading: 2024-04-01T16:11:15.369 INFO:teuthology.orchestra.run.smithi163.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-04-01T16:11:15.369 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:11:15.369 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-01T16:11:15.369 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-01T16:11:15.369 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrade 1 Package 2024-04-01T16:11:15.370 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:11:15.370 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 375 M 2024-04-01T16:11:15.370 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-01T16:11:17.784 INFO:teuthology.orchestra.run.smithi189.stdout:linux-firmware-20240219-143.el9.noarch.rpm 21 MB/s | 375 MB 00:17 2024-04-01T16:11:17.786 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-04-01T16:11:17.786 INFO:teuthology.orchestra.run.smithi189.stdout:Total 21 MB/s | 375 MB 00:17 2024-04-01T16:11:17.786 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-04-01T16:11:17.878 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-04-01T16:11:17.878 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-04-01T16:11:20.345 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-04-01T16:11:20.345 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-04-01T16:11:25.232 INFO:teuthology.orchestra.run.smithi163.stdout:linux-firmware-20240219-143.el9.noarch.rpm 38 MB/s | 375 MB 00:09 2024-04-01T16:11:25.233 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-01T16:11:25.234 INFO:teuthology.orchestra.run.smithi163.stdout:Total 38 MB/s | 375 MB 00:09 2024-04-01T16:11:25.234 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-01T16:11:25.332 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-01T16:11:25.332 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-01T16:11:26.716 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-04-01T16:11:26.959 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-01T16:11:27.051 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-01T16:11:27.793 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-01T16:11:27.794 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-01T16:11:28.079 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-01T16:11:28.079 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-01T16:11:28.469 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-01T16:11:28.469 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:11:28.469 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-04-01T16:11:28.469 INFO:teuthology.orchestra.run.smithi189.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-01T16:11:28.469 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:11:28.469 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-04-01T16:11:28.765 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-04-01T16:11:28.766 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T16:11:28.912 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-04-01T16:11:28.913 DEBUG:teuthology.orchestra.run.smithi189:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-01T16:11:28.915 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi189.front.sepia.ceph.com to complete... 2024-04-01T16:11:34.348 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-01T16:11:34.586 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-01T16:11:34.674 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-01T16:11:36.012 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-01T16:11:36.012 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-01T16:11:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-01T16:11:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:11:36.399 INFO:teuthology.orchestra.run.smithi163.stdout:Upgraded: 2024-04-01T16:11:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-01T16:11:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:11:36.399 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-01T16:11:36.725 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-04-01T16:11:36.726 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-01T16:11:36.871 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-04-01T16:11:36.871 DEBUG:teuthology.orchestra.run.smithi163:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-01T16:11:36.874 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi163.front.sepia.ceph.com to complete... 2024-04-01T16:12:24.686 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01 16:12:24 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-01T16:12:24.687 INFO:teuthology.orchestra.run.smithi163.stderr:FINISHED --2024-04-01 16:12:24-- 2024-04-01T16:12:24.687 INFO:teuthology.orchestra.run.smithi163.stderr:Total wall clock time: 48s 2024-04-01T16:12:24.687 INFO:teuthology.orchestra.run.smithi163.stderr:Downloaded: 1 files, 321M in 47s (6.77 MB/s) 2024-04-01T16:12:24.689 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-04-01T16:12:24.690 DEBUG:teuthology.orchestra.run.smithi163:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-01T16:12:26.629 INFO:teuthology.orchestra.run.smithi163.stdout:Verifying... ######################################## 2024-04-01T16:12:26.750 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing... ######################################## 2024-04-01T16:12:26.830 INFO:teuthology.orchestra.run.smithi163.stdout:Updating / installing... 2024-04-01T16:12:34.428 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-04-01T16:12:49.261 INFO:teuthology.orchestra.run.smithi163.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-01T16:13:11.869 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi163.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-01T16:13:11.869 DEBUG:teuthology.orchestra.run.smithi163:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-01T16:13:11.950 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-04-01T16:13:11.950 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-04-01T16:13:11.950 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-04-01T16:13:11.950 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-01T16:13:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-04-01T16:13:11.952 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-04-01T16:13:11.953 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-04-01T16:13:11.954 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-04-01T16:13:11.954 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-04-01T16:13:11.954 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-04-01T16:13:11.954 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-04-01T16:13:11.954 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-04-01T16:13:11.954 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-04-01T16:13:11.954 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-04-01T16:13:11.954 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-04-01T16:13:11.954 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-04-01T16:13:11.954 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-04-01T16:13:11.954 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-04-01T16:13:11.954 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-04-01T16:13:11.955 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-04-01T16:13:11.956 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-04-01T16:13:11.957 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-04-01T16:13:11.958 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-04-01T16:13:11.959 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-04-01T16:13:11.960 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-04-01T16:13:11.961 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-04-01T16:13:11.962 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-01T16:13:11.963 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-04-01T16:13:11.964 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-01T16:13:11.965 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-04-01T16:13:11.966 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-04-01T16:13:11.967 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-04-01T16:13:11.967 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-04-01T16:13:11.967 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-04-01T16:13:11.967 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-04-01T16:13:11.967 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-04-01T16:13:11.967 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-04-01T16:13:11.967 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-04-01T16:13:11.967 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-04-01T16:13:11.968 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-04-01T16:13:11.969 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-04-01T16:13:11.969 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-04-01T16:13:11.969 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-04-01T16:13:11.969 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-04-01T16:13:11.969 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-04-01T16:13:11.969 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-01T16:13:11.970 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-01T16:13:11.971 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-04-01T16:13:11.971 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-04-01T16:13:11.971 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-04-01T16:13:11.971 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-04-01T16:13:11.971 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-04-01T16:13:11.971 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-01T16:13:11.972 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-01T16:13:11.973 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-04-01T16:13:11.973 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-04-01T16:13:11.973 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-04-01T16:13:11.973 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-01T16:13:11.973 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-04-01T16:13:11.973 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-04-01T16:13:11.974 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-04-01T16:13:11.974 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-04-01T16:13:11.974 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-04-01T16:13:11.974 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-01T16:13:11.974 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-04-01T16:13:11.974 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-04-01T16:13:11.974 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-04-01T16:13:11.974 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-04-01T16:13:11.974 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-04-01T16:13:11.974 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-04-01T16:13:11.974 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-04-01T16:13:11.975 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-04-01T16:13:11.975 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-04-01T16:13:11.975 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-04-01T16:13:11.975 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-04-01T16:13:11.975 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-04-01T16:13:11.975 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-04-01T16:13:11.975 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-04-01T16:13:11.976 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-04-01T16:13:11.976 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-04-01T16:13:11.976 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-04-01T16:13:11.976 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-04-01T16:13:11.976 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-04-01T16:13:11.976 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-01T16:13:11.976 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-04-01T16:13:11.977 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-04-01T16:13:11.977 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-04-01T16:13:11.977 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-04-01T16:13:11.977 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-04-01T16:13:11.977 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-04-01T16:13:11.977 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-04-01T16:13:11.977 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-04-01T16:13:11.978 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-04-01T16:13:11.978 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-04-01T16:13:11.978 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-04-01T16:13:11.978 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-04-01T16:13:11.978 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-04-01T16:13:11.978 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-04-01T16:13:11.979 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-04-01T16:13:11.979 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-04-01T16:13:11.979 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-04-01T16:13:11.979 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-04-01T16:13:11.979 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-04-01T16:13:11.979 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-01T16:13:11.979 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-04-01T16:13:11.979 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-04-01T16:13:11.979 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-01T16:13:11.979 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-04-01T16:13:11.980 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-04-01T16:13:11.981 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-04-01T16:13:11.982 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-04-01T16:13:11.983 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-01T16:13:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-04-01T16:13:11.985 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-04-01T16:13:11.986 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-01T16:13:11.987 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-01T16:13:11.988 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-04-01T16:13:11.989 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-04-01T16:13:11.989 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-01T16:13:11.989 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-04-01T16:13:11.989 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-04-01T16:13:11.989 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-04-01T16:13:11.989 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-04-01T16:13:11.989 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-01T16:13:11.989 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-04-01T16:13:11.989 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-01T16:13:11.989 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-01T16:13:11.989 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-01T16:13:11.989 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-04-01T16:13:11.990 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-04-01T16:13:11.991 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-04-01T16:13:11.992 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-01T16:13:11.993 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-04-01T16:13:11.994 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-04-01T16:13:11.995 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-04-01T16:13:11.996 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-04-01T16:13:11.997 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-04-01T16:13:11.998 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-04-01T16:13:11.999 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-01T16:13:12.000 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-01T16:13:12.001 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-01T16:13:12.002 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-01T16:13:12.003 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-04-01T16:13:12.003 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-01T16:13:12.003 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-01T16:13:12.003 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-01T16:13:12.003 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-01T16:13:12.003 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-01T16:13:12.004 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-01T16:13:12.005 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-01T16:13:12.005 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-01T16:13:12.005 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-01T16:13:12.005 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-04-01T16:13:12.005 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-04-01T16:13:12.005 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-01T16:13:12.005 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-04-01T16:13:12.006 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-04-01T16:13:12.007 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-01T16:13:12.007 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-04-01T16:13:12.007 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-04-01T16:13:12.007 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-04-01T16:13:12.007 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-01T16:13:12.007 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-04-01T16:13:12.007 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-01T16:13:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-04-01T16:13:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-01T16:13:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-04-01T16:13:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-01T16:13:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-04-01T16:13:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-01T16:13:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-04-01T16:13:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-01T16:13:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-04-01T16:13:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-01T16:13:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-04-01T16:13:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-01T16:13:12.009 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-01T16:13:12.009 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-01T16:13:12.009 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-01T16:13:12.009 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-01T16:13:12.009 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-04-01T16:13:12.009 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-04-01T16:13:12.009 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-01T16:13:12.009 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-01T16:13:12.010 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-01T16:13:12.010 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-04-01T16:13:12.010 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-01T16:13:12.010 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-01T16:13:12.010 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-01T16:13:12.010 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-01T16:13:12.010 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-01T16:13:12.010 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-01T16:13:12.010 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-04-01T16:13:12.011 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-01T16:13:12.011 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-04-01T16:13:12.011 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-01T16:13:12.011 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-01T16:13:12.011 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-04-01T16:13:12.011 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-01T16:13:12.011 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-01T16:13:12.011 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-04-01T16:13:12.012 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-01T16:13:12.012 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-04-01T16:13:12.012 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-01T16:13:12.012 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-04-01T16:13:12.012 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-01T16:13:12.012 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-01T16:13:12.012 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-04-01T16:13:12.012 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-01T16:13:12.012 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-01T16:13:12.013 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-01T16:13:12.013 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-01T16:13:12.013 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-01T16:13:12.013 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-04-01T16:13:12.013 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-01T16:13:12.013 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-04-01T16:13:12.014 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-01T16:13:12.014 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-01T16:13:12.014 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-01T16:13:12.014 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-01T16:13:12.014 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-04-01T16:13:12.014 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-01T16:13:12.014 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-04-01T16:13:12.015 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-01T16:13:12.016 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-04-01T16:13:12.017 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-04-01T16:13:12.018 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-04-01T16:13:12.019 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-04-01T16:13:12.020 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-01T16:13:12.021 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-04-01T16:13:12.022 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-04-01T16:13:12.023 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-01T16:13:12.024 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-01T16:13:12.025 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-04-01T16:13:12.026 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-01T16:13:12.027 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-01T16:13:12.028 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-01T16:13:12.029 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-04-01T16:13:12.030 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-04-01T16:13:12.031 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-04-01T16:13:12.032 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-04-01T16:13:12.033 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-04-01T16:13:12.034 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-04-01T16:13:12.035 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-04-01T16:13:12.036 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-04-01T16:13:12.036 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-04-01T16:13:12.036 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-01T16:13:12.036 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-04-01T16:13:12.036 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-01T16:13:12.036 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-04-01T16:13:12.036 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-04-01T16:13:12.036 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-04-01T16:13:12.036 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-04-01T16:13:12.037 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-04-01T16:13:12.038 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-01T16:13:12.038 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-01T16:13:12.038 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-01T16:13:12.038 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-01T16:13:12.038 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-01T16:13:12.038 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-01T16:13:12.038 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-01T16:13:12.038 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-01T16:13:12.038 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-01T16:13:12.038 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-01T16:13:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-01T16:13:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-01T16:13:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-01T16:13:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-01T16:13:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-01T16:13:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-01T16:13:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-01T16:13:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-01T16:13:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-04-01T16:13:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-04-01T16:13:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-01T16:13:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-04-01T16:13:12.040 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-04-01T16:13:12.040 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-04-01T16:13:12.040 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-04-01T16:13:12.040 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-04-01T16:13:12.040 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-01T16:13:12.040 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-04-01T16:13:12.040 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-04-01T16:13:12.040 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-01T16:13:12.040 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-04-01T16:13:12.040 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-04-01T16:13:12.040 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-01T16:13:12.040 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-04-01T16:13:12.041 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-01T16:13:12.041 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-04-01T16:13:12.041 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-04-01T16:13:12.041 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-04-01T16:13:12.041 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-04-01T16:13:12.041 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-04-01T16:13:12.041 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-04-01T16:13:12.041 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-04-01T16:13:12.041 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-04-01T16:13:12.041 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-04-01T16:13:12.042 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-01T16:13:12.042 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-04-01T16:13:12.042 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-04-01T16:13:12.042 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-04-01T16:13:12.042 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-01T16:13:12.042 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-04-01T16:13:12.042 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-04-01T16:13:12.042 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-04-01T16:13:12.042 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-04-01T16:13:12.042 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-04-01T16:13:12.043 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-01T16:13:12.044 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-04-01T16:13:12.044 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-04-01T16:13:12.044 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-04-01T16:13:12.044 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-04-01T16:13:12.044 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-04-01T16:13:12.044 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-04-01T16:13:12.044 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-04-01T16:13:12.044 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-01T16:13:12.044 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-04-01T16:13:12.044 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-04-01T16:13:12.044 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-04-01T16:13:12.045 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-01T16:13:12.045 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-01T16:13:12.045 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-04-01T16:13:12.045 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-01T16:13:12.045 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-01T16:13:12.045 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-01T16:13:12.045 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-04-01T16:13:12.045 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-04-01T16:13:12.045 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-04-01T16:13:12.045 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-04-01T16:13:12.046 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-01T16:13:12.046 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-04-01T16:13:12.046 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-01T16:13:12.046 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-01T16:13:12.046 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-01T16:13:12.046 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-04-01T16:13:12.046 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-04-01T16:13:12.046 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-04-01T16:13:12.046 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-04-01T16:13:12.046 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-04-01T16:13:12.047 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-04-01T16:13:12.047 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-04-01T16:13:12.047 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-04-01T16:13:12.047 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-04-01T16:13:12.047 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-04-01T16:13:12.047 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-04-01T16:13:12.047 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-04-01T16:13:12.047 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-04-01T16:13:12.047 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-04-01T16:13:12.047 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-01T16:13:12.048 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-04-01T16:13:12.048 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-04-01T16:13:12.048 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-01T16:13:12.048 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-01T16:13:12.048 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-04-01T16:13:12.048 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-01T16:13:12.048 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-04-01T16:13:12.048 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-04-01T16:13:12.048 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-01T16:13:12.048 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-04-01T16:13:12.048 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-01T16:13:12.049 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-04-01T16:13:12.050 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-04-01T16:13:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-01T16:13:12.052 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-04-01T16:13:12.053 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-01T16:13:12.054 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-01T16:13:12.055 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-04-01T16:13:12.056 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-04-01T16:13:12.057 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-04-01T16:13:12.058 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-04-01T16:13:12.059 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-04-01T16:13:12.060 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-04-01T16:13:12.061 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-04-01T16:13:12.062 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-04-01T16:13:12.063 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-04-01T16:13:12.064 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-04-01T16:13:12.065 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-04-01T16:13:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-04-01T16:13:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-04-01T16:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-04-01T16:13:12.069 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-04-01T16:13:12.069 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-04-01T16:13:12.069 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-04-01T16:13:12.069 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-04-01T16:13:12.069 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-04-01T16:13:12.069 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-04-01T16:13:12.069 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-04-01T16:13:12.069 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-04-01T16:13:12.069 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-01T16:13:12.070 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-01T16:13:12.071 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-01T16:13:12.071 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-01T16:13:12.071 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-01T16:13:12.071 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-01T16:13:12.071 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-01T16:13:12.071 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-01T16:13:12.071 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-01T16:13:12.071 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-01T16:13:12.071 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-01T16:13:12.071 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-04-01T16:13:12.072 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-04-01T16:13:12.073 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-04-01T16:13:12.074 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-04-01T16:13:12.075 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-01T16:13:12.075 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-01T16:13:12.075 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-01T16:13:12.075 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-01T16:13:12.075 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-01T16:13:12.075 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-01T16:13:12.075 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-01T16:13:12.075 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-01T16:13:12.075 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-01T16:13:12.075 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-01T16:13:12.075 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-01T16:13:12.075 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-01T16:13:12.076 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-01T16:13:12.076 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-01T16:13:12.076 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-01T16:13:12.076 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-01T16:13:12.076 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-01T16:13:12.076 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-01T16:13:12.076 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-01T16:13:12.076 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-01T16:13:12.076 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-01T16:13:12.076 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-04-01T16:13:12.076 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-04-01T16:13:12.077 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-04-01T16:13:12.078 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-01T16:13:12.078 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-04-01T16:13:12.078 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-04-01T16:13:12.078 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-04-01T16:13:12.078 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-04-01T16:13:12.078 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-04-01T16:13:12.078 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-01T16:13:12.078 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-04-01T16:13:12.078 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-04-01T16:13:12.078 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-04-01T16:13:12.078 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-01T16:13:12.078 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-01T16:13:12.079 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-01T16:13:12.079 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-01T16:13:12.079 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-01T16:13:12.081 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-01T16:13:12.081 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-01T16:13:12.081 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-01T16:13:12.081 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-01T16:13:12.081 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-01T16:13:12.081 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-01T16:13:12.081 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-01T16:13:12.081 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-01T16:13:12.081 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-01T16:13:12.082 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-01T16:13:12.082 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-01T16:13:12.082 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-01T16:13:12.082 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-01T16:13:12.082 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-01T16:13:12.082 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-01T16:13:12.082 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-01T16:13:12.082 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-01T16:13:12.082 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-01T16:13:12.083 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-01T16:13:12.083 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-04-01T16:13:12.083 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-04-01T16:13:12.083 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-01T16:13:12.083 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-04-01T16:13:12.083 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-04-01T16:13:12.083 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-04-01T16:13:12.083 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-04-01T16:13:12.083 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-01T16:13:12.083 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-04-01T16:13:12.083 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-04-01T16:13:12.083 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-04-01T16:13:12.084 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-04-01T16:13:12.084 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-04-01T16:13:12.084 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-04-01T16:13:12.084 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-04-01T16:13:12.084 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-04-01T16:13:12.084 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-04-01T16:13:12.084 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-04-01T16:13:12.084 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-04-01T16:13:12.084 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-04-01T16:13:12.084 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-04-01T16:13:12.085 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-04-01T16:13:12.085 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-01T16:13:12.085 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-01T16:13:12.085 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-01T16:13:12.085 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-01T16:13:12.085 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-01T16:13:12.085 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-01T16:13:12.085 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-01T16:13:12.085 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-01T16:13:12.085 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-01T16:13:12.085 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-01T16:13:12.086 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-01T16:13:12.086 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-01T16:13:12.086 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-01T16:13:12.086 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-01T16:13:12.086 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-01T16:13:12.086 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-04-01T16:13:12.086 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-01T16:13:12.086 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-01T16:13:12.086 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-01T16:13:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-01T16:13:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-01T16:13:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-01T16:13:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-01T16:13:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-01T16:13:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-01T16:13:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-01T16:13:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-01T16:13:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-01T16:13:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-01T16:13:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-01T16:13:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-01T16:13:12.088 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-01T16:13:12.089 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-04-01T16:13:12.090 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-04-01T16:13:12.091 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-04-01T16:13:12.092 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-04-01T16:13:12.093 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-04-01T16:13:12.094 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-04-01T16:13:12.095 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-04-01T16:13:12.096 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-04-01T16:13:12.097 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-04-01T16:13:12.098 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-04-01T16:13:12.099 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-04-01T16:13:12.099 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-04-01T16:13:12.099 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-04-01T16:13:12.099 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-04-01T16:13:12.099 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-04-01T16:13:12.099 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-04-01T16:13:12.099 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-04-01T16:13:12.099 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-04-01T16:13:12.099 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-04-01T16:13:12.099 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-04-01T16:13:12.099 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-04-01T16:13:12.099 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-04-01T16:13:12.100 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-04-01T16:13:12.101 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-04-01T16:13:12.102 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-04-01T16:13:12.103 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-04-01T16:13:12.103 INFO:teuthology.orchestra.run.smithi163.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-01T16:13:12.107 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-04-01T16:13:12.107 DEBUG:teuthology.orchestra.run.smithi163:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-01T16:13:12.131 INFO:teuthology.orchestra.run.smithi163.stdout:postinstall scriptlet (using /bin/sh): 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout:fi 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout:for file in vmlinuz System.map config; do 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout: fi 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout:done 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-04-01T16:13:12.132 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-04-01T16:13:12.133 INFO:teuthology.orchestra.run.smithi163.stdout:fi 2024-04-01T16:13:12.133 INFO:teuthology.orchestra.run.smithi163.stdout:postuninstall scriptlet (using /bin/sh): 2024-04-01T16:13:12.133 INFO:teuthology.orchestra.run.smithi163.stdout:if [ -x /sbin/update-bootloader ]; then 2024-04-01T16:13:12.133 INFO:teuthology.orchestra.run.smithi163.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-04-01T16:13:12.133 INFO:teuthology.orchestra.run.smithi163.stdout:fi 2024-04-01T16:13:12.134 DEBUG:teuthology.orchestra.run.smithi163:> sudo rpm -qi grub2-tools 2024-04-01T16:13:12.212 INFO:teuthology.orchestra.run.smithi163.stdout:Name : grub2-tools 2024-04-01T16:13:12.212 INFO:teuthology.orchestra.run.smithi163.stdout:Epoch : 1 2024-04-01T16:13:12.212 INFO:teuthology.orchestra.run.smithi163.stdout:Version : 2.06 2024-04-01T16:13:12.212 INFO:teuthology.orchestra.run.smithi163.stdout:Release : 68.el9 2024-04-01T16:13:12.212 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: x86_64 2024-04-01T16:13:12.212 INFO:teuthology.orchestra.run.smithi163.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-01T16:13:12.212 INFO:teuthology.orchestra.run.smithi163.stdout:Group : Unspecified 2024-04-01T16:13:12.212 INFO:teuthology.orchestra.run.smithi163.stdout:Size : 8264254 2024-04-01T16:13:12.212 INFO:teuthology.orchestra.run.smithi163.stdout:License : GPLv3+ 2024-04-01T16:13:12.212 INFO:teuthology.orchestra.run.smithi163.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-01T16:13:12.212 INFO:teuthology.orchestra.run.smithi163.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-01T16:13:12.212 INFO:teuthology.orchestra.run.smithi163.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-01T16:13:12.213 INFO:teuthology.orchestra.run.smithi163.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-01T16:13:12.213 INFO:teuthology.orchestra.run.smithi163.stdout:Packager : builder@centos.org 2024-04-01T16:13:12.213 INFO:teuthology.orchestra.run.smithi163.stdout:Vendor : CentOS 2024-04-01T16:13:12.213 INFO:teuthology.orchestra.run.smithi163.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-01T16:13:12.213 INFO:teuthology.orchestra.run.smithi163.stdout:Summary : Support tools for GRUB. 2024-04-01T16:13:12.213 INFO:teuthology.orchestra.run.smithi163.stdout:Description : 2024-04-01T16:13:12.213 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:13:12.213 INFO:teuthology.orchestra.run.smithi163.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-01T16:13:12.213 INFO:teuthology.orchestra.run.smithi163.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-01T16:13:12.213 INFO:teuthology.orchestra.run.smithi163.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-01T16:13:12.213 INFO:teuthology.orchestra.run.smithi163.stdout:hardware devices. 2024-04-01T16:13:12.214 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:13:12.214 INFO:teuthology.orchestra.run.smithi163.stdout:This subpackage provides tools for support of all platforms. 2024-04-01T16:13:12.215 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-01T16:13:12.215 INFO:teuthology.task.kernel:Updating grub on smithi163 to boot 6.8.0-g1df0c7e8a235 2024-04-01T16:13:12.215 DEBUG:teuthology.orchestra.run.smithi163:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-01T16:13:12.851 INFO:teuthology.orchestra.run.smithi163.stderr:Generating grub configuration file ... 2024-04-01T16:13:14.186 INFO:teuthology.orchestra.run.smithi163.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-01T16:13:14.212 INFO:teuthology.orchestra.run.smithi163.stderr:done 2024-04-01T16:13:14.222 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-04-01T16:13:14.237 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.BB32sm4WYY 2024-04-01T16:13:14.237 DEBUG:teuthology.orchestra.run.smithi163:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BB32sm4WYY 2024-04-01T16:13:14.306 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.BB32sm4WYY 2024-04-01T16:13:14.451 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.BB32sm4WYY is 6KB 2024-04-01T16:13:14.499 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.BB32sm4WYY 2024-04-01T16:13:14.513 DEBUG:teuthology.orchestra.run.smithi163:> sudo /bin/ls /boot/loader/entries || true 2024-04-01T16:13:14.578 INFO:teuthology.orchestra.run.smithi163.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-01T16:13:14.578 INFO:teuthology.orchestra.run.smithi163.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-01T16:13:14.578 INFO:teuthology.orchestra.run.smithi163.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-01T16:13:14.578 INFO:teuthology.orchestra.run.smithi163.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-04-01T16:13:14.579 DEBUG:teuthology.orchestra.run.smithi163:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-04-01T16:13:14.750 DEBUG:teuthology.orchestra.run.smithi163:> sudo shutdown -r now 2024-04-01T16:13:44.753 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-01T16:13:44.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-01T16:13:44.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:13:44.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01 16:13:44 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-01T16:13:44.837 INFO:teuthology.orchestra.run.smithi189.stderr:FINISHED --2024-04-01 16:13:44-- 2024-04-01T16:13:44.837 INFO:teuthology.orchestra.run.smithi189.stderr:Total wall clock time: 2m 16s 2024-04-01T16:13:44.837 INFO:teuthology.orchestra.run.smithi189.stderr:Downloaded: 1 files, 321M in 2m 15s (2.37 MB/s) 2024-04-01T16:13:44.841 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-04-01T16:13:44.841 DEBUG:teuthology.orchestra.run.smithi189:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-01T16:13:46.772 INFO:teuthology.orchestra.run.smithi189.stdout:Verifying... ######################################## 2024-04-01T16:13:46.834 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing... ######################################## 2024-04-01T16:13:46.912 INFO:teuthology.orchestra.run.smithi189.stdout:Updating / installing... 2024-04-01T16:13:54.411 INFO:teuthology.orchestra.run.smithi189.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-04-01T16:14:08.737 INFO:teuthology.orchestra.run.smithi189.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-01T16:14:19.422 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-04-01T16:14:28.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-01T16:14:28.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:14:31.282 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi189.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-01T16:14:31.282 DEBUG:teuthology.orchestra.run.smithi189:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-01T16:14:31.354 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-04-01T16:14:31.354 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-04-01T16:14:31.354 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-04-01T16:14:31.354 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-04-01T16:14:31.354 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-04-01T16:14:31.354 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-04-01T16:14:31.354 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-01T16:14:31.355 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-01T16:14:31.356 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-04-01T16:14:31.357 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-04-01T16:14:31.358 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-04-01T16:14:31.359 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-04-01T16:14:31.360 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-04-01T16:14:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-04-01T16:14:31.362 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-04-01T16:14:31.363 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-04-01T16:14:31.364 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-04-01T16:14:31.365 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-04-01T16:14:31.366 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-01T16:14:31.367 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-01T16:14:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-04-01T16:14:31.369 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-04-01T16:14:31.370 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-04-01T16:14:31.371 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-01T16:14:31.371 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-04-01T16:14:31.371 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-01T16:14:31.371 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-04-01T16:14:31.371 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-04-01T16:14:31.371 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-04-01T16:14:31.371 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-04-01T16:14:31.371 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-04-01T16:14:31.371 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-04-01T16:14:31.371 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-04-01T16:14:31.371 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-04-01T16:14:31.372 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-04-01T16:14:31.373 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-04-01T16:14:31.374 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-04-01T16:14:31.375 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-04-01T16:14:31.376 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-04-01T16:14:31.377 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-04-01T16:14:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-04-01T16:14:31.379 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-04-01T16:14:31.380 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-04-01T16:14:31.381 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-04-01T16:14:31.382 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-04-01T16:14:31.383 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-04-01T16:14:31.383 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-04-01T16:14:31.383 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-04-01T16:14:31.383 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-04-01T16:14:31.383 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-04-01T16:14:31.383 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-04-01T16:14:31.383 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-04-01T16:14:31.383 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-04-01T16:14:31.383 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-04-01T16:14:31.383 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-04-01T16:14:31.383 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-01T16:14:31.384 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-04-01T16:14:31.385 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-04-01T16:14:31.386 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-01T16:14:31.387 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-01T16:14:31.388 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-01T16:14:31.389 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-01T16:14:31.390 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-04-01T16:14:31.391 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-04-01T16:14:31.392 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-01T16:14:31.393 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-04-01T16:14:31.394 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-04-01T16:14:31.395 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-01T16:14:31.396 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-01T16:14:31.397 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-04-01T16:14:31.398 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-04-01T16:14:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-04-01T16:14:31.400 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-04-01T16:14:31.400 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-04-01T16:14:31.400 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-01T16:14:31.400 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-01T16:14:31.400 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-01T16:14:31.400 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-01T16:14:31.400 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-04-01T16:14:31.400 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-01T16:14:31.401 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-01T16:14:31.401 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-01T16:14:31.401 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-01T16:14:31.401 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-04-01T16:14:31.401 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-01T16:14:31.401 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-04-01T16:14:31.401 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-01T16:14:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-04-01T16:14:31.403 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-04-01T16:14:31.404 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-04-01T16:14:31.405 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-01T16:14:31.406 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-01T16:14:31.407 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-01T16:14:31.408 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-01T16:14:31.409 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-01T16:14:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-01T16:14:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-04-01T16:14:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-04-01T16:14:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-04-01T16:14:31.414 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-04-01T16:14:31.415 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-04-01T16:14:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-04-01T16:14:31.417 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-04-01T16:14:31.418 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-04-01T16:14:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-04-01T16:14:31.420 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-04-01T16:14:31.421 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-01T16:14:31.422 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-01T16:14:31.423 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-04-01T16:14:31.424 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-04-01T16:14:31.425 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-01T16:14:31.426 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-04-01T16:14:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-04-01T16:14:31.428 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-04-01T16:14:31.429 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-04-01T16:14:31.430 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-04-01T16:14:31.431 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-01T16:14:31.432 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-01T16:14:31.433 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-04-01T16:14:31.434 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-04-01T16:14:31.435 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-01T16:14:31.436 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-01T16:14:31.437 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-01T16:14:31.438 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-01T16:14:31.439 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-01T16:14:31.440 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-01T16:14:31.441 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-04-01T16:14:31.442 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-04-01T16:14:31.443 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-01T16:14:31.444 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-01T16:14:31.445 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-04-01T16:14:31.446 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-01T16:14:31.446 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-04-01T16:14:31.446 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-01T16:14:31.446 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-01T16:14:31.446 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-01T16:14:31.446 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-04-01T16:14:31.446 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-04-01T16:14:31.446 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-04-01T16:14:31.446 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-01T16:14:31.446 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-04-01T16:14:31.446 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-04-01T16:14:31.446 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-04-01T16:14:31.447 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-04-01T16:14:31.448 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-04-01T16:14:31.449 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-04-01T16:14:31.450 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-04-01T16:14:31.451 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-04-01T16:14:31.452 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-04-01T16:14:31.453 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-04-01T16:14:31.454 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-04-01T16:14:31.455 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-04-01T16:14:31.456 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-04-01T16:14:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-04-01T16:14:31.458 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-04-01T16:14:31.459 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-04-01T16:14:31.460 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-01T16:14:31.461 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-01T16:14:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-04-01T16:14:31.463 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-04-01T16:14:31.464 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-01T16:14:31.465 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-01T16:14:31.466 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-04-01T16:14:31.467 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-04-01T16:14:31.468 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-01T16:14:31.469 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-04-01T16:14:31.470 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-04-01T16:14:31.471 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-01T16:14:31.472 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-01T16:14:31.473 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-01T16:14:31.474 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-04-01T16:14:31.475 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-04-01T16:14:31.476 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-04-01T16:14:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-04-01T16:14:31.478 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-04-01T16:14:31.479 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-04-01T16:14:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-04-01T16:14:31.481 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-04-01T16:14:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-04-01T16:14:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-04-01T16:14:31.484 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-04-01T16:14:31.485 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-04-01T16:14:31.486 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-01T16:14:31.487 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-04-01T16:14:31.488 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-04-01T16:14:31.489 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-04-01T16:14:31.489 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-04-01T16:14:31.489 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-04-01T16:14:31.489 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-04-01T16:14:31.489 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-04-01T16:14:31.489 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-04-01T16:14:31.489 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-01T16:14:31.492 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-04-01T16:14:31.493 DEBUG:teuthology.orchestra.run.smithi189:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-01T16:14:31.493 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-04-01T16:14:31.515 INFO:teuthology.orchestra.run.smithi189.stdout:postinstall scriptlet (using /bin/sh): 2024-04-01T16:14:31.515 INFO:teuthology.orchestra.run.smithi189.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-01T16:14:31.515 INFO:teuthology.orchestra.run.smithi189.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-04-01T16:14:31.515 INFO:teuthology.orchestra.run.smithi189.stdout:fi 2024-04-01T16:14:31.515 INFO:teuthology.orchestra.run.smithi189.stdout:for file in vmlinuz System.map config; do 2024-04-01T16:14:31.515 INFO:teuthology.orchestra.run.smithi189.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-04-01T16:14:31.515 INFO:teuthology.orchestra.run.smithi189.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-04-01T16:14:31.515 INFO:teuthology.orchestra.run.smithi189.stdout: fi 2024-04-01T16:14:31.515 INFO:teuthology.orchestra.run.smithi189.stdout:done 2024-04-01T16:14:31.515 INFO:teuthology.orchestra.run.smithi189.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-01T16:14:31.515 INFO:teuthology.orchestra.run.smithi189.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-04-01T16:14:31.515 INFO:teuthology.orchestra.run.smithi189.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-04-01T16:14:31.516 INFO:teuthology.orchestra.run.smithi189.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-04-01T16:14:31.516 INFO:teuthology.orchestra.run.smithi189.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-04-01T16:14:31.516 INFO:teuthology.orchestra.run.smithi189.stdout:fi 2024-04-01T16:14:31.516 INFO:teuthology.orchestra.run.smithi189.stdout:postuninstall scriptlet (using /bin/sh): 2024-04-01T16:14:31.516 INFO:teuthology.orchestra.run.smithi189.stdout:if [ -x /sbin/update-bootloader ]; then 2024-04-01T16:14:31.516 INFO:teuthology.orchestra.run.smithi189.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-04-01T16:14:31.516 INFO:teuthology.orchestra.run.smithi189.stdout:fi 2024-04-01T16:14:31.517 DEBUG:teuthology.orchestra.run.smithi189:> sudo rpm -qi grub2-tools 2024-04-01T16:14:31.592 INFO:teuthology.orchestra.run.smithi189.stdout:Name : grub2-tools 2024-04-01T16:14:31.592 INFO:teuthology.orchestra.run.smithi189.stdout:Epoch : 1 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:Version : 2.06 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:Release : 68.el9 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:Architecture: x86_64 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:Group : Unspecified 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:Size : 8264254 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:License : GPLv3+ 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:Packager : builder@centos.org 2024-04-01T16:14:31.593 INFO:teuthology.orchestra.run.smithi189.stdout:Vendor : CentOS 2024-04-01T16:14:31.594 INFO:teuthology.orchestra.run.smithi189.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-01T16:14:31.594 INFO:teuthology.orchestra.run.smithi189.stdout:Summary : Support tools for GRUB. 2024-04-01T16:14:31.594 INFO:teuthology.orchestra.run.smithi189.stdout:Description : 2024-04-01T16:14:31.594 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:14:31.594 INFO:teuthology.orchestra.run.smithi189.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-01T16:14:31.594 INFO:teuthology.orchestra.run.smithi189.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-01T16:14:31.594 INFO:teuthology.orchestra.run.smithi189.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-01T16:14:31.594 INFO:teuthology.orchestra.run.smithi189.stdout:hardware devices. 2024-04-01T16:14:31.594 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:14:31.594 INFO:teuthology.orchestra.run.smithi189.stdout:This subpackage provides tools for support of all platforms. 2024-04-01T16:14:31.595 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-01T16:14:31.595 INFO:teuthology.task.kernel:Updating grub on smithi189 to boot 6.8.0-g1df0c7e8a235 2024-04-01T16:14:31.595 DEBUG:teuthology.orchestra.run.smithi189:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-01T16:14:32.113 INFO:teuthology.orchestra.run.smithi189.stderr:Generating grub configuration file ... 2024-04-01T16:14:33.629 INFO:teuthology.orchestra.run.smithi189.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-01T16:14:33.677 INFO:teuthology.orchestra.run.smithi189.stderr:done 2024-04-01T16:14:33.679 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-04-01T16:14:33.694 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.5IQxh7B1jp 2024-04-01T16:14:33.694 DEBUG:teuthology.orchestra.run.smithi189:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5IQxh7B1jp 2024-04-01T16:14:33.763 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.5IQxh7B1jp 2024-04-01T16:14:33.896 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.5IQxh7B1jp is 6KB 2024-04-01T16:14:33.945 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.5IQxh7B1jp 2024-04-01T16:14:33.959 DEBUG:teuthology.orchestra.run.smithi189:> sudo /bin/ls /boot/loader/entries || true 2024-04-01T16:14:34.023 INFO:teuthology.orchestra.run.smithi189.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-01T16:14:34.023 INFO:teuthology.orchestra.run.smithi189.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-01T16:14:34.023 INFO:teuthology.orchestra.run.smithi189.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-01T16:14:34.023 INFO:teuthology.orchestra.run.smithi189.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-04-01T16:14:34.025 DEBUG:teuthology.orchestra.run.smithi189:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-04-01T16:14:34.177 DEBUG:teuthology.orchestra.run.smithi189:> sudo shutdown -r now 2024-04-01T16:14:43.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-01T16:14:43.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:15:01.919 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-04-01T16:15:04.182 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-01T16:15:04.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-01T16:15:04.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:15:16.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-01T16:15:16.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:15:19.998 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-04-01T16:15:22.654 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-01T16:15:31.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-01T16:15:31.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:15:34.722 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-01T16:15:38.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-01T16:15:38.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:15:38.435 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-04-01T16:15:39.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-01T16:15:39.212 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-g1df0c7e8a235"... 2024-04-01T16:15:39.212 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-04-01T16:15:39.290 INFO:teuthology.orchestra.run.smithi163.stdout:6.8.0-g1df0c7e8a235 2024-04-01T16:15:39.290 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-04-01T16:15:39.290 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-01T16:15:39.290 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-01T16:15:40.292 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-01T16:15:40.292 DEBUG:teuthology.orchestra.run.smithi163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-01T16:15:40.414 INFO:teuthology.orchestra.run.smithi163.stdout:ttyS1 2024-04-01T16:15:40.472 DEBUG:teuthology.parallel:result is None 2024-04-01T16:15:46.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-01T16:15:46.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:16:05.150 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-04-01T16:16:20.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-01T16:16:20.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:16:21.639 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-04-01T16:16:22.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-01T16:16:22.399 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.8.0-g1df0c7e8a235"... 2024-04-01T16:16:22.399 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-04-01T16:16:22.436 INFO:teuthology.orchestra.run.smithi189.stdout:6.8.0-g1df0c7e8a235 2024-04-01T16:16:22.437 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-04-01T16:16:22.437 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-01T16:16:22.437 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-01T16:16:23.437 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-01T16:16:23.438 DEBUG:teuthology.orchestra.run.smithi189:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-01T16:16:23.561 INFO:teuthology.orchestra.run.smithi189.stdout:ttyS1 2024-04-01T16:16:23.597 DEBUG:teuthology.parallel:result is None 2024-04-01T16:16:23.598 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-01T16:16:23.610 INFO:teuthology.task.internal:Creating test directory... 2024-04-01T16:16:23.610 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T16:16:23.618 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T16:16:23.667 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-01T16:16:23.684 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-01T16:16:23.712 INFO:teuthology.task.internal:Creating archive directory... 2024-04-01T16:16:23.712 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T16:16:23.719 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T16:16:23.777 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-01T16:16:23.784 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-01T16:16:23.785 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T16:16:23.792 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T16:16:23.878 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T16:16:23.891 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T16:16:23.922 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T16:16:23.931 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T16:16:23.936 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-01T16:16:23.953 INFO:teuthology.task.internal:Configuring sudo... 2024-04-01T16:16:23.953 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T16:16:23.959 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T16:16:24.047 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-01T16:16:24.057 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-01T16:16:24.057 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T16:16:24.064 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T16:16:24.112 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T16:16:24.192 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T16:16:24.302 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T16:16:24.386 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T16:16:24.485 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:16:24.485 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T16:16:24.576 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T16:16:24.658 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T16:16:24.738 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T16:16:24.803 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T16:16:24.893 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:16:24.894 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T16:16:24.964 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2024-04-01T16:16:24.971 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-04-01T16:16:25.092 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T16:16:25.127 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T16:16:25.587 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-01T16:16:25.595 INFO:teuthology.task.internal:Starting timer... 2024-04-01T16:16:25.595 INFO:teuthology.run_tasks:Running task pcp... 2024-04-01T16:16:25.640 INFO:teuthology.run_tasks:Running task selinux... 2024-04-01T16:16:25.688 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-01T16:16:25.689 DEBUG:teuthology.orchestra.run.smithi163:> sudo service auditd rotate 2024-04-01T16:16:25.818 INFO:teuthology.orchestra.run.smithi163.stdout:Rotating logs: 2024-04-01T16:16:25.823 DEBUG:teuthology.orchestra.run.smithi189:> sudo service auditd rotate 2024-04-01T16:16:25.940 INFO:teuthology.orchestra.run.smithi189.stdout:Rotating logs: 2024-04-01T16:16:25.971 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-01T16:16:25.972 DEBUG:teuthology.orchestra.run.smithi163:> /usr/sbin/getenforce 2024-04-01T16:16:26.024 INFO:teuthology.orchestra.run.smithi163.stdout:Permissive 2024-04-01T16:16:26.024 DEBUG:teuthology.orchestra.run.smithi189:> /usr/sbin/getenforce 2024-04-01T16:16:26.077 INFO:teuthology.orchestra.run.smithi189.stdout:Permissive 2024-04-01T16:16:26.078 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi163.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi189.front.sepia.ceph.com': 'permissive'} 2024-04-01T16:16:26.078 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T16:16:26.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T16:16:26.169 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T16:16:26.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T16:16:26.247 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-01T16:16:26.248 DEBUG:teuthology.orchestra.run.smithi163:> sudo /usr/sbin/setenforce permissive 2024-04-01T16:16:26.327 DEBUG:teuthology.orchestra.run.smithi189:> sudo /usr/sbin/setenforce permissive 2024-04-01T16:16:26.415 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-01T16:16:26.427 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-01T16:16:26.443 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-01T16:16:26.445 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi163.front.sepia.ceph.com,smithi189.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-01T16:22:24.261 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi163.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com')] 2024-04-01T16:22:24.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-01T16:22:24.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:22:24.407 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-04-01T16:22:24.545 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-01T16:22:24.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-01T16:22:24.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T16:22:24.689 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-04-01T16:22:24.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-01T16:22:24.851 INFO:teuthology.run_tasks:Running task clock... 2024-04-01T16:22:24.861 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-01T16:22:24.862 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T16:22:24.862 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T16:22:24.870 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T16:22:24.871 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T16:22:24.963 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-01T16:22:24.967 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-01T16:22:25.017 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-01T16:22:25.020 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-01T16:22:25.110 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: ntpd: command not found 2024-04-01T16:22:25.118 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: ntpd: command not found 2024-04-01T16:22:25.147 INFO:teuthology.orchestra.run.smithi163.stdout:506 Cannot talk to daemon 2024-04-01T16:22:25.161 INFO:teuthology.orchestra.run.smithi189.stdout:506 Cannot talk to daemon 2024-04-01T16:22:25.196 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-01T16:22:25.215 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-01T16:22:25.248 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-01T16:22:25.267 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-01T16:22:25.374 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: ntpq: command not found 2024-04-01T16:22:25.382 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T16:22:25.383 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2024-04-01T16:22:25.383 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T16:22:25.383 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T16:22:25.383 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T16:22:25.383 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T16:22:25.393 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-04-01T16:22:25.401 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T16:22:25.401 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-04-01T16:22:25.401 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T16:22:25.401 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T16:22:25.401 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T16:22:25.401 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T16:22:25.403 INFO:teuthology.run_tasks:Running task install... 2024-04-01T16:22:25.411 DEBUG:teuthology.task.install:project ceph 2024-04-01T16:22:25.411 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}} 2024-04-01T16:22:25.411 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'} 2024-04-01T16:22:25.411 INFO:teuthology.task.install:Using flavor: default 2024-04-01T16:22:25.419 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-04-01T16:22:25.419 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-01T16:22:25.419 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'tag': None, 'wait_for_package': False} 2024-04-01T16:22:25.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T16:22:25.422 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'tag': None, 'wait_for_package': False} 2024-04-01T16:22:25.422 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T16:22:25.565 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/ 2024-04-01T16:22:25.566 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2574.gd2271579 2024-04-01T16:22:25.569 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/ 2024-04-01T16:22:25.569 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2574.gd2271579 2024-04-01T16:22:25.677 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-01T16:22:25.678 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:22:25.678 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-01T16:22:25.745 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-01T16:22:25.745 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:22:25.746 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-01T16:22:25.779 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-01T16:22:25.780 DEBUG:teuthology.orchestra.run.smithi163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2271579d5e735cfd6d436b8349c004f06527cb0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-01T16:22:25.846 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-01T16:22:25.846 DEBUG:teuthology.orchestra.run.smithi189:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2271579d5e735cfd6d436b8349c004f06527cb0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-01T16:22:25.918 DEBUG:teuthology.orchestra.run.smithi163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-01T16:22:25.984 DEBUG:teuthology.orchestra.run.smithi189:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-01T16:22:26.047 DEBUG:teuthology.orchestra.run.smithi163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-01T16:22:26.108 DEBUG:teuthology.orchestra.run.smithi189:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-01T16:22:26.133 INFO:teuthology.orchestra.run.smithi163.stdout:check_obsoletes = 1 2024-04-01T16:22:26.138 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum clean all 2024-04-01T16:22:26.196 INFO:teuthology.orchestra.run.smithi189.stdout:check_obsoletes = 1 2024-04-01T16:22:26.201 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum clean all 2024-04-01T16:22:26.489 INFO:teuthology.orchestra.run.smithi163.stdout:74 files removed 2024-04-01T16:22:26.531 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-01T16:22:26.564 INFO:teuthology.orchestra.run.smithi189.stdout:74 files removed 2024-04-01T16:22:26.604 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-01T16:22:27.495 INFO:teuthology.orchestra.run.smithi163.stdout:ceph packages for x86_64 181 kB/s | 83 kB 00:00 2024-04-01T16:22:27.512 INFO:teuthology.orchestra.run.smithi189.stdout:ceph packages for x86_64 205 kB/s | 83 kB 00:00 2024-04-01T16:22:28.004 INFO:teuthology.orchestra.run.smithi163.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-04-01T16:22:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-04-01T16:22:28.530 INFO:teuthology.orchestra.run.smithi189.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2024-04-01T16:22:28.554 INFO:teuthology.orchestra.run.smithi163.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-04-01T16:22:29.109 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-04-01T16:22:29.182 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-01T16:22:30.825 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2024-04-01T16:22:30.902 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2024-04-01T16:22:35.675 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.0 MB 00:04 2024-04-01T16:22:36.012 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.0 MB 00:04 2024-04-01T16:22:43.058 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - AppStream 3.2 MB/s | 19 MB 00:05 2024-04-01T16:22:44.078 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 19 MB 00:07 2024-04-01T16:22:51.530 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - CRB 1.3 MB/s | 6.1 MB 00:04 2024-04-01T16:22:52.207 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.1 MB 00:04 2024-04-01T16:22:53.323 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-04-01T16:22:53.700 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 105 kB/s | 16 kB 00:00 2024-04-01T16:22:54.616 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-01T16:22:56.466 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 8.0 MB/s | 21 MB 00:02 2024-04-01T16:23:00.383 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-01T16:23:02.352 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-01T16:23:03.170 INFO:teuthology.orchestra.run.smithi163.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-01T16:23:03.172 INFO:teuthology.orchestra.run.smithi163.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-01T16:23:03.210 INFO:teuthology.orchestra.run.smithi163.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-01T16:23:03.211 INFO:teuthology.orchestra.run.smithi163.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-01T16:23:03.212 INFO:teuthology.orchestra.run.smithi163.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-01T16:23:03.213 INFO:teuthology.orchestra.run.smithi163.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-01T16:23:03.215 INFO:teuthology.orchestra.run.smithi163.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-01T16:23:03.217 INFO:teuthology.orchestra.run.smithi163.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-01T16:23:03.218 INFO:teuthology.orchestra.run.smithi163.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-01T16:23:03.308 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-01T16:23:03.328 INFO:teuthology.orchestra.run.smithi163.stdout:==================================================================================================== 2024-04-01T16:23:03.328 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-01T16:23:03.328 INFO:teuthology.orchestra.run.smithi163.stdout:==================================================================================================== 2024-04-01T16:23:03.328 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-01T16:23:03.328 INFO:teuthology.orchestra.run.smithi163.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-01T16:23:03.329 INFO:teuthology.orchestra.run.smithi163.stdout: ceph x86_64 2:19.0.0-2574.gd2271579.el9 ceph 6.6 k 2024-04-01T16:23:03.329 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.4 M 2024-04-01T16:23:03.329 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 69 M 2024-04-01T16:23:03.329 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 443 M 2024-04-01T16:23:03.329 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 889 k 2024-04-01T16:23:03.329 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 6.1 M 2024-04-01T16:23:03.329 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2574.gd2271579.el9 ceph 145 k 2024-04-01T16:23:03.329 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 1.5 M 2024-04-01T16:23:03.329 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 54 M 2024-04-01T16:23:03.329 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr x86_64 2:19.0.0-2574.gd2271579.el9 ceph 1.5 M 2024-04-01T16:23:03.329 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 141 k 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 3.5 M 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 20 M 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 7.4 M 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 49 k 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 99 M 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 290 M 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw x86_64 2:19.0.0-2574.gd2271579.el9 ceph 9.8 M 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 178 M 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test x86_64 2:19.0.0-2574.gd2271579.el9 ceph 48 M 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 680 M 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 264 k 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 762 k 2024-04-01T16:23:03.330 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror x86_64 2:19.0.0-2574.gd2271579.el9 ceph 225 k 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-shell x86_64 2:19.0.0-2574.gd2271579.el9 ceph 27 k 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-top noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 18 k 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel x86_64 2:19.0.0-2574.gd2271579.el9 ceph 32 k 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 746 k 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.5 M 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel x86_64 2:19.0.0-2574.gd2271579.el9 ceph 127 k 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 109 k 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 45 M 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 52 M 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-01T16:23:03.331 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs x86_64 2:19.0.0-2574.gd2271579.el9 ceph 162 k 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 615 k 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados x86_64 2:19.0.0-2574.gd2271579.el9 ceph 320 k 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 769 k 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 298 k 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 1.1 M 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw x86_64 2:19.0.0-2574.gd2271579.el9 ceph 99 k 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 337 k 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 85 k 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 516 k 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.1 M 2024-04-01T16:23:03.332 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 52 M 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 171 k 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 1.3 M 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrading: 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-01T16:23:03.333 INFO:teuthology.orchestra.run.smithi163.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.4 M 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.1 M 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-01T16:23:03.334 INFO:teuthology.orchestra.run.smithi163.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common x86_64 2:19.0.0-2574.gd2271579.el9 ceph 21 M 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 23 M 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 34 k 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds x86_64 2:19.0.0-2574.gd2271579.el9 ceph 2.4 M 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 249 k 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon x86_64 2:19.0.0-2574.gd2271579.el9 ceph 4.7 M 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 17 M 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 16 k 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux x86_64 2:19.0.0-2574.gd2271579.el9 ceph 25 k 2024-04-01T16:23:03.335 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite x86_64 2:19.0.0-2574.gd2271579.el9 ceph 163 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-01T16:23:03.336 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 501 k 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.1 M 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-01T16:23:03.337 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 45 k 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common x86_64 2:19.0.0-2574.gd2271579.el9 ceph 134 k 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-01T16:23:03.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-01T16:23:03.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-01T16:23:03.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-01T16:23:03.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout:Installing weak dependencies: 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-01T16:23:03.342 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:23:03.343 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-01T16:23:03.343 INFO:teuthology.orchestra.run.smithi163.stdout:==================================================================================================== 2024-04-01T16:23:03.343 INFO:teuthology.orchestra.run.smithi163.stdout:Install 172 Packages 2024-04-01T16:23:03.343 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrade 24 Packages 2024-04-01T16:23:03.343 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:23:03.343 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 2.2 G 2024-04-01T16:23:03.343 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-01T16:23:04.484 INFO:teuthology.orchestra.run.smithi163.stdout:(1/196): ceph-19.0.0-2574.gd2271579.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-04-01T16:23:05.084 INFO:teuthology.orchestra.run.smithi189.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-01T16:23:05.085 INFO:teuthology.orchestra.run.smithi189.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-01T16:23:05.127 INFO:teuthology.orchestra.run.smithi189.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-01T16:23:05.128 INFO:teuthology.orchestra.run.smithi189.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-01T16:23:05.129 INFO:teuthology.orchestra.run.smithi189.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-01T16:23:05.131 INFO:teuthology.orchestra.run.smithi189.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-01T16:23:05.132 INFO:teuthology.orchestra.run.smithi189.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-01T16:23:05.134 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-01T16:23:05.136 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-01T16:23:05.225 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-04-01T16:23:05.260 INFO:teuthology.orchestra.run.smithi189.stdout:==================================================================================================== 2024-04-01T16:23:05.260 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-04-01T16:23:05.260 INFO:teuthology.orchestra.run.smithi189.stdout:==================================================================================================== 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph x86_64 2:19.0.0-2574.gd2271579.el9 ceph 6.6 k 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.4 M 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 69 M 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 443 M 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 889 k 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 6.1 M 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2574.gd2271579.el9 ceph 145 k 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 1.5 M 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 54 M 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr x86_64 2:19.0.0-2574.gd2271579.el9 ceph 1.5 M 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 141 k 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 3.5 M 2024-04-01T16:23:05.261 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 20 M 2024-04-01T16:23:05.262 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 7.4 M 2024-04-01T16:23:05.262 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 49 k 2024-04-01T16:23:05.262 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 99 M 2024-04-01T16:23:05.262 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 290 M 2024-04-01T16:23:05.262 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw x86_64 2:19.0.0-2574.gd2271579.el9 ceph 9.8 M 2024-04-01T16:23:05.262 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 178 M 2024-04-01T16:23:05.262 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test x86_64 2:19.0.0-2574.gd2271579.el9 ceph 48 M 2024-04-01T16:23:05.262 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 680 M 2024-04-01T16:23:05.262 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 264 k 2024-04-01T16:23:05.262 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 762 k 2024-04-01T16:23:05.262 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror x86_64 2:19.0.0-2574.gd2271579.el9 ceph 225 k 2024-04-01T16:23:05.262 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell x86_64 2:19.0.0-2574.gd2271579.el9 ceph 27 k 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 18 k 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel x86_64 2:19.0.0-2574.gd2271579.el9 ceph 32 k 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 746 k 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.5 M 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel x86_64 2:19.0.0-2574.gd2271579.el9 ceph 127 k 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 109 k 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 45 M 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 52 M 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-01T16:23:05.263 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs x86_64 2:19.0.0-2574.gd2271579.el9 ceph 162 k 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 615 k 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados x86_64 2:19.0.0-2574.gd2271579.el9 ceph 320 k 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 769 k 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 298 k 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 1.1 M 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw x86_64 2:19.0.0-2574.gd2271579.el9 ceph 99 k 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 337 k 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 85 k 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 516 k 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.1 M 2024-04-01T16:23:05.264 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 52 M 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 171 k 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 1.3 M 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-01T16:23:05.265 INFO:teuthology.orchestra.run.smithi189.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.4 M 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.1 M 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-01T16:23:05.266 INFO:teuthology.orchestra.run.smithi189.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-01T16:23:05.267 INFO:teuthology.orchestra.run.smithi189.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-01T16:23:05.267 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-01T16:23:05.267 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-04-01T16:23:05.267 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-01T16:23:05.267 INFO:teuthology.orchestra.run.smithi189.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-01T16:23:05.267 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-01T16:23:05.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common x86_64 2:19.0.0-2574.gd2271579.el9 ceph 21 M 2024-04-01T16:23:05.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-debuginfo x86_64 2:19.0.0-2574.gd2271579.el9 ceph 23 M 2024-04-01T16:23:05.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 34 k 2024-04-01T16:23:05.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds x86_64 2:19.0.0-2574.gd2271579.el9 ceph 2.4 M 2024-04-01T16:23:05.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 249 k 2024-04-01T16:23:05.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon x86_64 2:19.0.0-2574.gd2271579.el9 ceph 4.7 M 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 17 M 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 16 k 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux x86_64 2:19.0.0-2574.gd2271579.el9 ceph 25 k 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite x86_64 2:19.0.0-2574.gd2271579.el9 ceph 163 k 2024-04-01T16:23:05.268 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-01T16:23:05.269 INFO:teuthology.orchestra.run.smithi189.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-01T16:23:05.269 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-01T16:23:05.269 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-01T16:23:05.269 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-01T16:23:05.269 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 501 k 2024-04-01T16:23:05.269 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-01T16:23:05.269 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.1 M 2024-04-01T16:23:05.269 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-01T16:23:05.269 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-01T16:23:05.269 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-01T16:23:05.269 INFO:teuthology.orchestra.run.smithi189.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-01T16:23:05.269 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-01T16:23:05.270 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 45 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common x86_64 2:19.0.0-2574.gd2271579.el9 ceph 134 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-01T16:23:05.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-01T16:23:05.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-01T16:23:05.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-01T16:23:05.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-01T16:23:05.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-01T16:23:05.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-01T16:23:05.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-01T16:23:05.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-01T16:23:05.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-01T16:23:05.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-01T16:23:05.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-01T16:23:05.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-01T16:23:05.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-01T16:23:05.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-01T16:23:05.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout:Installing weak dependencies: 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-04-01T16:23:05.275 INFO:teuthology.orchestra.run.smithi189.stdout:==================================================================================================== 2024-04-01T16:23:05.276 INFO:teuthology.orchestra.run.smithi189.stdout:Install 172 Packages 2024-04-01T16:23:05.276 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 24 Packages 2024-04-01T16:23:05.276 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:23:05.276 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 2.2 G 2024-04-01T16:23:05.276 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-04-01T16:23:06.469 INFO:teuthology.orchestra.run.smithi189.stdout:(1/196): ceph-19.0.0-2574.gd2271579.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-04-01T16:23:07.550 INFO:teuthology.orchestra.run.smithi163.stdout:(2/196): ceph-base-19.0.0-2574.gd2271579.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-04-01T16:23:09.861 INFO:teuthology.orchestra.run.smithi189.stdout:(2/196): ceph-base-19.0.0-2574.gd2271579.el9.x8 1.4 MB/s | 5.4 MB 00:03 2024-04-01T16:23:15.866 INFO:teuthology.orchestra.run.smithi163.stdout:(3/196): ceph-common-19.0.0-2574.gd2271579.el9. 1.8 MB/s | 21 MB 00:11 2024-04-01T16:23:16.694 INFO:teuthology.orchestra.run.smithi189.stdout:(3/196): ceph-common-19.0.0-2574.gd2271579.el9. 2.0 MB/s | 21 MB 00:10 2024-04-01T16:23:21.666 INFO:teuthology.orchestra.run.smithi163.stdout:(4/196): ceph-base-debuginfo-19.0.0-2574.gd2271 3.9 MB/s | 69 MB 00:17 2024-04-01T16:23:22.207 INFO:teuthology.orchestra.run.smithi163.stdout:(5/196): ceph-debuginfo-19.0.0-2574.gd2271579.e 3.6 MB/s | 23 MB 00:06 2024-04-01T16:23:22.257 INFO:teuthology.orchestra.run.smithi163.stdout:(6/196): ceph-fuse-19.0.0-2574.gd2271579.el9.x8 1.5 MB/s | 889 kB 00:00 2024-04-01T16:23:22.366 INFO:teuthology.orchestra.run.smithi163.stdout:(7/196): ceph-immutable-object-cache-19.0.0-257 1.3 MB/s | 145 kB 00:00 2024-04-01T16:23:22.925 INFO:teuthology.orchestra.run.smithi163.stdout:(8/196): ceph-immutable-object-cache-debuginfo- 2.6 MB/s | 1.5 MB 00:00 2024-04-01T16:23:23.700 INFO:teuthology.orchestra.run.smithi163.stdout:(9/196): ceph-mds-19.0.0-2574.gd2271579.el9.x86 3.0 MB/s | 2.4 MB 00:00 2024-04-01T16:23:24.287 INFO:teuthology.orchestra.run.smithi163.stdout:(10/196): ceph-fuse-debuginfo-19.0.0-2574.gd227 2.9 MB/s | 6.1 MB 00:02 2024-04-01T16:23:24.825 INFO:teuthology.orchestra.run.smithi163.stdout:(11/196): ceph-mgr-19.0.0-2574.gd2271579.el9.x8 2.8 MB/s | 1.5 MB 00:00 2024-04-01T16:23:28.901 INFO:teuthology.orchestra.run.smithi189.stdout:(4/196): ceph-debuginfo-19.0.0-2574.gd2271579.e 1.9 MB/s | 23 MB 00:12 2024-04-01T16:23:29.435 INFO:teuthology.orchestra.run.smithi189.stdout:(5/196): ceph-fuse-19.0.0-2574.gd2271579.el9.x8 1.6 MB/s | 889 kB 00:00 2024-04-01T16:23:30.093 INFO:teuthology.orchestra.run.smithi163.stdout:(12/196): ceph-mgr-debuginfo-19.0.0-2574.gd2271 3.8 MB/s | 20 MB 00:05 2024-04-01T16:23:31.517 INFO:teuthology.orchestra.run.smithi163.stdout:(13/196): ceph-mon-19.0.0-2574.gd2271579.el9.x8 3.3 MB/s | 4.7 MB 00:01 2024-04-01T16:23:32.402 INFO:teuthology.orchestra.run.smithi189.stdout:(6/196): ceph-base-debuginfo-19.0.0-2574.gd2271 2.6 MB/s | 69 MB 00:26 2024-04-01T16:23:32.644 INFO:teuthology.orchestra.run.smithi189.stdout:(7/196): ceph-fuse-debuginfo-19.0.0-2574.gd2271 1.9 MB/s | 6.1 MB 00:03 2024-04-01T16:23:32.677 INFO:teuthology.orchestra.run.smithi189.stdout:(8/196): ceph-immutable-object-cache-19.0.0-257 528 kB/s | 145 kB 00:00 2024-04-01T16:23:33.544 INFO:teuthology.orchestra.run.smithi189.stdout:(9/196): ceph-immutable-object-cache-debuginfo- 1.6 MB/s | 1.5 MB 00:00 2024-04-01T16:23:33.686 INFO:teuthology.orchestra.run.smithi189.stdout:(10/196): ceph-mds-19.0.0-2574.gd2271579.el9.x8 2.3 MB/s | 2.4 MB 00:01 2024-04-01T16:23:34.286 INFO:teuthology.orchestra.run.smithi189.stdout:(11/196): ceph-mgr-19.0.0-2574.gd2271579.el9.x8 2.5 MB/s | 1.5 MB 00:00 2024-04-01T16:23:40.920 INFO:teuthology.orchestra.run.smithi189.stdout:(12/196): ceph-mgr-debuginfo-19.0.0-2574.gd2271 3.0 MB/s | 20 MB 00:06 2024-04-01T16:23:43.661 INFO:teuthology.orchestra.run.smithi189.stdout:(13/196): ceph-mon-19.0.0-2574.gd2271579.el9.x8 1.7 MB/s | 4.7 MB 00:02 2024-04-01T16:24:08.405 INFO:teuthology.orchestra.run.smithi163.stdout:(14/196): ceph-mds-debuginfo-19.0.0-2574.gd2271 1.2 MB/s | 54 MB 00:44 2024-04-01T16:24:13.499 INFO:teuthology.orchestra.run.smithi189.stdout:(14/196): ceph-mds-debuginfo-19.0.0-2574.gd2271 1.3 MB/s | 54 MB 00:39 2024-04-01T16:24:19.895 INFO:teuthology.orchestra.run.smithi163.stdout:(15/196): ceph-osd-19.0.0-2574.gd2271579.el9.x8 1.5 MB/s | 17 MB 00:11 2024-04-01T16:24:20.349 INFO:teuthology.orchestra.run.smithi189.stdout:(15/196): ceph-osd-19.0.0-2574.gd2271579.el9.x8 2.5 MB/s | 17 MB 00:06 2024-04-01T16:24:32.860 INFO:teuthology.orchestra.run.smithi163.stdout:(16/196): ceph-mon-debuginfo-19.0.0-2574.gd2271 1.6 MB/s | 99 MB 01:01 2024-04-01T16:24:38.543 INFO:teuthology.orchestra.run.smithi163.stdout:(17/196): ceph-radosgw-19.0.0-2574.gd2271579.el 1.7 MB/s | 9.8 MB 00:05 2024-04-01T16:24:39.338 INFO:teuthology.orchestra.run.smithi189.stdout:(16/196): ceph-mon-debuginfo-19.0.0-2574.gd2271 1.8 MB/s | 99 MB 00:55 2024-04-01T16:24:42.046 INFO:teuthology.orchestra.run.smithi189.stdout:(17/196): ceph-radosgw-19.0.0-2574.gd2271579.el 3.6 MB/s | 9.8 MB 00:02 2024-04-01T16:25:41.898 INFO:teuthology.orchestra.run.smithi189.stdout:(18/196): ceph-common-debuginfo-19.0.0-2574.gd2 2.9 MB/s | 443 MB 02:32 2024-04-01T16:25:42.089 INFO:teuthology.orchestra.run.smithi189.stdout:(19/196): ceph-selinux-19.0.0-2574.gd2271579.el 132 kB/s | 25 kB 00:00 2024-04-01T16:25:48.558 INFO:teuthology.orchestra.run.smithi163.stdout:(18/196): ceph-radosgw-debuginfo-19.0.0-2574.gd 2.5 MB/s | 178 MB 01:10 2024-04-01T16:25:48.700 INFO:teuthology.orchestra.run.smithi163.stdout:(19/196): ceph-selinux-19.0.0-2574.gd2271579.el 178 kB/s | 25 kB 00:00 2024-04-01T16:25:58.399 INFO:teuthology.orchestra.run.smithi163.stdout:(20/196): ceph-common-debuginfo-19.0.0-2574.gd2 2.6 MB/s | 443 MB 02:50 2024-04-01T16:26:01.446 INFO:teuthology.orchestra.run.smithi189.stdout:(20/196): ceph-test-19.0.0-2574.gd2271579.el9.x 2.5 MB/s | 48 MB 00:19 2024-04-01T16:26:03.548 INFO:teuthology.orchestra.run.smithi163.stdout:(21/196): ceph-test-19.0.0-2574.gd2271579.el9.x 3.2 MB/s | 48 MB 00:14 2024-04-01T16:26:03.773 INFO:teuthology.orchestra.run.smithi163.stdout:(22/196): cephfs-mirror-19.0.0-2574.gd2271579.e 1.0 MB/s | 225 kB 00:00 2024-04-01T16:26:03.873 INFO:teuthology.orchestra.run.smithi163.stdout:(23/196): cephfs-shell-19.0.0-2574.gd2271579.el 273 kB/s | 27 kB 00:00 2024-04-01T16:26:03.999 INFO:teuthology.orchestra.run.smithi163.stdout:(24/196): libcephfs-devel-19.0.0-2574.gd2271579 256 kB/s | 32 kB 00:00 2024-04-01T16:26:04.266 INFO:teuthology.orchestra.run.smithi163.stdout:(25/196): libcephfs2-19.0.0-2574.gd2271579.el9. 2.7 MB/s | 746 kB 00:00 2024-04-01T16:26:06.224 INFO:teuthology.orchestra.run.smithi163.stdout:(26/196): libcephfs2-debuginfo-19.0.0-2574.gd22 2.8 MB/s | 5.5 MB 00:01 2024-04-01T16:26:06.333 INFO:teuthology.orchestra.run.smithi163.stdout:(27/196): libcephsqlite-19.0.0-2574.gd2271579.e 1.5 MB/s | 163 kB 00:00 2024-04-01T16:26:06.442 INFO:teuthology.orchestra.run.smithi163.stdout:(28/196): librados-devel-19.0.0-2574.gd2271579. 1.2 MB/s | 127 kB 00:00 2024-04-01T16:26:06.542 INFO:teuthology.orchestra.run.smithi163.stdout:(29/196): librados-devel-debuginfo-19.0.0-2574. 1.1 MB/s | 109 kB 00:00 2024-04-01T16:26:15.085 INFO:teuthology.orchestra.run.smithi189.stdout:(21/196): ceph-osd-debuginfo-19.0.0-2574.gd2271 2.5 MB/s | 290 MB 01:54 2024-04-01T16:26:15.485 INFO:teuthology.orchestra.run.smithi189.stdout:(22/196): cephfs-mirror-19.0.0-2574.gd2271579.e 565 kB/s | 225 kB 00:00 2024-04-01T16:26:15.586 INFO:teuthology.orchestra.run.smithi189.stdout:(23/196): cephfs-shell-19.0.0-2574.gd2271579.el 273 kB/s | 27 kB 00:00 2024-04-01T16:26:15.686 INFO:teuthology.orchestra.run.smithi189.stdout:(24/196): libcephfs-devel-19.0.0-2574.gd2271579 320 kB/s | 32 kB 00:00 2024-04-01T16:26:16.028 INFO:teuthology.orchestra.run.smithi189.stdout:(25/196): libcephfs2-19.0.0-2574.gd2271579.el9. 2.1 MB/s | 746 kB 00:00 2024-04-01T16:26:17.945 INFO:teuthology.orchestra.run.smithi189.stdout:(26/196): libcephfs2-debuginfo-19.0.0-2574.gd22 2.8 MB/s | 5.5 MB 00:01 2024-04-01T16:26:18.061 INFO:teuthology.orchestra.run.smithi189.stdout:(27/196): libcephsqlite-19.0.0-2574.gd2271579.e 1.4 MB/s | 163 kB 00:00 2024-04-01T16:26:18.179 INFO:teuthology.orchestra.run.smithi189.stdout:(28/196): librados-devel-19.0.0-2574.gd2271579. 1.1 MB/s | 127 kB 00:00 2024-04-01T16:26:18.296 INFO:teuthology.orchestra.run.smithi189.stdout:(29/196): librados-devel-debuginfo-19.0.0-2574. 940 kB/s | 109 kB 00:00 2024-04-01T16:26:21.865 INFO:teuthology.orchestra.run.smithi163.stdout:(30/196): ceph-osd-debuginfo-19.0.0-2574.gd2271 2.4 MB/s | 290 MB 02:01 2024-04-01T16:26:22.340 INFO:teuthology.orchestra.run.smithi163.stdout:(31/196): librados2-debuginfo-19.0.0-2574.gd227 2.9 MB/s | 45 MB 00:15 2024-04-01T16:26:22.415 INFO:teuthology.orchestra.run.smithi163.stdout:(32/196): libradosstriper1-19.0.0-2574.gd227157 912 kB/s | 501 kB 00:00 2024-04-01T16:26:23.641 INFO:teuthology.orchestra.run.smithi163.stdout:(33/196): librgw2-19.0.0-2574.gd2271579.el9.x86 4.2 MB/s | 5.1 MB 00:01 2024-04-01T16:26:23.769 INFO:teuthology.orchestra.run.smithi163.stdout:(34/196): python3-ceph-argparse-19.0.0-2574.gd2 354 kB/s | 45 kB 00:00 2024-04-01T16:26:23.883 INFO:teuthology.orchestra.run.smithi163.stdout:(35/196): python3-ceph-common-19.0.0-2574.gd227 1.2 MB/s | 134 kB 00:00 2024-04-01T16:26:23.991 INFO:teuthology.orchestra.run.smithi163.stdout:(36/196): python3-cephfs-19.0.0-2574.gd2271579. 1.5 MB/s | 162 kB 00:00 2024-04-01T16:26:24.216 INFO:teuthology.orchestra.run.smithi163.stdout:(37/196): python3-cephfs-debuginfo-19.0.0-2574. 2.7 MB/s | 615 kB 00:00 2024-04-01T16:26:24.325 INFO:teuthology.orchestra.run.smithi163.stdout:(38/196): python3-rados-19.0.0-2574.gd2271579.e 2.9 MB/s | 320 kB 00:00 2024-04-01T16:26:24.559 INFO:teuthology.orchestra.run.smithi163.stdout:(39/196): python3-rados-debuginfo-19.0.0-2574.g 3.2 MB/s | 769 kB 00:00 2024-04-01T16:26:24.684 INFO:teuthology.orchestra.run.smithi163.stdout:(40/196): python3-rbd-19.0.0-2574.gd2271579.el9 2.3 MB/s | 298 kB 00:00 2024-04-01T16:26:24.976 INFO:teuthology.orchestra.run.smithi163.stdout:(41/196): python3-rbd-debuginfo-19.0.0-2574.gd2 3.9 MB/s | 1.1 MB 00:00 2024-04-01T16:26:25.076 INFO:teuthology.orchestra.run.smithi163.stdout:(42/196): python3-rgw-19.0.0-2574.gd2271579.el9 1.0 MB/s | 99 kB 00:00 2024-04-01T16:26:25.193 INFO:teuthology.orchestra.run.smithi163.stdout:(43/196): python3-rgw-debuginfo-19.0.0-2574.gd2 2.8 MB/s | 337 kB 00:00 2024-04-01T16:26:25.294 INFO:teuthology.orchestra.run.smithi163.stdout:(44/196): rbd-fuse-19.0.0-2574.gd2271579.el9.x8 861 kB/s | 85 kB 00:00 2024-04-01T16:26:25.535 INFO:teuthology.orchestra.run.smithi163.stdout:(45/196): rbd-fuse-debuginfo-19.0.0-2574.gd2271 2.1 MB/s | 516 kB 00:00 2024-04-01T16:26:26.278 INFO:teuthology.orchestra.run.smithi163.stdout:(46/196): rbd-mirror-19.0.0-2574.gd2271579.el9. 4.2 MB/s | 3.1 MB 00:00 2024-04-01T16:26:27.061 INFO:teuthology.orchestra.run.smithi189.stdout:(30/196): ceph-radosgw-debuginfo-19.0.0-2574.gd 1.7 MB/s | 178 MB 01:45 2024-04-01T16:26:27.495 INFO:teuthology.orchestra.run.smithi189.stdout:(31/196): libradosstriper1-19.0.0-2574.gd227157 1.1 MB/s | 501 kB 00:00 2024-04-01T16:26:30.620 INFO:teuthology.orchestra.run.smithi189.stdout:(32/196): librados2-debuginfo-19.0.0-2574.gd227 3.7 MB/s | 45 MB 00:12 2024-04-01T16:26:32.195 INFO:teuthology.orchestra.run.smithi189.stdout:(33/196): librgw2-19.0.0-2574.gd2271579.el9.x86 3.3 MB/s | 5.1 MB 00:01 2024-04-01T16:26:32.303 INFO:teuthology.orchestra.run.smithi189.stdout:(34/196): python3-ceph-argparse-19.0.0-2574.gd2 421 kB/s | 45 kB 00:00 2024-04-01T16:26:32.420 INFO:teuthology.orchestra.run.smithi189.stdout:(35/196): python3-ceph-common-19.0.0-2574.gd227 1.1 MB/s | 134 kB 00:00 2024-04-01T16:26:32.587 INFO:teuthology.orchestra.run.smithi189.stdout:(36/196): python3-cephfs-19.0.0-2574.gd2271579. 976 kB/s | 162 kB 00:00 2024-04-01T16:26:32.821 INFO:teuthology.orchestra.run.smithi189.stdout:(37/196): python3-cephfs-debuginfo-19.0.0-2574. 2.6 MB/s | 615 kB 00:00 2024-04-01T16:26:32.947 INFO:teuthology.orchestra.run.smithi189.stdout:(38/196): python3-rados-19.0.0-2574.gd2271579.e 2.5 MB/s | 320 kB 00:00 2024-04-01T16:26:33.246 INFO:teuthology.orchestra.run.smithi189.stdout:(39/196): python3-rados-debuginfo-19.0.0-2574.g 2.5 MB/s | 769 kB 00:00 2024-04-01T16:26:33.372 INFO:teuthology.orchestra.run.smithi189.stdout:(40/196): python3-rbd-19.0.0-2574.gd2271579.el9 2.3 MB/s | 298 kB 00:00 2024-04-01T16:26:33.755 INFO:teuthology.orchestra.run.smithi189.stdout:(41/196): python3-rbd-debuginfo-19.0.0-2574.gd2 2.9 MB/s | 1.1 MB 00:00 2024-04-01T16:26:33.905 INFO:teuthology.orchestra.run.smithi189.stdout:(42/196): python3-rgw-19.0.0-2574.gd2271579.el9 667 kB/s | 99 kB 00:00 2024-04-01T16:26:34.039 INFO:teuthology.orchestra.run.smithi189.stdout:(43/196): python3-rgw-debuginfo-19.0.0-2574.gd2 2.5 MB/s | 337 kB 00:00 2024-04-01T16:26:34.140 INFO:teuthology.orchestra.run.smithi189.stdout:(44/196): rbd-fuse-19.0.0-2574.gd2271579.el9.x8 860 kB/s | 85 kB 00:00 2024-04-01T16:26:34.365 INFO:teuthology.orchestra.run.smithi189.stdout:(45/196): rbd-fuse-debuginfo-19.0.0-2574.gd2271 2.3 MB/s | 516 kB 00:00 2024-04-01T16:26:36.015 INFO:teuthology.orchestra.run.smithi189.stdout:(46/196): rbd-mirror-19.0.0-2574.gd2271579.el9. 1.9 MB/s | 3.1 MB 00:01 2024-04-01T16:26:37.535 INFO:teuthology.orchestra.run.smithi163.stdout:(47/196): librbd1-debuginfo-19.0.0-2574.gd22715 3.4 MB/s | 52 MB 00:15 2024-04-01T16:26:38.068 INFO:teuthology.orchestra.run.smithi163.stdout:(48/196): rbd-mirror-debuginfo-19.0.0-2574.gd22 4.4 MB/s | 52 MB 00:11 2024-04-01T16:26:38.102 INFO:teuthology.orchestra.run.smithi163.stdout:(49/196): rbd-nbd-19.0.0-2574.gd2271579.el9.x86 303 kB/s | 171 kB 00:00 2024-04-01T16:26:38.194 INFO:teuthology.orchestra.run.smithi163.stdout:(50/196): ceph-grafana-dashboards-19.0.0-2574.g 373 kB/s | 34 kB 00:00 2024-04-01T16:26:38.352 INFO:teuthology.orchestra.run.smithi163.stdout:(51/196): ceph-mgr-cephadm-19.0.0-2574.gd227157 898 kB/s | 141 kB 00:00 2024-04-01T16:26:38.545 INFO:teuthology.orchestra.run.smithi163.stdout:(52/196): rbd-nbd-debuginfo-19.0.0-2574.gd22715 2.7 MB/s | 1.3 MB 00:00 2024-04-01T16:26:39.537 INFO:teuthology.orchestra.run.smithi163.stdout:(53/196): ceph-mgr-dashboard-19.0.0-2574.gd2271 3.0 MB/s | 3.5 MB 00:01 2024-04-01T16:26:39.637 INFO:teuthology.orchestra.run.smithi163.stdout:(54/196): ceph-mgr-modules-core-19.0.0-2574.gd2 2.5 MB/s | 249 kB 00:00 2024-04-01T16:26:39.728 INFO:teuthology.orchestra.run.smithi163.stdout:(55/196): ceph-mgr-rook-19.0.0-2574.gd2271579.e 542 kB/s | 49 kB 00:00 2024-04-01T16:26:39.812 INFO:teuthology.orchestra.run.smithi163.stdout:(56/196): ceph-prometheus-alerts-19.0.0-2574.gd 199 kB/s | 16 kB 00:00 2024-04-01T16:26:39.987 INFO:teuthology.orchestra.run.smithi163.stdout:(57/196): ceph-volume-19.0.0-2574.gd2271579.el9 1.5 MB/s | 264 kB 00:00 2024-04-01T16:26:40.338 INFO:teuthology.orchestra.run.smithi163.stdout:(58/196): cephadm-19.0.0-2574.gd2271579.el9.noa 2.1 MB/s | 762 kB 00:00 2024-04-01T16:26:40.430 INFO:teuthology.orchestra.run.smithi163.stdout:(59/196): cephfs-top-19.0.0-2574.gd2271579.el9. 201 kB/s | 18 kB 00:00 2024-04-01T16:26:40.622 INFO:teuthology.orchestra.run.smithi163.stdout:(60/196): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2024-04-01T16:26:40.680 INFO:teuthology.orchestra.run.smithi163.stdout:(61/196): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 920 kB 00:00 2024-04-01T16:26:40.722 INFO:teuthology.orchestra.run.smithi163.stdout:(62/196): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-04-01T16:26:40.773 INFO:teuthology.orchestra.run.smithi163.stdout:(63/196): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2024-04-01T16:26:40.806 INFO:teuthology.orchestra.run.smithi163.stdout:(64/196): flexiblas-3.0.4-8.el9.x86_64.rpm 971 kB/s | 32 kB 00:00 2024-04-01T16:26:40.923 INFO:teuthology.orchestra.run.smithi163.stdout:(65/196): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-01T16:26:40.957 INFO:teuthology.orchestra.run.smithi163.stdout:(66/196): flexiblas-openblas-openmp-3.0.4-8.el9 521 kB/s | 17 kB 00:00 2024-04-01T16:26:40.990 INFO:teuthology.orchestra.run.smithi163.stdout:(67/196): libaio-devel-0.3.111-13.el9.x86_64.rp 309 kB/s | 10 kB 00:00 2024-04-01T16:26:41.124 INFO:teuthology.orchestra.run.smithi163.stdout:(68/196): ceph-mgr-diskprediction-local-19.0.0- 2.9 MB/s | 7.4 MB 00:02 2024-04-01T16:26:41.157 INFO:teuthology.orchestra.run.smithi163.stdout:(69/196): libpmemobj-1.12.1-1.el9.x86_64.rpm 958 kB/s | 159 kB 00:00 2024-04-01T16:26:41.183 INFO:teuthology.orchestra.run.smithi163.stdout:(70/196): librabbitmq-0.11.0-7.el9.x86_64.rpm 785 kB/s | 44 kB 00:00 2024-04-01T16:26:41.225 INFO:teuthology.orchestra.run.smithi163.stdout:(71/196): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2024-04-01T16:26:41.267 INFO:teuthology.orchestra.run.smithi163.stdout:(72/196): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2024-04-01T16:26:41.292 INFO:teuthology.orchestra.run.smithi163.stdout:(73/196): libzstd-devel-1.5.1-2.el9.x86_64.rpm 756 kB/s | 46 kB 00:00 2024-04-01T16:26:41.326 INFO:teuthology.orchestra.run.smithi163.stdout:(74/196): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-04-01T16:26:41.384 INFO:teuthology.orchestra.run.smithi163.stdout:(75/196): lua-5.4.4-4.el9.x86_64.rpm 2.1 MB/s | 187 kB 00:00 2024-04-01T16:26:41.417 INFO:teuthology.orchestra.run.smithi163.stdout:(76/196): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.4 MB/s | 217 kB 00:00 2024-04-01T16:26:41.443 INFO:teuthology.orchestra.run.smithi163.stdout:(77/196): openblas-0.3.21-2.el9.x86_64.rpm 611 kB/s | 34 kB 00:00 2024-04-01T16:26:41.593 INFO:teuthology.orchestra.run.smithi163.stdout:(78/196): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-04-01T16:26:41.660 INFO:teuthology.orchestra.run.smithi163.stdout:(79/196): postgresql-13.14-1.el9.x86_64.rpm 7.5 MB/s | 1.5 MB 00:00 2024-04-01T16:26:41.702 INFO:teuthology.orchestra.run.smithi163.stdout:(80/196): postgresql-contrib-13.14-1.el9.x86_64 8.1 MB/s | 817 kB 00:00 2024-04-01T16:26:41.727 INFO:teuthology.orchestra.run.smithi163.stdout:(81/196): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 132 kB 00:00 2024-04-01T16:26:41.869 INFO:teuthology.orchestra.run.smithi163.stdout:(82/196): postgresql-server-13.14-1.el9.x86_64. 35 MB/s | 5.7 MB 00:00 2024-04-01T16:26:41.920 INFO:teuthology.orchestra.run.smithi163.stdout:(83/196): protobuf-3.14.0-13.el9.x86_64.rpm 5.7 MB/s | 1.0 MB 00:00 2024-04-01T16:26:41.945 INFO:teuthology.orchestra.run.smithi163.stdout:(84/196): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 78 kB 00:00 2024-04-01T16:26:42.087 INFO:teuthology.orchestra.run.smithi163.stdout:(85/196): python3-babel-2.9.1-2.el9.noarch.rpm 35 MB/s | 5.8 MB 00:00 2024-04-01T16:26:42.112 INFO:teuthology.orchestra.run.smithi163.stdout:(86/196): python3-jsonpatch-1.21-16.el9.noarch. 161 kB/s | 24 kB 00:00 2024-04-01T16:26:42.146 INFO:teuthology.orchestra.run.smithi163.stdout:(87/196): python3-jsonpointer-2.0-4.el9.noarch. 564 kB/s | 18 kB 00:00 2024-04-01T16:26:42.171 INFO:teuthology.orchestra.run.smithi163.stdout:(88/196): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2024-04-01T16:26:42.196 INFO:teuthology.orchestra.run.smithi163.stdout:(89/196): python3-markupsafe-1.1.1-12.el9.x86_6 1.3 MB/s | 32 kB 00:00 2024-04-01T16:26:42.346 INFO:teuthology.orchestra.run.smithi163.stdout:(90/196): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 4.8 MB 00:00 2024-04-01T16:26:42.380 INFO:teuthology.orchestra.run.smithi163.stdout:(91/196): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 217 kB 00:00 2024-04-01T16:26:42.422 INFO:teuthology.orchestra.run.smithi163.stdout:(92/196): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2024-04-01T16:26:42.447 INFO:teuthology.orchestra.run.smithi163.stdout:(93/196): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-04-01T16:26:42.490 INFO:teuthology.orchestra.run.smithi163.stdout:(94/196): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-04-01T16:26:42.515 INFO:teuthology.orchestra.run.smithi163.stdout:(95/196): python3-protobuf-3.14.0-13.el9.noarch 3.6 MB/s | 238 kB 00:00 2024-04-01T16:26:42.557 INFO:teuthology.orchestra.run.smithi163.stdout:(96/196): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2024-04-01T16:26:42.582 INFO:teuthology.orchestra.run.smithi163.stdout:(97/196): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-04-01T16:26:42.615 INFO:teuthology.orchestra.run.smithi163.stdout:(98/196): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-04-01T16:26:42.641 INFO:teuthology.orchestra.run.smithi163.stdout:(99/196): python3-requests-oauthlib-1.3.0-12.el 748 kB/s | 43 kB 00:00 2024-04-01T16:26:42.875 INFO:teuthology.orchestra.run.smithi189.stdout:(47/196): rbd-mirror-debuginfo-19.0.0-2574.gd22 7.6 MB/s | 52 MB 00:06 2024-04-01T16:26:42.957 INFO:teuthology.orchestra.run.smithi163.stdout:(100/196): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-04-01T16:26:42.985 INFO:teuthology.orchestra.run.smithi163.stdout:(101/196): python3-toml-0.10.2-6.el9.noarch.rpm 118 kB/s | 39 kB 00:00 2024-04-01T16:26:43.008 INFO:teuthology.orchestra.run.smithi163.stdout:(102/196): python3-wcwidth-0.2.5-8.el9.noarch.r 837 kB/s | 41 kB 00:00 2024-04-01T16:26:43.041 INFO:teuthology.orchestra.run.smithi163.stdout:(103/196): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2024-04-01T16:26:43.067 INFO:teuthology.orchestra.run.smithi163.stdout:(104/196): qatlib-service-24.02.0-1.el9.x86_64. 622 kB/s | 35 kB 00:00 2024-04-01T16:26:43.093 INFO:teuthology.orchestra.run.smithi163.stdout:(105/196): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 46 kB 00:00 2024-04-01T16:26:43.126 INFO:teuthology.orchestra.run.smithi163.stdout:(106/196): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 300 kB 00:00 2024-04-01T16:26:43.151 INFO:teuthology.orchestra.run.smithi163.stdout:(107/196): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-04-01T16:26:43.165 INFO:teuthology.orchestra.run.smithi189.stdout:(48/196): rbd-nbd-19.0.0-2574.gd2271579.el9.x86 589 kB/s | 171 kB 00:00 2024-04-01T16:26:43.177 INFO:teuthology.orchestra.run.smithi163.stdout:(108/196): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2024-04-01T16:26:43.202 INFO:teuthology.orchestra.run.smithi163.stdout:(109/196): zlib-devel-1.2.11-40.el9.x86_64.rpm 902 kB/s | 44 kB 00:00 2024-04-01T16:26:43.227 INFO:teuthology.orchestra.run.smithi163.stdout:(110/196): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2024-04-01T16:26:43.277 INFO:teuthology.orchestra.run.smithi163.stdout:(111/196): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2024-04-01T16:26:43.327 INFO:teuthology.orchestra.run.smithi163.stdout:(112/196): python3-cryptography-36.0.1-4.el9.x8 12 MB/s | 1.1 MB 00:00 2024-04-01T16:26:43.353 INFO:teuthology.orchestra.run.smithi163.stdout:(113/196): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-04-01T16:26:43.378 INFO:teuthology.orchestra.run.smithi163.stdout:(114/196): python3-pycparser-2.20-6.el9.noarch. 2.5 MB/s | 124 kB 00:00 2024-04-01T16:26:43.412 INFO:teuthology.orchestra.run.smithi163.stdout:(115/196): python3-urllib3-1.26.5-5.el9.noarch. 3.2 MB/s | 187 kB 00:00 2024-04-01T16:26:43.416 INFO:teuthology.orchestra.run.smithi189.stdout:(49/196): rbd-nbd-debuginfo-19.0.0-2574.gd22715 5.2 MB/s | 1.3 MB 00:00 2024-04-01T16:26:43.503 INFO:teuthology.orchestra.run.smithi163.stdout:(116/196): jq-1.6-16.el9.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2024-04-01T16:26:43.604 INFO:teuthology.orchestra.run.smithi163.stdout:(117/196): libgfortran-11.4.1-3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2024-04-01T16:26:43.654 INFO:teuthology.orchestra.run.smithi163.stdout:(118/196): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-04-01T16:26:43.688 INFO:teuthology.orchestra.run.smithi163.stdout:(119/196): python3-requests-2.25.1-8.el9.noarch 1.5 MB/s | 125 kB 00:00 2024-04-01T16:26:43.763 INFO:teuthology.orchestra.run.smithi163.stdout:(120/196): elfutils-libelf-devel-0.190-2.el9.x8 200 kB/s | 21 kB 00:00 2024-04-01T16:26:43.830 INFO:teuthology.orchestra.run.smithi163.stdout:(121/196): libuuid-devel-2.37.4-18.el9.x86_64.r 180 kB/s | 25 kB 00:00 2024-04-01T16:26:43.938 INFO:teuthology.orchestra.run.smithi163.stdout:(122/196): python3-devel-3.9.17-2.el9.x86_64.rp 2.2 MB/s | 245 kB 00:00 2024-04-01T16:26:43.966 INFO:teuthology.orchestra.run.smithi189.stdout:(50/196): librbd1-debuginfo-19.0.0-2574.gd22715 3.2 MB/s | 52 MB 00:16 2024-04-01T16:26:43.997 INFO:teuthology.orchestra.run.smithi163.stdout:(123/196): python3-jinja2-2.11.3-5.el9.noarch.r 4.2 MB/s | 248 kB 00:00 2024-04-01T16:26:44.007 INFO:teuthology.orchestra.run.smithi189.stdout:(51/196): ceph-grafana-dashboards-19.0.0-2574.g 57 kB/s | 34 kB 00:00 2024-04-01T16:26:44.066 INFO:teuthology.orchestra.run.smithi189.stdout:(52/196): ceph-mgr-cephadm-19.0.0-2574.gd227157 1.4 MB/s | 141 kB 00:00 2024-04-01T16:26:44.115 INFO:teuthology.orchestra.run.smithi163.stdout:(124/196): openssl-devel-3.0.7-27.el9.x86_64.rp 12 MB/s | 4.1 MB 00:00 2024-04-01T16:26:44.148 INFO:teuthology.orchestra.run.smithi163.stdout:(125/196): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 627 kB/s | 94 kB 00:00 2024-04-01T16:26:44.238 INFO:teuthology.orchestra.run.smithi163.stdout:(126/196): lua-devel-5.4.4-4.el9.x86_64.rpm 183 kB/s | 22 kB 00:00 2024-04-01T16:26:44.399 INFO:teuthology.orchestra.run.smithi189.stdout:(53/196): ceph-mgr-dashboard-19.0.0-2574.gd2271 9.1 MB/s | 3.5 MB 00:00 2024-04-01T16:26:44.472 INFO:teuthology.orchestra.run.smithi163.stdout:(127/196): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-04-01T16:26:44.483 INFO:teuthology.orchestra.run.smithi189.stdout:(54/196): ceph-mgr-modules-core-19.0.0-2574.gd2 2.9 MB/s | 249 kB 00:00 2024-04-01T16:26:44.567 INFO:teuthology.orchestra.run.smithi189.stdout:(55/196): ceph-mgr-rook-19.0.0-2574.gd2271579.e 599 kB/s | 49 kB 00:00 2024-04-01T16:26:44.642 INFO:teuthology.orchestra.run.smithi189.stdout:(56/196): ceph-prometheus-alerts-19.0.0-2574.gd 222 kB/s | 16 kB 00:00 2024-04-01T16:26:44.742 INFO:teuthology.orchestra.run.smithi189.stdout:(57/196): ceph-volume-19.0.0-2574.gd2271579.el9 2.6 MB/s | 264 kB 00:00 2024-04-01T16:26:44.851 INFO:teuthology.orchestra.run.smithi189.stdout:(58/196): cephadm-19.0.0-2574.gd2271579.el9.noa 6.9 MB/s | 762 kB 00:00 2024-04-01T16:26:44.906 INFO:teuthology.orchestra.run.smithi163.stdout:(128/196): abseil-cpp-20211102.0-3.el9.x86_64.r 821 kB/s | 548 kB 00:00 2024-04-01T16:26:44.951 INFO:teuthology.orchestra.run.smithi189.stdout:(59/196): cephfs-top-19.0.0-2574.gd2271579.el9. 183 kB/s | 18 kB 00:00 2024-04-01T16:26:45.006 INFO:teuthology.orchestra.run.smithi163.stdout:(129/196): grpc-data-1.46.7-10.el9.noarch.rpm 196 kB/s | 19 kB 00:00 2024-04-01T16:26:45.058 INFO:teuthology.orchestra.run.smithi163.stdout:(130/196): gperftools-libs-2.9.1-2.el9.x86_64.r 528 kB/s | 309 kB 00:00 2024-04-01T16:26:45.144 INFO:teuthology.orchestra.run.smithi189.stdout:(60/196): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2024-04-01T16:26:45.167 INFO:teuthology.orchestra.run.smithi163.stdout:(131/196): libarrow-doc-9.0.0-10.el9.noarch.rpm 240 kB/s | 26 kB 00:00 2024-04-01T16:26:45.202 INFO:teuthology.orchestra.run.smithi189.stdout:(61/196): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 920 kB 00:00 2024-04-01T16:26:45.244 INFO:teuthology.orchestra.run.smithi189.stdout:(62/196): boost-program-options-1.75.0-8.el9.x8 2.6 MB/s | 106 kB 00:00 2024-04-01T16:26:45.276 INFO:teuthology.orchestra.run.smithi163.stdout:(132/196): liboath-2.6.7-2.el9.x86_64.rpm 451 kB/s | 49 kB 00:00 2024-04-01T16:26:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:(63/196): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 307 kB 00:00 2024-04-01T16:26:45.311 INFO:teuthology.orchestra.run.smithi189.stdout:(64/196): flexiblas-3.0.4-8.el9.x86_64.rpm 1.3 MB/s | 32 kB 00:00 2024-04-01T16:26:45.393 INFO:teuthology.orchestra.run.smithi163.stdout:(133/196): libunwind-1.6.2-1.el9.x86_64.rpm 579 kB/s | 67 kB 00:00 2024-04-01T16:26:45.420 INFO:teuthology.orchestra.run.smithi189.stdout:(65/196): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-04-01T16:26:45.445 INFO:teuthology.orchestra.run.smithi189.stdout:(66/196): flexiblas-openblas-openmp-3.0.4-8.el9 705 kB/s | 17 kB 00:00 2024-04-01T16:26:45.470 INFO:teuthology.orchestra.run.smithi189.stdout:(67/196): libaio-devel-0.3.111-13.el9.x86_64.rp 416 kB/s | 10 kB 00:00 2024-04-01T16:26:45.493 INFO:teuthology.orchestra.run.smithi163.stdout:(134/196): libarrow-9.0.0-10.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-04-01T16:26:45.512 INFO:teuthology.orchestra.run.smithi189.stdout:(68/196): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2024-04-01T16:26:45.527 INFO:teuthology.orchestra.run.smithi163.stdout:(135/196): luarocks-3.9.2-1.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-04-01T16:26:45.546 INFO:teuthology.orchestra.run.smithi189.stdout:(69/196): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-01T16:26:45.596 INFO:teuthology.orchestra.run.smithi189.stdout:(70/196): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-04-01T16:26:45.627 INFO:teuthology.orchestra.run.smithi163.stdout:(136/196): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.1 MB/s | 838 kB 00:00 2024-04-01T16:26:45.646 INFO:teuthology.orchestra.run.smithi189.stdout:(71/196): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-04-01T16:26:45.680 INFO:teuthology.orchestra.run.smithi189.stdout:(72/196): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-04-01T16:26:45.722 INFO:teuthology.orchestra.run.smithi189.stdout:(73/196): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 282 kB 00:00 2024-04-01T16:26:45.736 INFO:teuthology.orchestra.run.smithi163.stdout:(137/196): python3-bcrypt-3.2.2-1.el9.x86_64.rp 404 kB/s | 43 kB 00:00 2024-04-01T16:26:45.764 INFO:teuthology.orchestra.run.smithi189.stdout:(74/196): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-04-01T16:26:45.778 INFO:teuthology.orchestra.run.smithi163.stdout:(138/196): python3-asyncssh-2.13.2-5.el9.noarch 2.1 MB/s | 548 kB 00:00 2024-04-01T16:26:45.806 INFO:teuthology.orchestra.run.smithi189.stdout:(75/196): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2024-04-01T16:26:45.840 INFO:teuthology.orchestra.run.smithi189.stdout:(76/196): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-04-01T16:26:45.845 INFO:teuthology.orchestra.run.smithi163.stdout:(139/196): python3-cachetools-4.2.4-1.el9.noarc 298 kB/s | 32 kB 00:00 2024-04-01T16:26:45.878 INFO:teuthology.orchestra.run.smithi163.stdout:(140/196): python3-certifi-2021.10.8-2.el9.noar 150 kB/s | 15 kB 00:00 2024-04-01T16:26:45.954 INFO:teuthology.orchestra.run.smithi163.stdout:(141/196): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2024-04-01T16:26:45.981 INFO:teuthology.orchestra.run.smithi189.stdout:(77/196): openblas-openmp-0.3.21-2.el9.x86_64.r 34 MB/s | 4.7 MB 00:00 2024-04-01T16:26:46.021 INFO:teuthology.orchestra.run.smithi163.stdout:(142/196): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-04-01T16:26:46.063 INFO:teuthology.orchestra.run.smithi163.stdout:(143/196): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-04-01T16:26:46.090 INFO:teuthology.orchestra.run.smithi189.stdout:(78/196): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.5 MB 00:00 2024-04-01T16:26:46.130 INFO:teuthology.orchestra.run.smithi163.stdout:(144/196): python3-colorama-0.4.4-12.el9.noarch 327 kB/s | 35 kB 00:00 2024-04-01T16:26:46.157 INFO:teuthology.orchestra.run.smithi189.stdout:(79/196): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 817 kB 00:00 2024-04-01T16:26:46.188 INFO:teuthology.orchestra.run.smithi163.stdout:(145/196): python3-google-auth-2.28.2-1.el9.noa 1.6 MB/s | 203 kB 00:00 2024-04-01T16:26:46.208 INFO:teuthology.orchestra.run.smithi189.stdout:(80/196): postgresql-private-libs-13.14-1.el9.x 2.6 MB/s | 132 kB 00:00 2024-04-01T16:26:46.305 INFO:teuthology.orchestra.run.smithi163.stdout:(146/196): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-04-01T16:26:46.359 INFO:teuthology.orchestra.run.smithi189.stdout:(81/196): postgresql-server-13.14-1.el9.x86_64. 38 MB/s | 5.7 MB 00:00 2024-04-01T16:26:46.425 INFO:teuthology.orchestra.run.smithi189.stdout:(82/196): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-04-01T16:26:46.431 INFO:teuthology.orchestra.run.smithi163.stdout:(147/196): python3-grpcio-1.46.7-10.el9.x86_64. 6.8 MB/s | 2.0 MB 00:00 2024-04-01T16:26:46.456 INFO:teuthology.orchestra.run.smithi163.stdout:(148/196): python3-jaraco-8.2.1-3.el9.noarch.rp 71 kB/s | 11 kB 00:00 2024-04-01T16:26:46.459 INFO:teuthology.orchestra.run.smithi189.stdout:(83/196): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2024-04-01T16:26:46.540 INFO:teuthology.orchestra.run.smithi163.stdout:(149/196): python3-jaraco-classes-3.2.1-5.el9.n 164 kB/s | 18 kB 00:00 2024-04-01T16:26:46.565 INFO:teuthology.orchestra.run.smithi163.stdout:(150/196): python3-jaraco-collections-3.0.0-8.e 214 kB/s | 23 kB 00:00 2024-04-01T16:26:46.584 INFO:teuthology.orchestra.run.smithi189.stdout:(84/196): ceph-mgr-diskprediction-local-19.0.0- 2.9 MB/s | 7.4 MB 00:02 2024-04-01T16:26:46.649 INFO:teuthology.orchestra.run.smithi163.stdout:(151/196): python3-jaraco-functools-3.5.0-2.el9 180 kB/s | 19 kB 00:00 2024-04-01T16:26:46.674 INFO:teuthology.orchestra.run.smithi163.stdout:(152/196): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2024-04-01T16:26:46.718 INFO:teuthology.orchestra.run.smithi189.stdout:(85/196): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2024-04-01T16:26:46.743 INFO:teuthology.orchestra.run.smithi189.stdout:(86/196): python3-jsonpatch-1.21-16.el9.noarch. 170 kB/s | 24 kB 00:00 2024-04-01T16:26:46.776 INFO:teuthology.orchestra.run.smithi189.stdout:(87/196): python3-jsonpointer-2.0-4.el9.noarch. 564 kB/s | 18 kB 00:00 2024-04-01T16:26:46.782 INFO:teuthology.orchestra.run.smithi163.stdout:(153/196): python3-kubernetes-26.1.0-2.el9.noar 7.7 MB/s | 1.0 MB 00:00 2024-04-01T16:26:46.808 INFO:teuthology.orchestra.run.smithi163.stdout:(154/196): python3-logutils-0.3.5-21.el9.noarch 348 kB/s | 46 kB 00:00 2024-04-01T16:26:46.810 INFO:teuthology.orchestra.run.smithi189.stdout:(88/196): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 144 kB 00:00 2024-04-01T16:26:46.835 INFO:teuthology.orchestra.run.smithi189.stdout:(89/196): python3-markupsafe-1.1.1-12.el9.x86_6 560 kB/s | 32 kB 00:00 2024-04-01T16:26:46.908 INFO:teuthology.orchestra.run.smithi163.stdout:(155/196): python3-more-itertools-8.12.0-2.el9. 631 kB/s | 79 kB 00:00 2024-04-01T16:26:46.934 INFO:teuthology.orchestra.run.smithi163.stdout:(156/196): python3-natsort-7.1.1-5.el9.noarch.r 462 kB/s | 58 kB 00:00 2024-04-01T16:26:46.977 INFO:teuthology.orchestra.run.smithi189.stdout:(90/196): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2024-04-01T16:26:47.003 INFO:teuthology.orchestra.run.smithi189.stdout:(91/196): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-04-01T16:26:47.017 INFO:teuthology.orchestra.run.smithi163.stdout:(157/196): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-04-01T16:26:47.034 INFO:teuthology.orchestra.run.smithi163.stdout:(158/196): python3-portend-3.1.0-2.el9.noarch.r 165 kB/s | 16 kB 00:00 2024-04-01T16:26:47.044 INFO:teuthology.orchestra.run.smithi189.stdout:(92/196): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2024-04-01T16:26:47.103 INFO:teuthology.orchestra.run.smithi189.stdout:(93/196): python3-packaging-20.9-5.el9.noarch.r 694 kB/s | 69 kB 00:00 2024-04-01T16:26:47.135 INFO:teuthology.orchestra.run.smithi163.stdout:(159/196): python3-pyOpenSSL-21.0.0-1.el9.noarc 772 kB/s | 90 kB 00:00 2024-04-01T16:26:47.137 INFO:teuthology.orchestra.run.smithi189.stdout:(94/196): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-04-01T16:26:47.160 INFO:teuthology.orchestra.run.smithi163.stdout:(160/196): python3-pyperclip-1.8.2-2.el9.noarch 226 kB/s | 28 kB 00:00 2024-04-01T16:26:47.162 INFO:teuthology.orchestra.run.smithi189.stdout:(95/196): python3-protobuf-3.14.0-13.el9.noarch 4.1 MB/s | 238 kB 00:00 2024-04-01T16:26:47.204 INFO:teuthology.orchestra.run.smithi189.stdout:(96/196): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2024-04-01T16:26:47.229 INFO:teuthology.orchestra.run.smithi189.stdout:(97/196): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-04-01T16:26:47.244 INFO:teuthology.orchestra.run.smithi163.stdout:(161/196): python3-repoze-lru-0.7-16.el9.noarch 285 kB/s | 31 kB 00:00 2024-04-01T16:26:47.262 INFO:teuthology.orchestra.run.smithi189.stdout:(98/196): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-04-01T16:26:47.277 INFO:teuthology.orchestra.run.smithi163.stdout:(162/196): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-04-01T16:26:47.288 INFO:teuthology.orchestra.run.smithi189.stdout:(99/196): python3-requests-oauthlib-1.3.0-12.el 749 kB/s | 43 kB 00:00 2024-04-01T16:26:47.321 INFO:teuthology.orchestra.run.smithi189.stdout:(100/196): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 39 kB 00:00 2024-04-01T16:26:47.353 INFO:teuthology.orchestra.run.smithi163.stdout:(163/196): python3-rsa-4.9-2.el9.noarch.rpm 548 kB/s | 59 kB 00:00 2024-04-01T16:26:47.386 INFO:teuthology.orchestra.run.smithi163.stdout:(164/196): python3-tempora-5.0.0-2.el9.noarch.r 331 kB/s | 36 kB 00:00 2024-04-01T16:26:47.461 INFO:teuthology.orchestra.run.smithi163.stdout:(165/196): python3-typing-extensions-4.4.0-2.el 472 kB/s | 51 kB 00:00 2024-04-01T16:26:47.495 INFO:teuthology.orchestra.run.smithi163.stdout:(166/196): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-01T16:26:47.571 INFO:teuthology.orchestra.run.smithi163.stdout:(167/196): python3-websocket-client-1.2.3-2.el9 830 kB/s | 90 kB 00:00 2024-04-01T16:26:47.612 INFO:teuthology.orchestra.run.smithi163.stdout:(168/196): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-01T16:26:47.613 INFO:teuthology.orchestra.run.smithi189.stdout:(101/196): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2024-04-01T16:26:47.638 INFO:teuthology.orchestra.run.smithi189.stdout:(102/196): python3-wcwidth-0.2.5-8.el9.noarch.r 136 kB/s | 41 kB 00:00 2024-04-01T16:26:47.679 INFO:teuthology.orchestra.run.smithi163.stdout:(169/196): python3-zc-lockfile-2.0-10.el9.noarc 185 kB/s | 20 kB 00:00 2024-04-01T16:26:47.680 INFO:teuthology.orchestra.run.smithi189.stdout:(103/196): qatlib-24.02.0-1.el9.x86_64.rpm 5.3 MB/s | 220 kB 00:00 2024-04-01T16:26:47.705 INFO:teuthology.orchestra.run.smithi189.stdout:(104/196): qatlib-service-24.02.0-1.el9.x86_64. 533 kB/s | 35 kB 00:00 2024-04-01T16:26:47.721 INFO:teuthology.orchestra.run.smithi163.stdout:(170/196): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-01T16:26:47.747 INFO:teuthology.orchestra.run.smithi189.stdout:(105/196): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-04-01T16:26:47.773 INFO:teuthology.orchestra.run.smithi189.stdout:(106/196): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 300 kB 00:00 2024-04-01T16:26:47.814 INFO:teuthology.orchestra.run.smithi189.stdout:(107/196): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-04-01T16:26:47.830 INFO:teuthology.orchestra.run.smithi163.stdout:(171/196): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-01T16:26:47.840 INFO:teuthology.orchestra.run.smithi189.stdout:(108/196): uuid-1.6.2-55.el9.x86_64.rpm 857 kB/s | 56 kB 00:00 2024-04-01T16:26:47.865 INFO:teuthology.orchestra.run.smithi189.stdout:(109/196): zlib-devel-1.2.11-40.el9.x86_64.rpm 900 kB/s | 44 kB 00:00 2024-04-01T16:26:47.891 INFO:teuthology.orchestra.run.smithi189.stdout:(110/196): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2024-04-01T16:26:47.924 INFO:teuthology.orchestra.run.smithi189.stdout:(111/196): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-04-01T16:26:47.975 INFO:teuthology.orchestra.run.smithi189.stdout:(112/196): python3-cryptography-36.0.1-4.el9.x8 14 MB/s | 1.1 MB 00:00 2024-04-01T16:26:48.000 INFO:teuthology.orchestra.run.smithi189.stdout:(113/196): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2024-04-01T16:26:48.025 INFO:teuthology.orchestra.run.smithi189.stdout:(114/196): python3-pycparser-2.20-6.el9.noarch. 2.5 MB/s | 124 kB 00:00 2024-04-01T16:26:48.059 INFO:teuthology.orchestra.run.smithi189.stdout:(115/196): python3-urllib3-1.26.5-5.el9.noarch. 3.2 MB/s | 187 kB 00:00 2024-04-01T16:26:48.318 INFO:teuthology.orchestra.run.smithi189.stdout:(116/196): jq-1.6-16.el9.x86_64.rpm 647 kB/s | 187 kB 00:00 2024-04-01T16:26:48.402 INFO:teuthology.orchestra.run.smithi189.stdout:(117/196): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-01T16:26:48.451 INFO:teuthology.orchestra.run.smithi189.stdout:(118/196): libgfortran-11.4.1-3.el9.x86_64.rpm 2.0 MB/s | 803 kB 00:00 2024-04-01T16:26:48.502 INFO:teuthology.orchestra.run.smithi189.stdout:(119/196): python3-requests-2.25.1-8.el9.noarch 1.2 MB/s | 125 kB 00:00 2024-04-01T16:26:48.535 INFO:teuthology.orchestra.run.smithi189.stdout:(120/196): elfutils-libelf-devel-0.190-2.el9.x8 261 kB/s | 21 kB 00:00 2024-04-01T16:26:48.581 INFO:teuthology.orchestra.run.smithi163.stdout:(172/196): librados2-19.0.0-2574.gd2271579.el9. 4.0 MB/s | 3.4 MB 00:00 2024-04-01T16:26:48.603 INFO:teuthology.orchestra.run.smithi189.stdout:(121/196): libuuid-devel-2.37.4-18.el9.x86_64.r 256 kB/s | 25 kB 00:00 2024-04-01T16:26:48.673 INFO:teuthology.orchestra.run.smithi163.stdout:(173/196): NetworkManager-1.47.2-1.el9.x86_64.r 25 MB/s | 2.3 MB 00:00 2024-04-01T16:26:48.711 INFO:teuthology.orchestra.run.smithi189.stdout:(122/196): python3-devel-3.9.17-2.el9.x86_64.rp 2.2 MB/s | 245 kB 00:00 2024-04-01T16:26:48.748 INFO:teuthology.orchestra.run.smithi163.stdout:(174/196): librbd1-19.0.0-2574.gd2271579.el9.x8 3.4 MB/s | 3.1 MB 00:00 2024-04-01T16:26:48.761 INFO:teuthology.orchestra.run.smithi189.stdout:(123/196): python3-jinja2-2.11.3-5.el9.noarch.r 4.9 MB/s | 248 kB 00:00 2024-04-01T16:26:48.815 INFO:teuthology.orchestra.run.smithi163.stdout:(175/196): NetworkManager-libnm-1.47.2-1.el9.x8 13 MB/s | 1.8 MB 00:00 2024-04-01T16:26:48.840 INFO:teuthology.orchestra.run.smithi163.stdout:(176/196): NetworkManager-team-1.47.2-1.el9.x86 520 kB/s | 41 kB 00:00 2024-04-01T16:26:48.853 INFO:teuthology.orchestra.run.smithi189.stdout:(124/196): openssl-devel-3.0.7-27.el9.x86_64.rp 13 MB/s | 4.1 MB 00:00 2024-04-01T16:26:48.874 INFO:teuthology.orchestra.run.smithi163.stdout:(177/196): NetworkManager-tui-1.47.2-1.el9.x86_ 4.2 MB/s | 247 kB 00:00 2024-04-01T16:26:48.887 INFO:teuthology.orchestra.run.smithi189.stdout:(125/196): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 754 kB/s | 94 kB 00:00 2024-04-01T16:26:48.916 INFO:teuthology.orchestra.run.smithi163.stdout:(178/196): xfsdump-3.1.12-4.el9.x86_64.rpm 4.3 MB/s | 321 kB 00:00 2024-04-01T16:26:48.954 INFO:teuthology.orchestra.run.smithi189.stdout:(126/196): lua-devel-5.4.4-4.el9.x86_64.rpm 225 kB/s | 22 kB 00:00 2024-04-01T16:26:49.008 INFO:teuthology.orchestra.run.smithi163.stdout:(179/196): elfutils-debuginfod-client-0.190-2.e 402 kB/s | 36 kB 00:00 2024-04-01T16:26:49.059 INFO:teuthology.orchestra.run.smithi163.stdout:(180/196): acl-2.3.1-4.el9.x86_64.rpm 395 kB/s | 71 kB 00:00 2024-04-01T16:26:49.117 INFO:teuthology.orchestra.run.smithi163.stdout:(181/196): elfutils-libelf-0.190-2.el9.x86_64.r 1.7 MB/s | 192 kB 00:00 2024-04-01T16:26:49.176 INFO:teuthology.orchestra.run.smithi163.stdout:(182/196): elfutils-libs-0.190-2.el9.x86_64.rpm 2.1 MB/s | 256 kB 00:00 2024-04-01T16:26:49.196 INFO:teuthology.orchestra.run.smithi189.stdout:(127/196): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-04-01T16:26:49.201 INFO:teuthology.orchestra.run.smithi163.stdout:(183/196): libacl-2.3.1-4.el9.x86_64.rpm 278 kB/s | 23 kB 00:00 2024-04-01T16:26:49.230 INFO:teuthology.orchestra.run.smithi189.stdout:(128/196): abseil-cpp-20211102.0-3.el9.x86_64.r 2.0 MB/s | 548 kB 00:00 2024-04-01T16:26:49.263 INFO:teuthology.orchestra.run.smithi189.stdout:(129/196): gperftools-libs-2.9.1-2.el9.x86_64.r 4.7 MB/s | 309 kB 00:00 2024-04-01T16:26:49.283 INFO:teuthology.orchestra.run.smithi189.stdout:(130/196): grpc-data-1.46.7-10.el9.noarch.rpm 396 kB/s | 19 kB 00:00 2024-04-01T16:26:49.301 INFO:teuthology.orchestra.run.smithi163.stdout:(184/196): libblkid-2.37.4-18.el9.x86_64.rpm 873 kB/s | 108 kB 00:00 2024-04-01T16:26:49.327 INFO:teuthology.orchestra.run.smithi163.stdout:(185/196): libfdisk-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 155 kB 00:00 2024-04-01T16:26:49.333 INFO:teuthology.orchestra.run.smithi189.stdout:(131/196): libarrow-doc-9.0.0-10.el9.noarch.rpm 564 kB/s | 26 kB 00:00 2024-04-01T16:26:49.411 INFO:teuthology.orchestra.run.smithi163.stdout:(186/196): libsmartcols-2.37.4-18.el9.x86_64.rp 775 kB/s | 64 kB 00:00 2024-04-01T16:26:49.433 INFO:teuthology.orchestra.run.smithi189.stdout:(132/196): libarrow-9.0.0-10.el9.x86_64.rpm 26 MB/s | 4.4 MB 00:00 2024-04-01T16:26:49.444 INFO:teuthology.orchestra.run.smithi163.stdout:(187/196): libmount-2.37.4-18.el9.x86_64.rpm 957 kB/s | 136 kB 00:00 2024-04-01T16:26:49.459 INFO:teuthology.orchestra.run.smithi189.stdout:(133/196): liboath-2.6.7-2.el9.x86_64.rpm 433 kB/s | 49 kB 00:00 2024-04-01T16:26:49.484 INFO:teuthology.orchestra.run.smithi189.stdout:(134/196): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-01T16:26:49.503 INFO:teuthology.orchestra.run.smithi163.stdout:(188/196): libuuid-2.37.4-18.el9.x86_64.rpm 315 kB/s | 29 kB 00:00 2024-04-01T16:26:49.509 INFO:teuthology.orchestra.run.smithi189.stdout:(135/196): luarocks-3.9.2-1.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-04-01T16:26:49.551 INFO:teuthology.orchestra.run.smithi189.stdout:(136/196): parquet-libs-9.0.0-10.el9.x86_64.rpm 13 MB/s | 838 kB 00:00 2024-04-01T16:26:49.585 INFO:teuthology.orchestra.run.smithi189.stdout:(137/196): python3-asyncssh-2.13.2-5.el9.noarch 8.1 MB/s | 548 kB 00:00 2024-04-01T16:26:49.610 INFO:teuthology.orchestra.run.smithi189.stdout:(138/196): python3-bcrypt-3.2.2-1.el9.x86_64.rp 823 kB/s | 43 kB 00:00 2024-04-01T16:26:49.635 INFO:teuthology.orchestra.run.smithi189.stdout:(139/196): python3-cachetools-4.2.4-1.el9.noarc 651 kB/s | 32 kB 00:00 2024-04-01T16:26:49.636 INFO:teuthology.orchestra.run.smithi163.stdout:(189/196): openssl-3.0.7-27.el9.x86_64.rpm 6.3 MB/s | 1.2 MB 00:00 2024-04-01T16:26:49.661 INFO:teuthology.orchestra.run.smithi189.stdout:(140/196): python3-certifi-2021.10.8-2.el9.noar 306 kB/s | 15 kB 00:00 2024-04-01T16:26:49.694 INFO:teuthology.orchestra.run.smithi189.stdout:(141/196): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-04-01T16:26:49.728 INFO:teuthology.orchestra.run.smithi189.stdout:(142/196): python3-cherrypy-18.6.1-2.el9.noarch 5.4 MB/s | 358 kB 00:00 2024-04-01T16:26:49.770 INFO:teuthology.orchestra.run.smithi189.stdout:(143/196): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.2 MB/s | 303 kB 00:00 2024-04-01T16:26:49.795 INFO:teuthology.orchestra.run.smithi163.stdout:(190/196): openssl-libs-3.0.7-27.el9.x86_64.rpm 7.4 MB/s | 2.2 MB 00:00 2024-04-01T16:26:49.795 INFO:teuthology.orchestra.run.smithi189.stdout:(144/196): python3-colorama-0.4.4-12.el9.noarch 555 kB/s | 35 kB 00:00 2024-04-01T16:26:49.829 INFO:teuthology.orchestra.run.smithi189.stdout:(145/196): python3-google-auth-2.28.2-1.el9.noa 3.4 MB/s | 203 kB 00:00 2024-04-01T16:26:49.904 INFO:teuthology.orchestra.run.smithi189.stdout:(146/196): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-04-01T16:26:49.920 INFO:teuthology.orchestra.run.smithi163.stdout:(191/196): util-linux-2.37.4-18.el9.x86_64.rpm 8.1 MB/s | 2.3 MB 00:00 2024-04-01T16:26:49.930 INFO:teuthology.orchestra.run.smithi189.stdout:(147/196): python3-grpcio-tools-1.46.7-10.el9.x 1.6 MB/s | 144 kB 00:00 2024-04-01T16:26:49.955 INFO:teuthology.orchestra.run.smithi189.stdout:(148/196): python3-jaraco-8.2.1-3.el9.noarch.rp 222 kB/s | 11 kB 00:00 2024-04-01T16:26:49.970 INFO:teuthology.orchestra.run.smithi163.stdout:(192/196): util-linux-core-2.37.4-18.el9.x86_64 2.6 MB/s | 465 kB 00:00 2024-04-01T16:26:49.980 INFO:teuthology.orchestra.run.smithi189.stdout:(149/196): python3-jaraco-classes-3.2.1-5.el9.n 359 kB/s | 18 kB 00:00 2024-04-01T16:26:50.005 INFO:teuthology.orchestra.run.smithi189.stdout:(150/196): python3-jaraco-collections-3.0.0-8.e 472 kB/s | 23 kB 00:00 2024-04-01T16:26:50.021 INFO:teuthology.orchestra.run.smithi163.stdout:(193/196): util-linux-user-2.37.4-18.el9.x86_64 313 kB/s | 31 kB 00:00 2024-04-01T16:26:50.031 INFO:teuthology.orchestra.run.smithi189.stdout:(151/196): python3-jaraco-functools-3.5.0-2.el9 396 kB/s | 19 kB 00:00 2024-04-01T16:26:50.056 INFO:teuthology.orchestra.run.smithi189.stdout:(152/196): python3-jaraco-text-3.2.0-6.el9.noar 399 kB/s | 20 kB 00:00 2024-04-01T16:26:50.107 INFO:teuthology.orchestra.run.smithi189.stdout:(153/196): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-04-01T16:26:50.138 INFO:teuthology.orchestra.run.smithi163.stdout:(194/196): libacl-devel-2.3.1-4.el9.x86_64.rpm 641 kB/s | 74 kB 00:00 2024-04-01T16:26:50.157 INFO:teuthology.orchestra.run.smithi189.stdout:(154/196): python3-logutils-0.3.5-21.el9.noarch 519 kB/s | 46 kB 00:00 2024-04-01T16:26:50.182 INFO:teuthology.orchestra.run.smithi189.stdout:(155/196): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-04-01T16:26:50.207 INFO:teuthology.orchestra.run.smithi189.stdout:(156/196): python3-natsort-7.1.1-5.el9.noarch.r 1.2 MB/s | 58 kB 00:00 2024-04-01T16:26:50.238 INFO:teuthology.orchestra.run.smithi163.stdout:(195/196): xfsprogs-6.3.0-1.el9.x86_64.rpm 4.0 MB/s | 1.1 MB 00:00 2024-04-01T16:26:50.241 INFO:teuthology.orchestra.run.smithi189.stdout:(157/196): python3-pecan-1.4.2-3.el9.noarch.rpm 4.7 MB/s | 272 kB 00:00 2024-04-01T16:26:50.283 INFO:teuthology.orchestra.run.smithi189.stdout:(158/196): python3-portend-3.1.0-2.el9.noarch.r 228 kB/s | 16 kB 00:00 2024-04-01T16:26:50.308 INFO:teuthology.orchestra.run.smithi189.stdout:(159/196): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-01T16:26:50.334 INFO:teuthology.orchestra.run.smithi189.stdout:(160/196): python3-pyperclip-1.8.2-2.el9.noarch 582 kB/s | 28 kB 00:00 2024-04-01T16:26:50.359 INFO:teuthology.orchestra.run.smithi189.stdout:(161/196): python3-repoze-lru-0.7-16.el9.noarch 626 kB/s | 31 kB 00:00 2024-04-01T16:26:50.393 INFO:teuthology.orchestra.run.smithi189.stdout:(162/196): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-04-01T16:26:50.418 INFO:teuthology.orchestra.run.smithi189.stdout:(163/196): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-01T16:26:50.443 INFO:teuthology.orchestra.run.smithi189.stdout:(164/196): python3-tempora-5.0.0-2.el9.noarch.r 730 kB/s | 36 kB 00:00 2024-04-01T16:26:50.469 INFO:teuthology.orchestra.run.smithi189.stdout:(165/196): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-04-01T16:26:50.502 INFO:teuthology.orchestra.run.smithi189.stdout:(166/196): python3-webob-1.8.7-6.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-04-01T16:26:50.527 INFO:teuthology.orchestra.run.smithi189.stdout:(167/196): python3-websocket-client-1.2.3-2.el9 1.6 MB/s | 90 kB 00:00 2024-04-01T16:26:50.561 INFO:teuthology.orchestra.run.smithi189.stdout:(168/196): python3-werkzeug-2.0.3-3.el9.1.noarc 7.3 MB/s | 427 kB 00:00 2024-04-01T16:26:50.586 INFO:teuthology.orchestra.run.smithi189.stdout:(169/196): python3-zc-lockfile-2.0-10.el9.noarc 370 kB/s | 20 kB 00:00 2024-04-01T16:26:50.620 INFO:teuthology.orchestra.run.smithi189.stdout:(170/196): re2-20211101-3.el9.x86_64.rpm 3.3 MB/s | 192 kB 00:00 2024-04-01T16:26:50.687 INFO:teuthology.orchestra.run.smithi189.stdout:(171/196): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-01T16:26:51.596 INFO:teuthology.orchestra.run.smithi189.stdout:(172/196): librados2-19.0.0-2574.gd2271579.el9. 3.5 MB/s | 3.4 MB 00:00 2024-04-01T16:26:51.679 INFO:teuthology.orchestra.run.smithi189.stdout:(173/196): librbd1-19.0.0-2574.gd2271579.el9.x8 3.2 MB/s | 3.1 MB 00:00 2024-04-01T16:26:51.955 INFO:teuthology.orchestra.run.smithi189.stdout:(174/196): NetworkManager-1.47.2-1.el9.x86_64.r 6.4 MB/s | 2.3 MB 00:00 2024-04-01T16:26:51.997 INFO:teuthology.orchestra.run.smithi189.stdout:(175/196): NetworkManager-libnm-1.47.2-1.el9.x8 7.3 MB/s | 1.8 MB 00:00 2024-04-01T16:26:52.038 INFO:teuthology.orchestra.run.smithi189.stdout:(176/196): NetworkManager-team-1.47.2-1.el9.x86 1.0 MB/s | 41 kB 00:00 2024-04-01T16:26:52.063 INFO:teuthology.orchestra.run.smithi189.stdout:(177/196): NetworkManager-tui-1.47.2-1.el9.x86_ 3.7 MB/s | 247 kB 00:00 2024-04-01T16:26:52.114 INFO:teuthology.orchestra.run.smithi189.stdout:(178/196): xfsdump-3.1.12-4.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2024-04-01T16:26:52.239 INFO:teuthology.orchestra.run.smithi189.stdout:(179/196): acl-2.3.1-4.el9.x86_64.rpm 410 kB/s | 71 kB 00:00 2024-04-01T16:26:52.306 INFO:teuthology.orchestra.run.smithi189.stdout:(180/196): elfutils-debuginfod-client-0.190-2.e 190 kB/s | 36 kB 00:00 2024-04-01T16:26:52.340 INFO:teuthology.orchestra.run.smithi189.stdout:(181/196): elfutils-libelf-0.190-2.el9.x86_64.r 1.9 MB/s | 192 kB 00:00 2024-04-01T16:26:52.390 INFO:teuthology.orchestra.run.smithi189.stdout:(182/196): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-04-01T16:26:52.407 INFO:teuthology.orchestra.run.smithi189.stdout:(183/196): libacl-2.3.1-4.el9.x86_64.rpm 347 kB/s | 23 kB 00:00 2024-04-01T16:26:52.449 INFO:teuthology.orchestra.run.smithi189.stdout:(184/196): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 108 kB 00:00 2024-04-01T16:26:52.499 INFO:teuthology.orchestra.run.smithi189.stdout:(185/196): libfdisk-2.37.4-18.el9.x86_64.rpm 1.7 MB/s | 155 kB 00:00 2024-04-01T16:26:52.550 INFO:teuthology.orchestra.run.smithi189.stdout:(186/196): libmount-2.37.4-18.el9.x86_64.rpm 1.3 MB/s | 136 kB 00:00 2024-04-01T16:26:52.575 INFO:teuthology.orchestra.run.smithi189.stdout:(187/196): libsmartcols-2.37.4-18.el9.x86_64.rp 860 kB/s | 64 kB 00:00 2024-04-01T16:26:52.617 INFO:teuthology.orchestra.run.smithi189.stdout:(188/196): libuuid-2.37.4-18.el9.x86_64.rpm 434 kB/s | 29 kB 00:00 2024-04-01T16:26:52.734 INFO:teuthology.orchestra.run.smithi189.stdout:(189/196): openssl-3.0.7-27.el9.x86_64.rpm 7.7 MB/s | 1.2 MB 00:00 2024-04-01T16:26:52.834 INFO:teuthology.orchestra.run.smithi189.stdout:(190/196): openssl-libs-3.0.7-27.el9.x86_64.rpm 10 MB/s | 2.2 MB 00:00 2024-04-01T16:26:52.911 INFO:teuthology.orchestra.run.smithi189.stdout:(191/196): util-linux-core-2.37.4-18.el9.x86_64 6.1 MB/s | 465 kB 00:00 2024-04-01T16:26:52.968 INFO:teuthology.orchestra.run.smithi189.stdout:(192/196): util-linux-2.37.4-18.el9.x86_64.rpm 9.8 MB/s | 2.3 MB 00:00 2024-04-01T16:26:53.012 INFO:teuthology.orchestra.run.smithi189.stdout:(193/196): util-linux-user-2.37.4-18.el9.x86_64 312 kB/s | 31 kB 00:00 2024-04-01T16:26:53.088 INFO:teuthology.orchestra.run.smithi189.stdout:(194/196): xfsprogs-6.3.0-1.el9.x86_64.rpm 9.2 MB/s | 1.1 MB 00:00 2024-04-01T16:26:53.120 INFO:teuthology.orchestra.run.smithi189.stdout:(195/196): libacl-devel-2.3.1-4.el9.x86_64.rpm 700 kB/s | 74 kB 00:00 2024-04-01T16:27:15.742 INFO:teuthology.orchestra.run.smithi189.stdout:(196/196): ceph-test-debuginfo-19.0.0-2574.gd22 9.2 MB/s | 680 MB 01:14 2024-04-01T16:27:15.760 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-04-01T16:27:15.760 INFO:teuthology.orchestra.run.smithi189.stdout:Total 9.0 MB/s | 2.2 GB 04:10 2024-04-01T16:27:16.935 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-04-01T16:27:17.323 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-04-01T16:27:17.324 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-04-01T16:27:18.510 INFO:teuthology.orchestra.run.smithi163.stdout:(196/196): ceph-test-debuginfo-19.0.0-2574.gd22 8.5 MB/s | 680 MB 01:20 2024-04-01T16:27:18.521 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-01T16:27:18.521 INFO:teuthology.orchestra.run.smithi163.stdout:Total 8.8 MB/s | 2.2 GB 04:15 2024-04-01T16:27:19.663 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-01T16:27:20.052 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-01T16:27:20.052 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-01T16:27:31.807 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-04-01T16:27:31.808 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-04-01T16:27:34.568 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-01T16:27:34.569 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-01T16:27:51.543 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-04-01T16:27:54.359 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/220 2024-04-01T16:27:54.385 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_6 2/220 2024-04-01T16:27:54.421 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/220 2024-04-01T16:27:54.432 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-01T16:27:54.448 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/220 2024-04-01T16:27:54.479 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/220 2024-04-01T16:27:54.561 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/220 2024-04-01T16:27:54.648 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/220 2024-04-01T16:27:54.697 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/220 2024-04-01T16:27:54.740 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/220 2024-04-01T16:27:54.832 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/220 2024-04-01T16:27:55.248 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/220 2024-04-01T16:27:55.297 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librados2-2:19.0.0-2574.gd2271579.el9.x86_64 11/220 2024-04-01T16:27:55.446 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:19.0.0-2574.gd2271579.el9.x86_64 11/220 2024-04-01T16:27:55.481 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 12/220 2024-04-01T16:27:55.593 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 12/220 2024-04-01T16:27:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 13/220 2024-04-01T16:27:55.695 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 14/220 2024-04-01T16:27:56.028 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 15/220 2024-04-01T16:27:56.085 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-13.14-1.el9.x86_64 16/220 2024-04-01T16:27:56.111 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 17/220 2024-04-01T16:27:56.256 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 17/220 2024-04-01T16:27:56.287 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 18/220 2024-04-01T16:27:56.386 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 18/220 2024-04-01T16:27:56.439 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/220 2024-04-01T16:27:56.466 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 20/220 2024-04-01T16:27:56.525 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 20/220 2024-04-01T16:27:56.804 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 21/220 2024-04-01T16:27:56.873 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 21/220 2024-04-01T16:27:56.913 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/220 2024-04-01T16:27:57.216 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/220 2024-04-01T16:27:57.219 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/220 2024-04-01T16:27:57.245 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_6 2/220 2024-04-01T16:27:57.280 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/220 2024-04-01T16:27:57.325 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/220 2024-04-01T16:27:57.356 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/220 2024-04-01T16:27:57.363 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 24/220 2024-04-01T16:27:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/220 2024-04-01T16:27:57.450 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 24/220 2024-04-01T16:27:57.530 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/220 2024-04-01T16:27:57.581 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/220 2024-04-01T16:27:57.615 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/220 2024-04-01T16:27:57.655 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-04-01T16:27:57.694 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/220 2024-04-01T16:27:57.707 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-04-01T16:27:58.055 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-04-01T16:27:58.107 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/220 2024-04-01T16:27:58.147 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librados2-2:19.0.0-2574.gd2271579.el9.x86_64 11/220 2024-04-01T16:27:58.248 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/220 2024-04-01T16:27:58.296 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:19.0.0-2574.gd2271579.el9.x86_64 11/220 2024-04-01T16:27:58.332 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 12/220 2024-04-01T16:27:58.372 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/220 2024-04-01T16:27:58.404 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/220 2024-04-01T16:27:58.441 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/220 2024-04-01T16:27:58.453 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 12/220 2024-04-01T16:27:58.489 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 13/220 2024-04-01T16:27:58.498 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/220 2024-04-01T16:27:58.566 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 14/220 2024-04-01T16:27:58.611 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/220 2024-04-01T16:27:58.677 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/220 2024-04-01T16:27:58.720 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/220 2024-04-01T16:27:58.809 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 34/220 2024-04-01T16:27:58.852 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 35/220 2024-04-01T16:27:58.872 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 15/220 2024-04-01T16:27:58.928 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/220 2024-04-01T16:27:58.928 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-13.14-1.el9.x86_64 16/220 2024-04-01T16:27:58.954 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 17/220 2024-04-01T16:27:58.972 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/220 2024-04-01T16:27:59.005 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-5.4.4-4.el9.x86_64 38/220 2024-04-01T16:27:59.092 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 17/220 2024-04-01T16:27:59.119 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 39/220 2024-04-01T16:27:59.122 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 18/220 2024-04-01T16:27:59.158 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-common-2:19.0.0-2574.gd2271579.el9. 40/220 2024-04-01T16:27:59.210 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-argparse-2:19.0.0-2574.gd2271579.el 41/220 2024-04-01T16:27:59.221 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 18/220 2024-04-01T16:27:59.240 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_6 42/220 2024-04-01T16:27:59.274 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/220 2024-04-01T16:27:59.299 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 20/220 2024-04-01T16:27:59.355 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/220 2024-04-01T16:27:59.371 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 20/220 2024-04-01T16:27:59.417 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/220 2024-04-01T16:27:59.517 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/220 2024-04-01T16:27:59.661 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 21/220 2024-04-01T16:27:59.690 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/220 2024-04-01T16:27:59.708 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 21/220 2024-04-01T16:27:59.754 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/220 2024-04-01T16:27:59.782 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/220 2024-04-01T16:28:00.108 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/220 2024-04-01T16:28:00.274 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 24/220 2024-04-01T16:28:00.362 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 24/220 2024-04-01T16:28:00.441 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/220 2024-04-01T16:28:00.534 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/220 2024-04-01T16:28:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-04-01T16:28:00.619 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-04-01T16:28:00.626 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/220 2024-04-01T16:28:00.693 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-04-01T16:28:00.720 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-04-01T16:28:00.765 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 52/220 2024-04-01T16:28:00.833 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 53/220 2024-04-01T16:28:00.887 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-2:19.0.0-2574.gd2271579.el9.x86_6 54/220 2024-04-01T16:28:00.947 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-04-01T16:28:00.958 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 55/220 2024-04-01T16:28:01.117 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/220 2024-04-01T16:28:01.234 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/220 2024-04-01T16:28:01.266 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/220 2024-04-01T16:28:01.302 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/220 2024-04-01T16:28:01.359 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/220 2024-04-01T16:28:01.378 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/220 2024-04-01T16:28:01.468 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/220 2024-04-01T16:28:01.531 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/220 2024-04-01T16:28:01.574 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/220 2024-04-01T16:28:01.582 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/220 2024-04-01T16:28:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 34/220 2024-04-01T16:28:01.672 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/220 2024-04-01T16:28:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 35/220 2024-04-01T16:28:01.728 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/220 2024-04-01T16:28:01.775 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/220 2024-04-01T16:28:01.819 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/220 2024-04-01T16:28:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lua-5.4.4-4.el9.x86_64 38/220 2024-04-01T16:28:01.924 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/220 2024-04-01T16:28:01.962 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 39/220 2024-04-01T16:28:01.996 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-common-2:19.0.0-2574.gd2271579.el9. 40/220 2024-04-01T16:28:02.009 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/220 2024-04-01T16:28:02.046 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-argparse-2:19.0.0-2574.gd2271579.el 41/220 2024-04-01T16:28:02.078 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_6 42/220 2024-04-01T16:28:02.090 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/220 2024-04-01T16:28:02.192 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/220 2024-04-01T16:28:02.192 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/220 2024-04-01T16:28:02.234 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/220 2024-04-01T16:28:02.256 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/220 2024-04-01T16:28:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/220 2024-04-01T16:28:02.343 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/220 2024-04-01T16:28:02.353 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/220 2024-04-01T16:28:02.381 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/220 2024-04-01T16:28:02.444 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/220 2024-04-01T16:28:02.502 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/220 2024-04-01T16:28:02.528 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/220 2024-04-01T16:28:02.593 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/220 2024-04-01T16:28:02.681 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/220 2024-04-01T16:28:02.729 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/220 2024-04-01T16:28:02.766 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/220 2024-04-01T16:28:02.813 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/220 2024-04-01T16:28:02.939 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/220 2024-04-01T16:28:03.007 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 75/220 2024-04-01T16:28:03.053 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/220 2024-04-01T16:28:03.089 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/220 2024-04-01T16:28:03.122 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/220 2024-04-01T16:28:03.284 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/220 2024-04-01T16:28:03.301 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/220 2024-04-01T16:28:03.399 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/220 2024-04-01T16:28:03.459 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/220 2024-04-01T16:28:03.508 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/220 2024-04-01T16:28:03.559 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-04-01T16:28:03.586 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-04-01T16:28:03.590 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/220 2024-04-01T16:28:03.641 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/220 2024-04-01T16:28:03.660 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 52/220 2024-04-01T16:28:03.704 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/220 2024-04-01T16:28:03.729 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 53/220 2024-04-01T16:28:03.777 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados-devel-2:19.0.0-2574.gd2271579.el9.x86_6 54/220 2024-04-01T16:28:03.778 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/220 2024-04-01T16:28:03.817 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 55/220 2024-04-01T16:28:04.030 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/220 2024-04-01T16:28:04.088 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/220 2024-04-01T16:28:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/220 2024-04-01T16:28:04.261 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/220 2024-04-01T16:28:04.318 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 88/220 2024-04-01T16:28:04.358 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/220 2024-04-01T16:28:04.396 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fuse-2.9.9-15.el9.x86_64 90/220 2024-04-01T16:28:04.446 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 91/220 2024-04-01T16:28:04.478 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/220 2024-04-01T16:28:04.493 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 92/220 2024-04-01T16:28:04.560 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : uuid-1.6.2-55.el9.x86_64 93/220 2024-04-01T16:28:04.598 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/220 2024-04-01T16:28:04.620 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 94/220 2024-04-01T16:28:04.675 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 95/220 2024-04-01T16:28:04.678 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/220 2024-04-01T16:28:04.802 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 96/220 2024-04-01T16:28:04.845 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 97/220 2024-04-01T16:28:04.881 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 98/220 2024-04-01T16:28:04.886 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/220 2024-04-01T16:28:04.936 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/220 2024-04-01T16:28:04.943 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 99/220 2024-04-01T16:28:04.982 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 100/220 2024-04-01T16:28:05.006 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/220 2024-04-01T16:28:05.096 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/220 2024-04-01T16:28:05.136 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/220 2024-04-01T16:28:05.164 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 101/220 2024-04-01T16:28:05.174 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/220 2024-04-01T16:28:05.241 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/220 2024-04-01T16:28:05.281 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 102/220 2024-04-01T16:28:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/220 2024-04-01T16:28:05.338 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 103/220 2024-04-01T16:28:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/220 2024-04-01T16:28:05.374 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 104/220 2024-04-01T16:28:05.405 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/220 2024-04-01T16:28:05.430 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 105/220 2024-04-01T16:28:05.569 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-packaging-20.9-5.el9.noarch 106/220 2024-04-01T16:28:05.595 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/220 2024-04-01T16:28:05.640 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 107/220 2024-04-01T16:28:05.649 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/220 2024-04-01T16:28:05.678 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/220 2024-04-01T16:28:05.727 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/220 2024-04-01T16:28:05.855 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/220 2024-04-01T16:28:05.902 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 75/220 2024-04-01T16:28:05.947 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/220 2024-04-01T16:28:05.985 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/220 2024-04-01T16:28:06.018 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/220 2024-04-01T16:28:06.177 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/220 2024-04-01T16:28:06.347 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/220 2024-04-01T16:28:06.482 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/220 2024-04-01T16:28:06.538 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/220 2024-04-01T16:28:06.599 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/220 2024-04-01T16:28:06.615 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 108/220 2024-04-01T16:28:06.664 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 109/220 2024-04-01T16:28:06.697 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 110/220 2024-04-01T16:28:06.753 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 111/220 2024-04-01T16:28:06.867 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 112/220 2024-04-01T16:28:06.905 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 113/220 2024-04-01T16:28:07.075 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/220 2024-04-01T16:28:07.137 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-0.3.21-2.el9.x86_64 114/220 2024-04-01T16:28:07.169 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 115/220 2024-04-01T16:28:07.262 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 116/220 2024-04-01T16:28:07.349 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/220 2024-04-01T16:28:07.402 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/220 2024-04-01T16:28:07.602 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/220 2024-04-01T16:28:07.640 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 88/220 2024-04-01T16:28:07.680 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/220 2024-04-01T16:28:07.718 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : fuse-2.9.9-15.el9.x86_64 90/220 2024-04-01T16:28:07.767 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 91/220 2024-04-01T16:28:07.813 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 92/220 2024-04-01T16:28:07.870 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : uuid-1.6.2-55.el9.x86_64 93/220 2024-04-01T16:28:07.923 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 94/220 2024-04-01T16:28:07.964 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 95/220 2024-04-01T16:28:08.066 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 117/220 2024-04-01T16:28:08.089 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 96/220 2024-04-01T16:28:08.134 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 97/220 2024-04-01T16:28:08.169 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 98/220 2024-04-01T16:28:08.214 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 118/220 2024-04-01T16:28:08.221 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 99/220 2024-04-01T16:28:08.264 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 100/220 2024-04-01T16:28:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 101/220 2024-04-01T16:28:08.550 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 102/220 2024-04-01T16:28:08.603 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 103/220 2024-04-01T16:28:08.639 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 104/220 2024-04-01T16:28:08.695 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 105/220 2024-04-01T16:28:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-packaging-20.9-5.el9.noarch 106/220 2024-04-01T16:28:08.905 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 107/220 2024-04-01T16:28:09.725 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 119/220 2024-04-01T16:28:09.822 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 120/220 2024-04-01T16:28:09.860 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 121/220 2024-04-01T16:28:09.863 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 108/220 2024-04-01T16:28:09.891 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : jq-1.6-16.el9.x86_64 122/220 2024-04-01T16:28:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 109/220 2024-04-01T16:28:09.938 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/220 2024-04-01T16:28:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 110/220 2024-04-01T16:28:10.012 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 111/220 2024-04-01T16:28:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 112/220 2024-04-01T16:28:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 113/220 2024-04-01T16:28:10.316 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/220 2024-04-01T16:28:10.346 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 125/220 2024-04-01T16:28:10.396 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-0.3.21-2.el9.x86_64 114/220 2024-04-01T16:28:10.428 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 115/220 2024-04-01T16:28:10.449 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 125/220 2024-04-01T16:28:10.478 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 126/220 2024-04-01T16:28:10.521 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 116/220 2024-04-01T16:28:10.539 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/220 2024-04-01T16:28:11.051 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/220 2024-04-01T16:28:11.083 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 129/220 2024-04-01T16:28:11.199 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 129/220 2024-04-01T16:28:11.226 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 130/220 2024-04-01T16:28:11.315 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 117/220 2024-04-01T16:28:11.442 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 118/220 2024-04-01T16:28:12.959 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 119/220 2024-04-01T16:28:13.052 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 120/220 2024-04-01T16:28:13.082 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 121/220 2024-04-01T16:28:13.112 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : jq-1.6-16.el9.x86_64 122/220 2024-04-01T16:28:13.152 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/220 2024-04-01T16:28:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/220 2024-04-01T16:28:13.585 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 125/220 2024-04-01T16:28:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 125/220 2024-04-01T16:28:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 126/220 2024-04-01T16:28:13.818 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/220 2024-04-01T16:28:13.828 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 131/220 2024-04-01T16:28:13.873 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 131/220 2024-04-01T16:28:14.336 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/220 2024-04-01T16:28:14.363 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 129/220 2024-04-01T16:28:14.463 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 129/220 2024-04-01T16:28:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 130/220 2024-04-01T16:28:14.502 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 131/220 2024-04-01T16:28:14.542 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 132/220 2024-04-01T16:28:14.698 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 132/220 2024-04-01T16:28:14.698 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-01T16:28:14.698 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-01T16:28:14.698 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:28:14.735 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 133/220 2024-04-01T16:28:17.081 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 131/220 2024-04-01T16:28:17.154 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 131/220 2024-04-01T16:28:17.802 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 131/220 2024-04-01T16:28:17.866 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 132/220 2024-04-01T16:28:18.047 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 132/220 2024-04-01T16:28:18.047 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-01T16:28:18.047 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-01T16:28:18.047 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:28:18.109 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 133/220 2024-04-01T16:28:27.941 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 133/220 2024-04-01T16:28:27.942 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /sys 2024-04-01T16:28:27.942 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /proc 2024-04-01T16:28:27.942 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /mnt 2024-04-01T16:28:27.942 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /var/tmp 2024-04-01T16:28:27.942 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /home 2024-04-01T16:28:27.942 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /root 2024-04-01T16:28:27.942 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /tmp 2024-04-01T16:28:27.942 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:28:28.156 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 134/220 2024-04-01T16:28:28.207 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 134/220 2024-04-01T16:28:28.207 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:28.207 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-01T16:28:28.207 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:28:29.833 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 135/220 2024-04-01T16:28:29.909 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 135/220 2024-04-01T16:28:29.909 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:29.909 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-01T16:28:29.909 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-01T16:28:29.909 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-01T16:28:29.909 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:28:30.150 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 136/220 2024-04-01T16:28:30.235 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 136/220 2024-04-01T16:28:30.235 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:30.235 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-01T16:28:30.235 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-01T16:28:30.235 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-01T16:28:30.235 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:28:30.734 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 137/220 2024-04-01T16:28:30.804 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 137/220 2024-04-01T16:28:30.804 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:30.804 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-01T16:28:30.804 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-01T16:28:30.804 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-01T16:28:30.804 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:28:30.919 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : automake-1.16.2-8.el9.noarch 138/220 2024-04-01T16:28:31.509 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephadm-2:19.0.0-2574.gd2271579.el9.noarch 139/220 2024-04-01T16:28:31.553 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephadm-2:19.0.0-2574.gd2271579.el9.noarch 139/220 2024-04-01T16:28:31.602 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.e 140/220 2024-04-01T16:28:31.702 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2574.gd2271579. 141/220 2024-04-01T16:28:31.732 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 142/220 2024-04-01T16:28:32.000 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 133/220 2024-04-01T16:28:32.000 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /sys 2024-04-01T16:28:32.000 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /proc 2024-04-01T16:28:32.000 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /mnt 2024-04-01T16:28:32.000 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /var/tmp 2024-04-01T16:28:32.000 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /home 2024-04-01T16:28:32.000 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /root 2024-04-01T16:28:32.001 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /tmp 2024-04-01T16:28:32.001 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:28:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 134/220 2024-04-01T16:28:32.297 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 134/220 2024-04-01T16:28:32.297 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:32.297 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-01T16:28:32.297 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:28:33.032 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 142/220 2024-04-01T16:28:33.067 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 143/220 2024-04-01T16:28:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 135/220 2024-04-01T16:28:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 135/220 2024-04-01T16:28:33.956 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:33.956 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-01T16:28:33.956 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-01T16:28:33.956 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-01T16:28:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:28:34.161 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 143/220 2024-04-01T16:28:34.201 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 144/220 2024-04-01T16:28:34.224 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 136/220 2024-04-01T16:28:34.292 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 136/220 2024-04-01T16:28:34.293 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:34.293 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-01T16:28:34.293 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-01T16:28:34.293 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-01T16:28:34.293 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:28:34.343 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 144/220 2024-04-01T16:28:34.514 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el 145/220 2024-04-01T16:28:34.553 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 146/220 2024-04-01T16:28:34.626 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 146/220 2024-04-01T16:28:34.626 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:34.626 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-01T16:28:34.626 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-01T16:28:34.626 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-01T16:28:34.626 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:28:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 147/220 2024-04-01T16:28:34.724 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 147/220 2024-04-01T16:28:34.814 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-2:19.0.0-2574.gd2271579.el9.x86_64 148/220 2024-04-01T16:28:34.833 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 137/220 2024-04-01T16:28:34.926 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 137/220 2024-04-01T16:28:34.926 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:34.926 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-01T16:28:34.926 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-01T16:28:34.926 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-01T16:28:34.927 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:28:35.077 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : automake-1.16.2-8.el9.noarch 138/220 2024-04-01T16:28:35.687 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephadm-2:19.0.0-2574.gd2271579.el9.noarch 139/220 2024-04-01T16:28:35.738 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephadm-2:19.0.0-2574.gd2271579.el9.noarch 139/220 2024-04-01T16:28:35.816 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.e 140/220 2024-04-01T16:28:35.834 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/220 2024-04-01T16:28:35.863 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 150/220 2024-04-01T16:28:35.931 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 150/220 2024-04-01T16:28:35.931 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:35.931 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-01T16:28:35.932 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-01T16:28:35.932 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-01T16:28:35.932 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:28:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2574.gd2271579. 141/220 2024-04-01T16:28:35.981 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2574.gd2271 151/220 2024-04-01T16:28:36.007 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 142/220 2024-04-01T16:28:36.067 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2574.gd2271 151/220 2024-04-01T16:28:36.067 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:36.067 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-01T16:28:36.068 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:28:36.135 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 152/220 2024-04-01T16:28:36.205 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 152/220 2024-04-01T16:28:36.205 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:36.206 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-01T16:28:36.206 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-01T16:28:36.206 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-01T16:28:36.206 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:28:36.602 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 153/220 2024-04-01T16:28:36.672 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 153/220 2024-04-01T16:28:36.672 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:36.672 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-01T16:28:36.672 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-01T16:28:36.672 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-01T16:28:36.672 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:28:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 142/220 2024-04-01T16:28:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 143/220 2024-04-01T16:28:38.485 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 143/220 2024-04-01T16:28:38.543 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 144/220 2024-04-01T16:28:38.694 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 144/220 2024-04-01T16:28:38.875 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el 145/220 2024-04-01T16:28:38.929 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 146/220 2024-04-01T16:28:38.999 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 146/220 2024-04-01T16:28:39.000 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:39.000 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-01T16:28:39.000 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-01T16:28:39.000 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-01T16:28:39.000 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:28:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 147/220 2024-04-01T16:28:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 147/220 2024-04-01T16:28:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-2:19.0.0-2574.gd2271579.el9.x86_64 148/220 2024-04-01T16:28:40.297 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/220 2024-04-01T16:28:40.349 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 150/220 2024-04-01T16:28:40.416 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 150/220 2024-04-01T16:28:40.416 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:40.416 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-01T16:28:40.416 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-01T16:28:40.416 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-01T16:28:40.416 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:28:40.508 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2574.gd2271 151/220 2024-04-01T16:28:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2574.gd2271 151/220 2024-04-01T16:28:40.580 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:40.580 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-01T16:28:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:28:40.683 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 152/220 2024-04-01T16:28:40.757 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 152/220 2024-04-01T16:28:40.757 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:40.758 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-01T16:28:40.758 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-01T16:28:40.758 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-01T16:28:40.758 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:28:41.151 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 153/220 2024-04-01T16:28:41.220 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 153/220 2024-04-01T16:28:41.221 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T16:28:41.221 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-01T16:28:41.221 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-01T16:28:41.221 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-01T16:28:41.221 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:28:41.507 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 154/220 2024-04-01T16:28:41.552 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 155/220 2024-04-01T16:28:41.596 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 156/220 2024-04-01T16:28:41.635 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/220 2024-04-01T16:28:41.925 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 158/220 2024-04-01T16:28:42.050 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/220 2024-04-01T16:28:42.098 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 160/220 2024-04-01T16:28:42.154 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/220 2024-04-01T16:28:42.214 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/220 2024-04-01T16:28:42.259 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/220 2024-04-01T16:28:42.294 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_ 164/220 2024-04-01T16:28:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/220 2024-04-01T16:28:42.390 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 166/220 2024-04-01T16:28:42.481 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 167/220 2024-04-01T16:28:42.588 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 168/220 2024-04-01T16:28:42.630 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/220 2024-04-01T16:28:43.591 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-01T16:28:43.636 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-01T16:28:43.696 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-01T16:28:46.041 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 154/220 2024-04-01T16:28:46.086 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 155/220 2024-04-01T16:28:46.122 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 156/220 2024-04-01T16:28:46.160 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/220 2024-04-01T16:28:46.434 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 158/220 2024-04-01T16:28:46.561 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/220 2024-04-01T16:28:46.607 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 160/220 2024-04-01T16:28:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/220 2024-04-01T16:28:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/220 2024-04-01T16:28:46.769 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/220 2024-04-01T16:28:46.829 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_ 164/220 2024-04-01T16:28:46.874 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/220 2024-04-01T16:28:46.926 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 166/220 2024-04-01T16:28:47.014 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 167/220 2024-04-01T16:28:47.120 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 168/220 2024-04-01T16:28:47.149 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/220 2024-04-01T16:28:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-01T16:28:48.540 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-01T16:28:48.594 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-01T16:28:51.438 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 171/220 2024-04-01T16:28:56.291 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 171/220 2024-04-01T16:29:36.801 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-debuginfo-2:19.0.0-2574.gd2271579.el9. 172/220 2024-04-01T16:29:37.490 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-debuginfo-2:19.0.0-2574.gd2271579.el 173/220 2024-04-01T16:29:38.681 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-2574.gd2271579.el9. 174/220 2024-04-01T16:29:41.763 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-base-debuginfo-2:19.0.0-2574.gd2271579.el9. 172/220 2024-04-01T16:29:42.436 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-common-debuginfo-2:19.0.0-2574.gd2271579.el 173/220 2024-04-01T16:29:42.616 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-2574.gd2271579.el9. 174/220 2024-04-01T16:29:43.909 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 175/220 2024-04-01T16:29:47.045 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-2574.gd2271579.el9.x 176/220 2024-04-01T16:29:47.840 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 175/220 2024-04-01T16:29:50.049 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-2574.gd2271579.el9.x 176/220 2024-04-01T16:29:57.403 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-2574.gd2271579.el9.x 177/220 2024-04-01T16:30:00.361 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-2574.gd2271579.el9.x 177/220 2024-04-01T16:30:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-2574.gd2271579.el9.x 178/220 2024-04-01T16:30:30.417 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-2574.gd2271579.el9.x 178/220 2024-04-01T16:30:49.103 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-2574.gd2271579.el9.x 179/220 2024-04-01T16:30:50.229 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-2574.gd2271579.el9.x 179/220 2024-04-01T16:32:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-2574.gd2271579.e 180/220 2024-04-01T16:32:02.701 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-2574.gd2271579.e 180/220 2024-04-01T16:32:02.912 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-debuginfo-2:19.0.0-2574.gd2271579.el9. 181/220 2024-04-01T16:32:02.953 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-2574.gd2271579.el9 182/220 2024-04-01T16:32:03.318 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-test-debuginfo-2:19.0.0-2574.gd2271579.el9. 181/220 2024-04-01T16:32:04.682 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-2574.gd2271579.el9 182/220 2024-04-01T16:32:08.115 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-debuginfo-2:19.0.0-2574.gd2271579 183/220 2024-04-01T16:32:09.885 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados-devel-debuginfo-2:19.0.0-2574.gd2271579 183/220 2024-04-01T16:32:14.509 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados2-debuginfo-2:19.0.0-2574.gd2271579.el9. 184/220 2024-04-01T16:32:14.601 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librbd1-debuginfo-2:19.0.0-2574.gd2271579.el9.x8 185/220 2024-04-01T16:32:14.708 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-2574.gd2271579 186/220 2024-04-01T16:32:14.847 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-debuginfo-2:19.0.0-2574.gd2271579. 187/220 2024-04-01T16:32:14.908 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-2574.gd2271579.el 188/220 2024-04-01T16:32:14.991 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-2574.gd2271579.el 189/220 2024-04-01T16:32:16.774 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados2-debuginfo-2:19.0.0-2574.gd2271579.el9. 184/220 2024-04-01T16:32:16.874 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librbd1-debuginfo-2:19.0.0-2574.gd2271579.el9.x8 185/220 2024-04-01T16:32:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-2574.gd2271579 186/220 2024-04-01T16:32:17.168 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rados-debuginfo-2:19.0.0-2574.gd2271579. 187/220 2024-04-01T16:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-2574.gd2271579.el 188/220 2024-04-01T16:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-2574.gd2271579.el 189/220 2024-04-01T16:32:21.275 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-2574.gd2271579.el9.x 190/220 2024-04-01T16:32:21.888 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-2574.gd2271579.el9 191/220 2024-04-01T16:32:23.156 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-2574.gd2271579.el9.x8 192/220 2024-04-01T16:32:23.257 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 193/220 2024-04-01T16:32:23.285 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-2574.gd2271579.el9.x 190/220 2024-04-01T16:32:23.309 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 194/220 2024-04-01T16:32:23.434 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flex-2.6.4-9.el9.x86_64 195/220 2024-04-01T16:32:23.452 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-2574.gd2271579.el9 191/220 2024-04-01T16:32:23.476 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bison-3.7.4-5.el9.x86_64 196/220 2024-04-01T16:32:23.509 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 197/220 2024-04-01T16:32:23.552 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 198/220 2024-04-01T16:32:23.602 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 199/220 2024-04-01T16:32:23.602 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-04-01T16:32:23.749 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-04-01T16:32:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 201/220 2024-04-01T16:32:23.806 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 202/220 2024-04-01T16:32:23.944 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 202/220 2024-04-01T16:32:23.989 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 203/220 2024-04-01T16:32:24.034 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 204/220 2024-04-01T16:32:24.075 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 205/220 2024-04-01T16:32:24.108 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 206/220 2024-04-01T16:32:24.186 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 207/220 2024-04-01T16:32:24.256 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 208/220 2024-04-01T16:32:24.304 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 209/220 2024-04-01T16:32:24.346 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 210/220 2024-04-01T16:32:24.388 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 211/220 2024-04-01T16:32:24.421 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 212/220 2024-04-01T16:32:24.454 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 213/220 2024-04-01T16:32:24.492 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-01T16:32:24.493 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-01T16:32:24.704 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-2574.gd2271579.el9.x8 192/220 2024-04-01T16:32:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 193/220 2024-04-01T16:32:24.811 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-01T16:32:24.811 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-04-01T16:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 194/220 2024-04-01T16:32:24.952 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-04-01T16:32:24.988 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flex-2.6.4-9.el9.x86_64 195/220 2024-04-01T16:32:25.003 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 216/220 2024-04-01T16:32:25.033 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 217/220 2024-04-01T16:32:25.036 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : bison-3.7.4-5.el9.x86_64 196/220 2024-04-01T16:32:25.069 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 197/220 2024-04-01T16:32:25.077 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 218/220 2024-04-01T16:32:25.104 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 198/220 2024-04-01T16:32:25.126 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 219/220 2024-04-01T16:32:25.145 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 199/220 2024-04-01T16:32:25.145 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-04-01T16:32:25.246 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-04-01T16:32:25.497 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-04-01T16:32:25.497 INFO:teuthology.orchestra.run.smithi189.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-01T16:32:25.498 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:27.308 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-04-01T16:32:27.358 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 201/220 2024-04-01T16:32:27.358 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 202/220 2024-04-01T16:32:27.496 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 202/220 2024-04-01T16:32:27.566 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 203/220 2024-04-01T16:32:27.611 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 204/220 2024-04-01T16:32:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 205/220 2024-04-01T16:32:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 206/220 2024-04-01T16:32:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 207/220 2024-04-01T16:32:27.834 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 208/220 2024-04-01T16:32:27.883 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 209/220 2024-04-01T16:32:27.915 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 210/220 2024-04-01T16:32:27.949 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 211/220 2024-04-01T16:32:27.983 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 212/220 2024-04-01T16:32:28.016 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 213/220 2024-04-01T16:32:28.052 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-01T16:32:28.053 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-01T16:32:28.383 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-01T16:32:28.383 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-04-01T16:32:28.531 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-04-01T16:32:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 216/220 2024-04-01T16:32:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 217/220 2024-04-01T16:32:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 218/220 2024-04-01T16:32:28.713 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 219/220 2024-04-01T16:32:29.207 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-04-01T16:32:29.464 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-04-01T16:32:29.464 INFO:teuthology.orchestra.run.smithi163.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-01T16:32:29.464 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:34.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-2:19.0.0-2574.gd2271579.el9.x86_64 1/220 2024-04-01T16:32:34.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 2/220 2024-04-01T16:32:34.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-2574.gd2271579.el9. 3/220 2024-04-01T16:32:34.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 4/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-2574.gd2271579.el 5/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_6 6/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 7/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-2574.gd2271579.el9. 8/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2574.gd2271 9/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 10/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 11/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-2574.gd2271579.el9.x 12/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 13/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-2574.gd2271579.el9.x 14/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 15/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-2574.gd2271579.el9.x 16/220 2024-04-01T16:32:34.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 17/220 2024-04-01T16:32:34.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-2574.gd2271579.el9.x 18/220 2024-04-01T16:32:34.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 19/220 2024-04-01T16:32:34.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-2574.gd2271579.e 20/220 2024-04-01T16:32:34.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 21/220 2024-04-01T16:32:34.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 22/220 2024-04-01T16:32:34.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-2574.gd2271579.el9. 23/220 2024-04-01T16:32:34.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 24/220 2024-04-01T16:32:34.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 25/220 2024-04-01T16:32:34.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_ 26/220 2024-04-01T16:32:34.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 27/220 2024-04-01T16:32:34.682 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-2574.gd2271579.el9 28/220 2024-04-01T16:32:34.682 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 29/220 2024-04-01T16:32:34.682 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-2:19.0.0-2574.gd2271579.el9.x86_6 30/220 2024-04-01T16:32:34.682 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-2574.gd2271579 31/220 2024-04-01T16:32:34.682 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-debuginfo-2:19.0.0-2574.gd2271579.el9. 32/220 2024-04-01T16:32:34.682 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 33/220 2024-04-01T16:32:34.682 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-debuginfo-2:19.0.0-2574.gd2271579.el9.x8 34/220 2024-04-01T16:32:34.682 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 35/220 2024-04-01T16:32:34.682 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2574.gd2271579.el 36/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-common-2:19.0.0-2574.gd2271579.el9. 37/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_6 38/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-2574.gd2271579 39/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 40/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-2574.gd2271579. 41/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 42/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-2574.gd2271579.el 43/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 44/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-2574.gd2271579.el 45/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 46/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-2574.gd2271579.el9.x 47/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 48/220 2024-04-01T16:32:34.683 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-2574.gd2271579.el9 49/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 50/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-2574.gd2271579.el9.x8 51/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2574.gd2271579. 52/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 53/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 54/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 55/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el 56/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 57/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.e 58/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 59/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephadm-2:19.0.0-2574.gd2271579.el9.noarch 60/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 61/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/220 2024-04-01T16:32:34.684 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 70/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 71/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 72/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 73/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 74/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 75/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-5.4.4-4.el9.x86_64 76/220 2024-04-01T16:32:34.685 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 77/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 78/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 79/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-13.14-1.el9.x86_64 80/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 81/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 82/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 83/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 84/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 85/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 86/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 87/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 88/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 89/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 90/220 2024-04-01T16:32:34.686 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 91/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 93/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 94/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 95/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 96/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 97/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 98/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 99/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 100/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 101/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 102/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 103/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 104/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 105/220 2024-04-01T16:32:34.687 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 106/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 107/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 108/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 109/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 110/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 111/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 112/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 113/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ply-3.11-14.el9.noarch 114/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 115/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 116/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : jq-1.6-16.el9.x86_64 117/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 118/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 119/220 2024-04-01T16:32:34.688 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 120/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 121/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 122/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 123/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 124/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 125/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 126/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/220 2024-04-01T16:32:34.689 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 138/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 146/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/220 2024-04-01T16:32:34.690 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/220 2024-04-01T16:32:34.691 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:19.0.0-2574.gd2271579.el9.x86_64 173/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 175/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/220 2024-04-01T16:32:34.692 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 177/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 178/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 179/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 180/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 181/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 182/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 183/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 184/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 185/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 186/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : acl-2.3.1-4.el9.x86_64 187/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : acl-2.3.1-3.el9.x86_64 188/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 189/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 190/220 2024-04-01T16:32:34.693 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 191/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 192/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 193/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 194/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 195/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 196/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 197/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 198/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 199/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 200/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 201/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 202/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 203/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 204/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 205/220 2024-04-01T16:32:34.694 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 206/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 207/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 208/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 209/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 210/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 211/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 212/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 213/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 214/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 215/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 216/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 217/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 218/220 2024-04-01T16:32:34.695 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 219/220 2024-04-01T16:32:36.513 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-2:19.0.0-2574.gd2271579.el9.x86_64 1/220 2024-04-01T16:32:36.513 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 2/220 2024-04-01T16:32:36.513 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-2574.gd2271579.el9. 3/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 4/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-2574.gd2271579.el 5/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_6 6/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 7/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-2574.gd2271579.el9. 8/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2574.gd2271 9/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 10/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 11/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-2574.gd2271579.el9.x 12/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 13/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-2574.gd2271579.el9.x 14/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 15/220 2024-04-01T16:32:36.514 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-2574.gd2271579.el9.x 16/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 17/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-2574.gd2271579.el9.x 18/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 19/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-2574.gd2271579.e 20/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 21/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 22/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-2574.gd2271579.el9. 23/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 24/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 25/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_ 26/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 27/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-2574.gd2271579.el9 28/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 29/220 2024-04-01T16:32:36.515 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados-devel-2:19.0.0-2574.gd2271579.el9.x86_6 30/220 2024-04-01T16:32:36.516 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-2574.gd2271579 31/220 2024-04-01T16:32:36.533 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-debuginfo-2:19.0.0-2574.gd2271579.el9. 32/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 33/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-debuginfo-2:19.0.0-2574.gd2271579.el9.x8 34/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 35/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2574.gd2271579.el 36/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-common-2:19.0.0-2574.gd2271579.el9. 37/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_6 38/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-2574.gd2271579 39/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 40/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-2574.gd2271579. 41/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 42/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-2574.gd2271579.el 43/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 44/220 2024-04-01T16:32:36.534 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-2574.gd2271579.el 45/220 2024-04-01T16:32:36.535 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 46/220 2024-04-01T16:32:36.535 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-2574.gd2271579.el9.x 47/220 2024-04-01T16:32:36.535 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 48/220 2024-04-01T16:32:36.535 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-2574.gd2271579.el9 49/220 2024-04-01T16:32:36.535 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 50/220 2024-04-01T16:32:36.535 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-2574.gd2271579.el9.x8 51/220 2024-04-01T16:32:36.535 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2574.gd2271579. 52/220 2024-04-01T16:32:36.535 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 53/220 2024-04-01T16:32:36.535 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 54/220 2024-04-01T16:32:36.535 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 55/220 2024-04-01T16:32:36.535 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el 56/220 2024-04-01T16:32:36.535 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 57/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.e 58/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 59/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephadm-2:19.0.0-2574.gd2271579.el9.noarch 60/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 61/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 70/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 71/220 2024-04-01T16:32:36.536 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 72/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 73/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 74/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 75/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lua-5.4.4-4.el9.x86_64 76/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 77/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 78/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 79/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-13.14-1.el9.x86_64 80/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 81/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 82/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 83/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 84/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 85/220 2024-04-01T16:32:36.537 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 86/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 87/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 88/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 89/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 90/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 91/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 93/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 94/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 95/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 96/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 97/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 98/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 99/220 2024-04-01T16:32:36.538 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 100/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 101/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 102/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 103/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 104/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 105/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 106/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 107/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 108/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 109/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 110/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 111/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 112/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 113/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ply-3.11-14.el9.noarch 114/220 2024-04-01T16:32:36.539 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 115/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 116/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : jq-1.6-16.el9.x86_64 117/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 118/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 119/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 120/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 121/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 122/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 123/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 124/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 125/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 126/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/220 2024-04-01T16:32:36.540 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 138/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/220 2024-04-01T16:32:36.541 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 146/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/220 2024-04-01T16:32:36.542 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/220 2024-04-01T16:32:36.543 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:19.0.0-2574.gd2271579.el9.x86_64 173/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 175/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 177/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 178/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 179/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 180/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 181/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 182/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 183/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 184/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 185/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 186/220 2024-04-01T16:32:36.544 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : acl-2.3.1-4.el9.x86_64 187/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : acl-2.3.1-3.el9.x86_64 188/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 189/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 190/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 191/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 192/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 193/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 194/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 195/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 196/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 197/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 198/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 199/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 200/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 201/220 2024-04-01T16:32:36.545 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 202/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 203/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 204/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 205/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 206/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 207/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 208/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 209/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 210/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 211/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 212/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 213/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 214/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 215/220 2024-04-01T16:32:36.546 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 216/220 2024-04-01T16:32:36.547 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 217/220 2024-04-01T16:32:36.547 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 218/220 2024-04-01T16:32:36.547 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 219/220 2024-04-01T16:32:37.369 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 220/220 2024-04-01T16:32:37.369 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:37.369 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-04-01T16:32:37.369 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-04-01T16:32:37.369 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-04-01T16:32:37.369 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-04-01T16:32:37.369 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-04-01T16:32:37.370 INFO:teuthology.orchestra.run.smithi189.stdout: acl-2.3.1-4.el9.x86_64 2024-04-01T16:32:37.370 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-01T16:32:37.370 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-01T16:32:37.370 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-01T16:32:37.370 INFO:teuthology.orchestra.run.smithi189.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-01T16:32:37.370 INFO:teuthology.orchestra.run.smithi189.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-01T16:32:37.370 INFO:teuthology.orchestra.run.smithi189.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-01T16:32:37.370 INFO:teuthology.orchestra.run.smithi189.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-01T16:32:37.370 INFO:teuthology.orchestra.run.smithi189.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-01T16:32:37.370 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.370 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.370 INFO:teuthology.orchestra.run.smithi189.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: automake-1.16.2-8.el9.noarch 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: bison-3.7.4-5.el9.x86_64 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-01T16:32:37.371 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:37.372 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.373 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: flex-2.6.4-9.el9.x86_64 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: jq-1.6-16.el9.x86_64 2024-04-01T16:32:37.374 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.375 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: lua-5.4.4-4.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-01T16:32:37.376 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-13.14-1.el9.x86_64 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-01T16:32:37.377 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-01T16:32:37.378 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-01T16:32:37.379 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply-3.11-14.el9.noarch 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-01T16:32:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-01T16:32:37.381 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-01T16:32:37.382 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: re2-1:20211101-3.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-01T16:32:37.383 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-01T16:32:37.384 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-01T16:32:37.384 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:37.384 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-04-01T16:32:38.945 DEBUG:teuthology.parallel:result is None 2024-04-01T16:32:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 220/220 2024-04-01T16:32:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:39.210 INFO:teuthology.orchestra.run.smithi163.stdout:Upgraded: 2024-04-01T16:32:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-04-01T16:32:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-04-01T16:32:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-04-01T16:32:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-04-01T16:32:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: acl-2.3.1-4.el9.x86_64 2024-04-01T16:32:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-01T16:32:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-01T16:32:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: automake-1.16.2-8.el9.noarch 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: bison-3.7.4-5.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: flex-2.6.4-9.el9.x86_64 2024-04-01T16:32:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: jq-1.6-16.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-01T16:32:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-01T16:32:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: lua-5.4.4-4.el9.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-13.14-1.el9.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-01T16:32:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-01T16:32:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-01T16:32:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ply-3.11-14.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-01T16:32:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-01T16:32:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-debuginfo-2:19.0.0-2574.gd2271579.el9.x86_64 2024-04-01T16:32:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: re2-1:20211101-3.el9.x86_64 2024-04-01T16:32:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-01T16:32:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-01T16:32:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-01T16:32:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-01T16:32:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-01T16:32:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-01T16:32:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:39.223 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-01T16:32:40.660 DEBUG:teuthology.parallel:result is None 2024-04-01T16:32:40.661 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T16:32:40.876 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-01T16:32:40.931 INFO:teuthology.orchestra.run.smithi163.stdout:19.0.0-2574.gd2271579.el9 2024-04-01T16:32:40.932 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2574.gd2271579.el9 2024-04-01T16:32:40.932 INFO:teuthology.task.install:The correct ceph version 19.0.0-2574.gd2271579 is installed. 2024-04-01T16:32:40.934 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T16:32:41.071 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-01T16:32:41.144 INFO:teuthology.orchestra.run.smithi189.stdout:19.0.0-2574.gd2271579.el9 2024-04-01T16:32:41.144 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2574.gd2271579.el9 2024-04-01T16:32:41.144 INFO:teuthology.task.install:The correct ceph version 19.0.0-2574.gd2271579 is installed. 2024-04-01T16:32:41.146 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-01T16:32:41.146 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:32:41.146 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T16:32:41.223 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:32:41.223 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T16:32:41.328 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-01T16:32:41.328 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:32:41.328 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T16:32:41.411 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T16:32:41.529 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:32:41.529 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T16:32:41.625 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T16:32:41.718 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-01T16:32:41.718 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:32:41.718 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T16:32:41.796 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T16:32:41.910 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:32:41.910 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T16:32:42.009 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T16:32:42.145 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-01T16:32:42.145 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:32:42.145 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T16:32:42.218 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T16:32:42.329 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:32:42.329 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T16:32:42.429 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T16:32:42.513 INFO:teuthology.run_tasks:Running task ceph... 2024-04-01T16:32:42.593 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-01T16:32:42.593 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2024-04-01T16:32:42.601 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /var/log/ceph 2024-04-01T16:32:42.700 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-01T16:32:42.701 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-01T16:32:42.706 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-01T16:32:42.801 INFO:tasks.ceph:Creating extra log directories... 2024-04-01T16:32:42.801 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-01T16:32:42.807 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-01T16:32:42.909 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-01T16:32:42.909 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-01T16:32:42.909 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-01T16:32:42.909 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:32:42.909 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-01T16:32:42.961 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-01T16:32:43.227 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-01T16:32:43.323 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:32:43.323 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-01T16:32:43.376 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-01T16:32:43.645 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-01T16:32:43.752 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-01T16:32:43.752 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-01T16:32:43.752 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958', 'branch': 'wip-vshankar-testing-20240330.170739', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7633958', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240330.170739'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240330.170739', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6891, 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'sleep_before_teardown': 0, 'subset': '932/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240330.170739', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJNvpDfk19B0IUi/Ydj37n1HFdeQY3OxFWAhXFZv1fl8FYopydoy5Ji0WHVb26kKxtbbjpwS0aUGEumLQtbfZk=', 'smithi189.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJyTDvOq7o62e63FZnD5vzScSY0bwTAzRp4xkzsYzrKUQ5o6ZKPGwWm1wdvoi5OnOWlSxfi0Az3Ty0BGDfgi440='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-04-01_14:09:42', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-01T16:32:43.753 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-01T16:32:43.761 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-01T16:32:43.819 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2024-04-01T16:32:43.824 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m0777 -- /var/run/ceph 2024-04-01T16:32:43.918 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:32:43.918 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T16:32:43.971 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T16:32:43.971 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2024-04-01T16:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T16:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T16:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 629 Links: 1 2024-04-01T16:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T16:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T16:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-04-01 16:32:29.912288609 +0000 2024-04-01T16:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-01 16:21:52.145406087 +0000 2024-04-01T16:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-01 16:21:52.145406087 +0000 2024-04-01T16:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-04-01 16:21:52.145406087 +0000 2024-04-01T16:32:44.022 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T16:32:44.111 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-04-01T16:32:44.111 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-04-01T16:32:44.111 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000353697 s, 1.4 MB/s 2024-04-01T16:32:44.114 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T16:32:44.165 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2024-04-01T16:32:44.212 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T16:32:44.212 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T16:32:44.213 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 647 Links: 1 2024-04-01T16:32:44.213 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T16:32:44.213 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T16:32:44.213 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-04-01 16:32:29.913288585 +0000 2024-04-01T16:32:44.213 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-01 16:21:52.703392809 +0000 2024-04-01T16:32:44.213 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-01 16:21:52.703392809 +0000 2024-04-01T16:32:44.213 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-04-01 16:21:52.703392809 +0000 2024-04-01T16:32:44.213 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T16:32:44.347 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-04-01T16:32:44.348 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-04-01T16:32:44.348 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000333632 s, 1.5 MB/s 2024-04-01T16:32:44.352 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T16:32:44.408 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2024-04-01T16:32:44.456 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T16:32:44.457 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T16:32:44.457 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-04-01T16:32:44.457 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T16:32:44.457 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T16:32:44.457 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-04-01 16:32:29.914288561 +0000 2024-04-01T16:32:44.457 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-01 16:21:53.263379483 +0000 2024-04-01T16:32:44.457 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-01 16:21:53.263379483 +0000 2024-04-01T16:32:44.457 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-04-01 16:21:53.263379483 +0000 2024-04-01T16:32:44.457 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T16:32:44.539 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-04-01T16:32:44.540 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-04-01T16:32:44.540 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000316694 s, 1.6 MB/s 2024-04-01T16:32:44.544 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T16:32:44.596 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2024-04-01T16:32:44.643 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T16:32:44.644 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T16:32:44.644 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-04-01T16:32:44.644 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T16:32:44.644 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T16:32:44.644 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-04-01 16:32:29.914288561 +0000 2024-04-01T16:32:44.644 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-01 16:21:53.837365825 +0000 2024-04-01T16:32:44.644 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-01 16:21:53.837365825 +0000 2024-04-01T16:32:44.644 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-04-01 16:21:53.837365825 +0000 2024-04-01T16:32:44.644 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T16:32:44.729 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-04-01T16:32:44.729 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-04-01T16:32:44.729 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000298344 s, 1.7 MB/s 2024-04-01T16:32:44.732 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T16:32:44.787 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T16:32:44.787 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:32:44.787 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T16:32:44.844 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T16:32:44.845 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-04-01T16:32:44.896 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T16:32:44.896 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T16:32:44.897 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 637 Links: 1 2024-04-01T16:32:44.897 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T16:32:44.897 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T16:32:44.897 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-04-01 16:32:25.910328873 +0000 2024-04-01T16:32:44.897 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-04-01 16:21:52.142512900 +0000 2024-04-01T16:32:44.897 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-04-01 16:21:52.142512900 +0000 2024-04-01T16:32:44.897 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-04-01 16:21:52.142512900 +0000 2024-04-01T16:32:44.897 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T16:32:44.987 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-04-01T16:32:44.987 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-04-01T16:32:44.987 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000349361 s, 1.5 MB/s 2024-04-01T16:32:44.991 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T16:32:45.046 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-04-01T16:32:45.096 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T16:32:45.096 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T16:32:45.096 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 656 Links: 1 2024-04-01T16:32:45.096 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T16:32:45.096 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T16:32:45.096 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-04-01 16:32:25.911328853 +0000 2024-04-01T16:32:45.096 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-04-01 16:21:52.711501540 +0000 2024-04-01T16:32:45.096 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-04-01 16:21:52.711501540 +0000 2024-04-01T16:32:45.096 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-04-01 16:21:52.711501540 +0000 2024-04-01T16:32:45.097 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T16:32:45.177 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-04-01T16:32:45.177 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-04-01T16:32:45.177 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000287246 s, 1.8 MB/s 2024-04-01T16:32:45.180 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T16:32:45.235 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-04-01T16:32:45.285 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T16:32:45.286 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T16:32:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 676 Links: 1 2024-04-01T16:32:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T16:32:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T16:32:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-04-01 16:32:25.911328853 +0000 2024-04-01T16:32:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-04-01 16:21:53.290489979 +0000 2024-04-01T16:32:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-04-01 16:21:53.290489979 +0000 2024-04-01T16:32:45.286 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-04-01 16:21:53.290489979 +0000 2024-04-01T16:32:45.286 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T16:32:45.372 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-04-01T16:32:45.372 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-04-01T16:32:45.372 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000468896 s, 1.1 MB/s 2024-04-01T16:32:45.376 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T16:32:45.432 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-04-01T16:32:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T16:32:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T16:32:45.479 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 694 Links: 1 2024-04-01T16:32:45.479 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T16:32:45.479 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T16:32:45.479 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-04-01 16:32:25.912328833 +0000 2024-04-01T16:32:45.479 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-04-01 16:21:53.877478260 +0000 2024-04-01T16:32:45.479 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-04-01 16:21:53.877478260 +0000 2024-04-01T16:32:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-04-01 16:21:53.877478260 +0000 2024-04-01T16:32:45.479 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T16:32:45.613 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-04-01T16:32:45.613 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-04-01T16:32:45.613 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000330818 s, 1.5 MB/s 2024-04-01T16:32:45.618 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T16:32:45.675 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T16:32:45.675 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi189.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-01T16:32:45.675 INFO:tasks.ceph:Generating config... 2024-04-01T16:32:45.677 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-01T16:32:45.677 INFO:tasks.ceph:[client] debug client = 20 2024-04-01T16:32:45.677 INFO:tasks.ceph:[client] debug ms = 1 2024-04-01T16:32:45.677 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-01T16:32:45.677 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-01T16:32:45.677 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-04-01T16:32:45.677 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-04-01T16:32:45.677 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-04-01T16:32:45.677 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-01T16:32:45.677 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-01T16:32:45.677 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-01T16:32:45.677 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-01T16:32:45.677 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-01T16:32:45.678 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-01T16:32:45.679 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-04-01T16:32:45.680 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-01T16:32:45.680 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-01T16:32:45.680 INFO:tasks.ceph:Setting up mon.a... 2024-04-01T16:32:45.680 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-01T16:32:45.821 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/ceph.keyring 2024-04-01T16:32:45.830 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-01T16:32:45.960 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-01T16:32:46.056 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.163'), ('mon.b', '172.21.15.189'), ('mon.c', '[v2:172.21.15.189:3301,v1:172.21.15.189:6790]')] 2024-04-01T16:32:46.057 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.163,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-01T16:32:46.057 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:32:46.058 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-01T16:32:46.112 DEBUG:teuthology.orchestra.run.smithi163:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.163 --add b 172.21.15.189 --addv c '[v2:172.21.15.189:3301,v1:172.21.15.189:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:32:46.269 INFO:teuthology.orchestra.run.smithi163.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:32:46.269 INFO:teuthology.orchestra.run.smithi163.stdout:monmaptool: generated fsid 0870cdfa-3f81-4bb7-98e8-9588fec4cf05 2024-04-01T16:32:46.269 INFO:teuthology.orchestra.run.smithi163.stdout:setting min_mon_release = quincy 2024-04-01T16:32:46.270 INFO:teuthology.orchestra.run.smithi163.stdout:epoch 0 2024-04-01T16:32:46.270 INFO:teuthology.orchestra.run.smithi163.stdout:fsid 0870cdfa-3f81-4bb7-98e8-9588fec4cf05 2024-04-01T16:32:46.270 INFO:teuthology.orchestra.run.smithi163.stdout:last_changed 2024-04-01T16:32:46.270917+0000 2024-04-01T16:32:46.270 INFO:teuthology.orchestra.run.smithi163.stdout:created 2024-04-01T16:32:46.270917+0000 2024-04-01T16:32:46.270 INFO:teuthology.orchestra.run.smithi163.stdout:min_mon_release 17 (quincy) 2024-04-01T16:32:46.270 INFO:teuthology.orchestra.run.smithi163.stdout:election_strategy: 1 2024-04-01T16:32:46.270 INFO:teuthology.orchestra.run.smithi163.stdout:0: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.a 2024-04-01T16:32:46.270 INFO:teuthology.orchestra.run.smithi163.stdout:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-04-01T16:32:46.270 INFO:teuthology.orchestra.run.smithi163.stdout:2: [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] mon.c 2024-04-01T16:32:46.270 INFO:teuthology.orchestra.run.smithi163.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-01T16:32:46.273 DEBUG:teuthology.orchestra.run.smithi163:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-01T16:32:46.325 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0870cdfa-3f81-4bb7-98e8-9588fec4cf05... 2024-04-01T16:32:46.326 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-01T16:32:46.331 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-01T16:32:46.486 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.487 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2024-04-01T16:32:46.488 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = "172.21.15.163,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-04-01T16:32:46.489 INFO:teuthology.orchestra.run.smithi163.stdout: mds beacon grace = 60 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: mds heartbeat grace = 60 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: osd heartbeat grace = 60 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = 0870cdfa-3f81-4bb7-98e8-9588fec4cf05 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: osd mclock profile = high_recovery_ops 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2024-04-01T16:32:46.490 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug trim objects = true 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.491 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: bdev async discard = True 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: bdev enable discard = True 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore allocator = bitmap 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore block size = 96636764160 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore fsck on mount = True 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluefs = 1/20 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluestore = 1/20 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2024-04-01T16:32:46.492 INFO:teuthology.orchestra.run.smithi163.stdout: debug rocksdb = 4/10 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd backfillfull_ratio = 0.85 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd full ratio = 0.9 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd nearfull ratio = 0.8 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: osd failsafe full ratio = 0.95 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: osd fast shutdown = False 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: osd objectstore = bluestore 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-04-01T16:32:46.493 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: debug client = 20 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2024-04-01T16:32:46.494 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: # 1m isn't quite enough 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: mon_down_mkfs_grace = 2m 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_filestore_osds = false 2024-04-01T16:32:46.495 INFO:teuthology.orchestra.run.smithi163.stdout: mon down mkfs grace = 300 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: mon op complaint time = 120 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd crush smoke test = False 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: client mount timeout = 600 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: debug client = 20 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2024-04-01T16:32:46.496 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.b] 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.c] 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.e] 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d] 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.f] 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout:[mds] 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds = 20 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds balancer = 20 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug frag = True 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug scatterstat = True 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout: mds op complaint time = 180 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout: mds valgrind exit = True 2024-04-01T16:32:46.497 INFO:teuthology.orchestra.run.smithi163.stdout: mds verify scatter = True 2024-04-01T16:32:46.498 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2024-04-01T16:32:46.498 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2024-04-01T16:32:46.498 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2024-04-01T16:32:46.500 INFO:teuthology.orchestra.run.smithi189.stdout:[global] 2024-04-01T16:32:46.501 INFO:teuthology.orchestra.run.smithi189.stdout: chdir = "" 2024-04-01T16:32:46.501 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-01T16:32:46.501 INFO:teuthology.orchestra.run.smithi189.stdout: auth supported = cephx 2024-04-01T16:32:46.501 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.501 INFO:teuthology.orchestra.run.smithi189.stdout: filestore xattr use omap = true 2024-04-01T16:32:46.501 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.501 INFO:teuthology.orchestra.run.smithi189.stdout: mon clock drift allowed = 1.000 2024-04-01T16:32:46.501 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.501 INFO:teuthology.orchestra.run.smithi189.stdout: osd crush chooseleaf type = 0 2024-04-01T16:32:46.501 INFO:teuthology.orchestra.run.smithi189.stdout: auth debug = true 2024-04-01T16:32:46.501 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.502 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on old message = true 2024-04-01T16:32:46.502 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on bug = true 2024-04-01T16:32:46.502 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.502 INFO:teuthology.orchestra.run.smithi189.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-01T16:32:46.502 INFO:teuthology.orchestra.run.smithi189.stdout: mon pg warn max object skew = 0 2024-04-01T16:32:46.502 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.502 INFO:teuthology.orchestra.run.smithi189.stdout: # disable pg_autoscaler by default for new pools 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default size = 2 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow primary affinity = true 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow pg remap = true 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on legacy crush tunables = false 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on crush straw calc version zero = false 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on no sortbitwise = false 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on osd down out interval zero = false 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on too few osds = false 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-01T16:32:46.503 INFO:teuthology.orchestra.run.smithi189.stdout: mon_allow_pool_size_one = true 2024-04-01T16:32:46.504 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.504 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-01T16:32:46.504 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.504 INFO:teuthology.orchestra.run.smithi189.stdout: osd default data pool replay window = 5 2024-04-01T16:32:46.504 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.504 INFO:teuthology.orchestra.run.smithi189.stdout: mon allow pool delete = true 2024-04-01T16:32:46.504 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.504 INFO:teuthology.orchestra.run.smithi189.stdout: mon cluster log file level = debug 2024-04-01T16:32:46.504 INFO:teuthology.orchestra.run.smithi189.stdout: debug asserts on shutdown = true 2024-04-01T16:32:46.504 INFO:teuthology.orchestra.run.smithi189.stdout: mon health detail to clog = false 2024-04-01T16:32:46.504 INFO:teuthology.orchestra.run.smithi189.stdout: mon host = "172.21.15.163,172.21.15.189,[v2:172.21.15.189:3301,v1:172.21.15.189:6790]" 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: mds beacon grace = 60 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: mds heartbeat grace = 60 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: osd heartbeat grace = 60 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: fsid = 0870cdfa-3f81-4bb7-98e8-9588fec4cf05 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout:[osd] 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: osd journal size = 100 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub load threshold = 5.0 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub max interval = 600 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: osd mclock profile = high_recovery_ops 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: osd recover clone overlap = true 2024-04-01T16:32:46.505 INFO:teuthology.orchestra.run.smithi189.stdout: osd recovery max chunk = 1048576 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug shutdown = true 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug op order = true 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug verify stray on activate = true 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug trim objects = true 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: osd open classes on start = true 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug pg log writeout = true 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: osd deep scrub update digest min age = 30 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: osd map max advance = 10 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: journal zero on create = true 2024-04-01T16:32:46.506 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: filestore ondisk finisher threads = 3 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: filestore apply finisher threads = 3 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: bdev debug aio = true 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug misdirected ops = true 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: bdev async discard = True 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: bdev enable discard = True 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore allocator = bitmap 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore block size = 96636764160 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore fsck on mount = True 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluefs = 1/20 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluestore = 1/20 2024-04-01T16:32:46.507 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: debug osd = 20 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: debug rocksdb = 4/10 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd backfillfull_ratio = 0.85 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd full ratio = 0.9 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd nearfull ratio = 0.8 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: osd failsafe full ratio = 0.95 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: osd fast shutdown = False 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: osd objectstore = bluestore 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr] 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: debug mgr = 20 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-04-01T16:32:46.508 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: mgr/telemetry/nag = false 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout:[mon] 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: debug paxos = 20 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: mon data avail warn = 5 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: mon mgr mkfs grace = 240 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd reporter subtree level = osd 2024-04-01T16:32:46.509 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd prime pg temp = true 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: auth mon ticket ttl = 660 # 11m 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: auth service ticket ttl = 240 # 4m 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: # don't complain about insecure global_id in the test suite 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: # 1m isn't quite enough 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: mon_down_mkfs_grace = 2m 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_filestore_osds = false 2024-04-01T16:32:46.510 INFO:teuthology.orchestra.run.smithi189.stdout: mon down mkfs grace = 300 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: mon op complaint time = 120 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd crush smoke test = False 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout:[client] 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: rgw cache enabled = true 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable ops log = true 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable usage log = true 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: client mount timeout = 600 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: debug client = 20 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.a] 2024-04-01T16:32:46.511 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.b] 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.c] 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.a] 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.c] 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.e] 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.b] 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.d] 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.f] 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout:[mds] 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds = 20 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout: debug mds balancer = 20 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug frag = True 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout: mds debug scatterstat = True 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout: mds op complaint time = 180 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout: mds valgrind exit = True 2024-04-01T16:32:46.512 INFO:teuthology.orchestra.run.smithi189.stdout: mds verify scatter = True 2024-04-01T16:32:46.513 INFO:teuthology.orchestra.run.smithi189.stdout: osd op complaint time = 180 2024-04-01T16:32:46.513 INFO:teuthology.orchestra.run.smithi189.stdout: rados mon op timeout = 900 2024-04-01T16:32:46.513 INFO:teuthology.orchestra.run.smithi189.stdout: rados osd op timeout = 900 2024-04-01T16:32:46.545 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-01T16:32:46.545 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-01T16:32:46.688 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-01T16:32:46.689 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:32:46.689 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-01T16:32:46.734 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:32:46.735 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-01T16:32:46.828 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2024-04-01T16:32:46.828 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:32:46.828 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-01T16:32:46.828 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-01T16:32:46.957 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:32:46.957 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:32:47.055 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi189.front.sepia.ceph.com 2024-04-01T16:32:47.055 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:32:47.055 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-01T16:32:47.055 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-01T16:32:47.209 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:32:47.209 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:32:47.305 INFO:tasks.ceph:Setting up mon nodes... 2024-04-01T16:32:47.306 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-01T16:32:47.306 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-01T16:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-01T16:32:47.497 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-01T16:32:47.681 INFO:teuthology.orchestra.run.smithi189.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-01T16:32:47.692 INFO:tasks.ceph:Setting up mds nodes... 2024-04-01T16:32:47.692 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-01T16:32:47.877 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-01T16:32:47.887 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-01T16:32:47.981 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-01T16:32:48.155 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-01T16:32:48.164 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-01T16:32:48.254 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-01T16:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-01T16:32:48.443 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-01T16:32:48.535 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-01T16:32:48.724 INFO:teuthology.orchestra.run.smithi189.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-01T16:32:48.733 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-01T16:32:48.826 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-01T16:32:49.003 INFO:teuthology.orchestra.run.smithi189.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-01T16:32:49.012 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-01T16:32:49.099 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-01T16:32:49.269 INFO:teuthology.orchestra.run.smithi189.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-01T16:32:49.278 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-01T16:32:49.366 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-01T16:32:49.366 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-01T16:32:49.492 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-01T16:32:49.547 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-01T16:32:49.547 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi189.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-01T16:32:49.547 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-01T16:32:49.643 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T16:32:49.643 INFO:tasks.ceph:role: osd.0 2024-04-01T16:32:49.643 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-01T16:32:49.643 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-01T16:32:49.738 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T16:32:49.738 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T16:32:49.738 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T16:32:49.738 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T16:32:49.738 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T16:32:49.738 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-04-01T16:32:49.739 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T16:32:49.739 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T16:32:49.739 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T16:32:49.739 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T16:32:50.256 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-04-01T16:32:50.263 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-04-01T16:32:50.263 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-01T16:32:50.456 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-01T16:32:50.566 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-01T16:32:50.654 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T16:32:50.654 INFO:tasks.ceph:role: osd.1 2024-04-01T16:32:50.654 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-01T16:32:50.655 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-01T16:32:50.744 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T16:32:50.745 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T16:32:50.745 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T16:32:50.745 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T16:32:50.745 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T16:32:50.745 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-04-01T16:32:50.745 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T16:32:50.745 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T16:32:50.745 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T16:32:50.745 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T16:32:51.218 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-04-01T16:32:51.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-04-01T16:32:51.227 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-01T16:32:51.363 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-01T16:32:51.440 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-01T16:32:51.520 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T16:32:51.520 INFO:tasks.ceph:role: osd.2 2024-04-01T16:32:51.520 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-01T16:32:51.520 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-01T16:32:51.600 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T16:32:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T16:32:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T16:32:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T16:32:51.600 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T16:32:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-04-01T16:32:51.600 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T16:32:51.600 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T16:32:51.600 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T16:32:51.601 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T16:32:52.112 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-04-01T16:32:52.119 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-04-01T16:32:52.119 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-01T16:32:52.299 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-01T16:32:52.400 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-01T16:32:52.493 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T16:32:52.493 INFO:tasks.ceph:role: osd.3 2024-04-01T16:32:52.493 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-01T16:32:52.494 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-01T16:32:52.589 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T16:32:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T16:32:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T16:32:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T16:32:52.589 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T16:32:52.589 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-04-01T16:32:52.590 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T16:32:52.590 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T16:32:52.590 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T16:32:52.590 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T16:32:53.062 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-04-01T16:32:53.068 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-04-01T16:32:53.068 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-01T16:32:53.210 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-01T16:32:53.304 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:32:53.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:53.443+0000 7efc88c48640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-01T16:32:53.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:53.444+0000 7efc88c48640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-01T16:32:53.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:53.444+0000 7efc88c48640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-01T16:32:53.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:53.444+0000 7efc88c48640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-01T16:32:53.444 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:53.444+0000 7efc88c48640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-01T16:32:53.453 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:53.454+0000 7efc88c48640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-01T16:32:56.395 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-01T16:32:56.495 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:32:56.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:56.629+0000 7f58f8f19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-01T16:32:56.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:56.630+0000 7f58f8f19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-01T16:32:56.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:56.630+0000 7f58f8f19640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-01T16:32:56.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:56.630+0000 7f58f8f19640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-01T16:32:56.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:56.630+0000 7f58f8f19640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-01T16:32:56.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:56.632+0000 7f58f8f19640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-01T16:32:59.541 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-01T16:32:59.639 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:32:59.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:59.778+0000 7fac34815640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-01T16:32:59.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:59.778+0000 7fac34815640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-01T16:32:59.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:59.778+0000 7fac34815640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-01T16:32:59.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:59.778+0000 7fac34815640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-01T16:32:59.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:59.779+0000 7fac34815640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-01T16:32:59.780 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:32:59.781+0000 7fac34815640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-01T16:33:02.715 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-01T16:33:02.812 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:33:02.948 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:02.948+0000 7ff2e5804640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-01T16:33:02.949 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:02.949+0000 7ff2e5804640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-01T16:33:02.949 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:02.949+0000 7ff2e5804640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-01T16:33:02.949 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:02.949+0000 7ff2e5804640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-01T16:33:02.949 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:02.949+0000 7ff2e5804640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-01T16:33:02.950 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:02.951+0000 7ff2e5804640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-01T16:33:05.875 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-01T16:33:05.973 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-01T16:33:06.076 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T16:33:06.076 INFO:tasks.ceph:role: osd.4 2024-04-01T16:33:06.076 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-01T16:33:06.077 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-01T16:33:06.170 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T16:33:06.170 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T16:33:06.170 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T16:33:06.170 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T16:33:06.170 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T16:33:06.170 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-04-01T16:33:06.170 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T16:33:06.171 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T16:33:06.171 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T16:33:06.171 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T16:33:06.694 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-04-01T16:33:06.700 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-04-01T16:33:06.700 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-01T16:33:06.877 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-01T16:33:06.969 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-01T16:33:07.041 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T16:33:07.041 INFO:tasks.ceph:role: osd.5 2024-04-01T16:33:07.041 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-01T16:33:07.042 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-01T16:33:07.117 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T16:33:07.117 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T16:33:07.118 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T16:33:07.118 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T16:33:07.118 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T16:33:07.118 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-04-01T16:33:07.118 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T16:33:07.118 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T16:33:07.118 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T16:33:07.118 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T16:33:07.568 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-04-01T16:33:07.574 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-04-01T16:33:07.574 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-01T16:33:07.702 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-01T16:33:07.790 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-01T16:33:07.866 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T16:33:07.866 INFO:tasks.ceph:role: osd.6 2024-04-01T16:33:07.866 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-01T16:33:07.866 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-01T16:33:07.950 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T16:33:07.951 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T16:33:07.951 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T16:33:07.951 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T16:33:07.951 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T16:33:07.951 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-04-01T16:33:07.951 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T16:33:07.951 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T16:33:07.951 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T16:33:07.951 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T16:33:08.474 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-04-01T16:33:08.481 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-04-01T16:33:08.481 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-01T16:33:08.663 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-01T16:33:08.756 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-01T16:33:08.838 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T16:33:08.838 INFO:tasks.ceph:role: osd.7 2024-04-01T16:33:08.838 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-01T16:33:08.839 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-01T16:33:08.926 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T16:33:08.927 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T16:33:08.927 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T16:33:08.927 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T16:33:08.927 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T16:33:08.927 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-04-01T16:33:08.927 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T16:33:08.927 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T16:33:08.927 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T16:33:08.927 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T16:33:09.383 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-04-01T16:33:09.389 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-04-01T16:33:09.389 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-01T16:33:09.496 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-01T16:33:09.579 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:33:09.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:09.726+0000 7fc287fac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-01T16:33:09.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:09.727+0000 7fc287fac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-01T16:33:09.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:09.727+0000 7fc287fac640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-01T16:33:09.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:09.727+0000 7fc287fac640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-01T16:33:09.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:09.727+0000 7fc287fac640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-01T16:33:09.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:09.730+0000 7fc287fac640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-01T16:33:12.912 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-01T16:33:13.005 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:33:13.139 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:13.140+0000 7f63e0771640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-01T16:33:13.140 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:13.141+0000 7f63e0771640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-01T16:33:13.140 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:13.141+0000 7f63e0771640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-01T16:33:13.140 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:13.141+0000 7f63e0771640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-01T16:33:13.140 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:13.141+0000 7f63e0771640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-01T16:33:13.142 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:13.143+0000 7f63e0771640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-01T16:33:13.754 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:33:13.762 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:33:16.074 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-01T16:33:16.163 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:33:16.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:16.300+0000 7f1004381640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-01T16:33:16.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:16.301+0000 7f1004381640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-01T16:33:16.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:16.301+0000 7f1004381640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-01T16:33:16.301 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:16.301+0000 7f1004381640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-01T16:33:16.301 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:16.301+0000 7f1004381640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-01T16:33:16.302 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:16.303+0000 7f1004381640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-01T16:33:19.480 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-01T16:33:19.574 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:33:19.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:19.713+0000 7fd667c11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-01T16:33:19.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:19.713+0000 7fd667c11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-01T16:33:19.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:19.713+0000 7fd667c11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-01T16:33:19.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:19.713+0000 7fd667c11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-01T16:33:19.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:19.713+0000 7fd667c11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-01T16:33:19.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:19.716+0000 7fd667c11640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-01T16:33:22.638 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-01T16:33:22.733 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-01T16:33:22.733 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:22.733 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-01T16:33:22.835 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:22.835 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-01T16:33:22.921 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:22.921 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-01T16:33:23.060 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:23.064 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-01T16:33:23.158 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:23.158 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-01T16:33:23.249 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:23.249 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-01T16:33:23.344 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:23.344 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-01T16:33:23.438 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:23.438 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-01T16:33:23.527 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:33:23.527 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-01T16:33:23.624 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:33:23.625 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-01T16:33:23.717 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:33:23.717 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-01T16:33:23.811 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:33:23.811 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-01T16:33:23.904 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:33:23.904 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-01T16:33:24.042 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:33:24.042 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-01T16:33:24.135 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:33:24.135 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-01T16:33:24.228 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:33:24.229 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-01T16:33:24.321 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:24.321 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-01T16:33:24.376 INFO:tasks.ceph:Adding keys to all mons... 2024-04-01T16:33:24.376 DEBUG:teuthology.orchestra.run.smithi163:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-01T16:33:24.383 DEBUG:teuthology.orchestra.run.smithi189:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-01T16:33:24.465 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.y] 2024-04-01T16:33:24.465 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCv4QpmS2cdHRAA3vF1xOghYECSSUz3+hV5mw== 2024-04-01T16:33:24.465 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2024-04-01T16:33:24.465 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCv4QpmyDJlNBAAVAh3udzxGBhRE7CZOCB+nA== 2024-04-01T16:33:24.465 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2024-04-01T16:33:24.465 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCw4QpmP3VbCRAA6777bqKq85rlwjCJcozu/Q== 2024-04-01T16:33:24.465 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.e] 2024-04-01T16:33:24.465 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCw4Qpmjuv0GRAADdq+7SWqc/txXOq3pviF1A== 2024-04-01T16:33:24.465 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.0] 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQC14QpmWUB2GhAAxTEQLMAVuma3KpWWC5+NBg== 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.1] 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQC44QpmAW+TJRAAIDJ5bLqEEI1xPQeDsrCT3A== 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.2] 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQC74QpmS2dvLhAAjjZjKuq9IWvPFinR+LMWdA== 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.3] 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQC+4Qpm7/qXOBAAcXi+9Eu2UjNp2yEGN0wONA== 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.x] 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCv4QpmVLuwKBAAh40SsJEbm/eow4DEeYoZSA== 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCw4QpmDQNAKxAA5OG6kBwCh1fZzNOair6vcw== 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d] 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCx4Qpm5WxGABAAFqx8+l1ySQnTbQeWOnErKA== 2024-04-01T16:33:24.466 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.f] 2024-04-01T16:33:24.467 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCx4Qpmq+wgEBAA0Lbppxs0rUMZu/MUHLUK8w== 2024-04-01T16:33:24.467 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.4] 2024-04-01T16:33:24.467 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQDF4QpmyJFVKxAAx7IFc8lTxeNObhttKG46xw== 2024-04-01T16:33:24.467 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.5] 2024-04-01T16:33:24.467 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQDJ4QpmrGlqCBAAWXfNdgu+/c6rDMkA+hJl/w== 2024-04-01T16:33:24.467 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.6] 2024-04-01T16:33:24.467 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQDM4Qpm0HH2ERAAi0sz7F0p14bBWnHuLaH4Zg== 2024-04-01T16:33:24.467 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.7] 2024-04-01T16:33:24.467 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQDP4QpmqtWMKhAAq48jgZxORG3FVD9Ykkqc2Q== 2024-04-01T16:33:24.467 INFO:teuthology.orchestra.run.smithi163.stdout:[client.0] 2024-04-01T16:33:24.467 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCx4QpmfEdrHRAAaXpYF9s9hSfILAKl5V9KLA== 2024-04-01T16:33:24.476 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr.y] 2024-04-01T16:33:24.476 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQCv4QpmS2cdHRAA3vF1xOghYECSSUz3+hV5mw== 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.a] 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQCv4QpmyDJlNBAAVAh3udzxGBhRE7CZOCB+nA== 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.c] 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQCw4QpmP3VbCRAA6777bqKq85rlwjCJcozu/Q== 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.e] 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQCw4Qpmjuv0GRAADdq+7SWqc/txXOq3pviF1A== 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.0] 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQC14QpmWUB2GhAAxTEQLMAVuma3KpWWC5+NBg== 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.1] 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQC44QpmAW+TJRAAIDJ5bLqEEI1xPQeDsrCT3A== 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.2] 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQC74QpmS2dvLhAAjjZjKuq9IWvPFinR+LMWdA== 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.3] 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQC+4Qpm7/qXOBAAcXi+9Eu2UjNp2yEGN0wONA== 2024-04-01T16:33:24.477 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr.x] 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQCv4QpmVLuwKBAAh40SsJEbm/eow4DEeYoZSA== 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.b] 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQCw4QpmDQNAKxAA5OG6kBwCh1fZzNOair6vcw== 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.d] 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQCx4Qpm5WxGABAAFqx8+l1ySQnTbQeWOnErKA== 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout:[mds.f] 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQCx4Qpmq+wgEBAA0Lbppxs0rUMZu/MUHLUK8w== 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.4] 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDF4QpmyJFVKxAAx7IFc8lTxeNObhttKG46xw== 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.5] 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDJ4QpmrGlqCBAAWXfNdgu+/c6rDMkA+hJl/w== 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.6] 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDM4Qpm0HH2ERAAi0sz7F0p14bBWnHuLaH4Zg== 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.7] 2024-04-01T16:33:24.478 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDP4QpmqtWMKhAAq48jgZxORG3FVD9Ykkqc2Q== 2024-04-01T16:33:24.479 INFO:teuthology.orchestra.run.smithi189.stdout:[client.0] 2024-04-01T16:33:24.479 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQCx4QpmfEdrHRAAaXpYF9s9hSfILAKl5V9KLA== 2024-04-01T16:33:24.482 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T16:33:24.517 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T16:33:24.662 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T16:33:24.670 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T16:33:24.813 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T16:33:24.818 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T16:33:24.962 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T16:33:24.969 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T16:33:25.116 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:25.122 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:25.265 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:25.272 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:25.416 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:25.422 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:25.562 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:25.569 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:25.706 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T16:33:25.712 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T16:33:25.855 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T16:33:25.860 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T16:33:26.003 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T16:33:26.010 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T16:33:26.156 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T16:33:26.163 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T16:33:26.306 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:26.313 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:26.455 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:26.460 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:26.598 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:26.602 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:26.738 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:26.745 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T16:33:26.886 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-01T16:33:26.893 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-01T16:33:27.035 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-01T16:33:27.035 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-01T16:33:27.129 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-01T16:33:27.284 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-01T16:33:27.378 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-01T16:33:27.479 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-01T16:33:27.636 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-01T16:33:27.725 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-01T16:33:27.820 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-01T16:33:27.973 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-01T16:33:28.063 DEBUG:teuthology.orchestra.run.smithi163:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:33:28.071 DEBUG:teuthology.orchestra.run.smithi189:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-01T16:33:28.123 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-01T16:33:28.124 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-01T16:33:28.124 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-01T16:33:28.124 DEBUG:teuthology.orchestra.run.smithi163:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-04-01T16:33:28.129 INFO:tasks.ceph.mon.a:Started 2024-04-01T16:33:28.129 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-01T16:33:28.129 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-01T16:33:28.129 DEBUG:teuthology.orchestra.run.smithi189:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-04-01T16:33:28.134 INFO:tasks.ceph.mon.b:Started 2024-04-01T16:33:28.134 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-01T16:33:28.134 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-01T16:33:28.134 DEBUG:teuthology.orchestra.run.smithi189:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-04-01T16:33:28.139 INFO:tasks.ceph.mon.c:Started 2024-04-01T16:33:28.139 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-01T16:33:28.139 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-01T16:33:28.140 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-04-01T16:33:28.144 INFO:tasks.ceph.mgr.y:Started 2024-04-01T16:33:28.144 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-01T16:33:28.144 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-04-01T16:33:28.149 INFO:tasks.ceph.mgr.x:Started 2024-04-01T16:33:28.150 INFO:tasks.ceph:Setting crush tunables to default 2024-04-01T16:33:28.150 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd crush tunables default 2024-04-01T16:33:28.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.325+0000 7fb10ca00640 1 Processor -- start 2024-04-01T16:33:28.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.325+0000 7fb10ca00640 1 -- start start 2024-04-01T16:33:28.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.327+0000 7fb10ca00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb108154c50 0x7fb10806c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:28.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.327+0000 7fb10ca00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 0x7fb10806c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:28.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.327+0000 7fb10ca00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb1080b4660 0x7fb1080b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:28.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.327+0000 7fb10ca00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb1080b4ff0 con 0x7fb1080b4660 2024-04-01T16:33:28.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.327+0000 7fb10ca00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb1080ca9a0 con 0x7fb108154c50 2024-04-01T16:33:28.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.327+0000 7fb10ca00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb1080cc840 con 0x7fb10815dd60 2024-04-01T16:33:28.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.327+0000 7fb106800640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7fb1080b4660 msgr2=0x7fb1080b4ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3300/0 2024-04-01T16:33:28.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.327+0000 7fb106800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb1080b4660 0x7fb1080b4ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T16:33:28.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.327+0000 7fb0fd400640 1 -- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 msgr2=0x7fb10806c950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3301/0 2024-04-01T16:33:28.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.327+0000 7fb105e00640 1 -- >> v2:172.21.15.189:3300/0 conn(0x7fb108154c50 msgr2=0x7fb10806c410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3300/0 2024-04-01T16:33:28.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.327+0000 7fb105e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb108154c50 0x7fb10806c410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T16:33:28.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.327+0000 7fb0fd400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 0x7fb10806c950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T16:33:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.528+0000 7fb106800640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7fb1080b4660 msgr2=0x7fb1080b4ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3300/0 2024-04-01T16:33:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.528+0000 7fb106800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb1080b4660 0x7fb1080b4ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T16:33:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.528+0000 7fb105e00640 1 -- >> v2:172.21.15.189:3300/0 conn(0x7fb108154c50 msgr2=0x7fb10806c410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3300/0 2024-04-01T16:33:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.528+0000 7fb0fd400640 1 -- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 msgr2=0x7fb10806c950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3301/0 2024-04-01T16:33:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.528+0000 7fb105e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb108154c50 0x7fb10806c410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T16:33:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.528+0000 7fb0fd400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 0x7fb10806c950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T16:33:28.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.929+0000 7fb106800640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7fb1080b4660 msgr2=0x7fb1080b4ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3300/0 2024-04-01T16:33:28.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.929+0000 7fb106800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb1080b4660 0x7fb1080b4ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T16:33:28.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.929+0000 7fb105e00640 1 -- >> v2:172.21.15.189:3300/0 conn(0x7fb108154c50 msgr2=0x7fb10806c410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3300/0 2024-04-01T16:33:28.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.929+0000 7fb0fd400640 1 -- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 msgr2=0x7fb10806c950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3301/0 2024-04-01T16:33:28.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.929+0000 7fb105e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb108154c50 0x7fb10806c410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T16:33:28.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:28.929+0000 7fb0fd400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 0x7fb10806c950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T16:33:29.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:29.730+0000 7fb106800640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7fb1080b4660 msgr2=0x7fb1080b4ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.163:3300/0 2024-04-01T16:33:29.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:29.730+0000 7fb0fd400640 1 -- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 msgr2=0x7fb10806c950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3301/0 2024-04-01T16:33:29.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:29.730+0000 7fb106800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb1080b4660 0x7fb1080b4ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T16:33:29.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:29.730+0000 7fb0fd400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 0x7fb10806c950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T16:33:29.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:29.730+0000 7fb105e00640 1 -- >> v2:172.21.15.189:3300/0 conn(0x7fb108154c50 msgr2=0x7fb10806c410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3300/0 2024-04-01T16:33:29.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:29.730+0000 7fb105e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb108154c50 0x7fb10806c410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T16:33:31.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.327+0000 7fb0ffe00640 1 -- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 msgr2=0x7fb10806c950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T16:33:31.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.327+0000 7fb0ffe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 0x7fb10806c950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:31.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.327+0000 7fb0ffe00640 1 -- >> v2:172.21.15.189:3300/0 conn(0x7fb108154c50 msgr2=0x7fb10806c410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T16:33:31.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.327+0000 7fb0ffe00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb108154c50 0x7fb10806c410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:31.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.327+0000 7fb0ffe00640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7fb1080b4660 msgr2=0x7fb1080b4ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T16:33:31.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.327+0000 7fb0ffe00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb1080b4660 0x7fb1080b4ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:31.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.327+0000 7fb0ffe00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1080cac60 con 0x7fb0e4007360 2024-04-01T16:33:31.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.327+0000 7fb0ffe00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e400c0d0 con 0x7fb0e40036b0 2024-04-01T16:33:31.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.327+0000 7fb0fd400640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7fb0e4007360 legacy=0x7fb0e4009820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-04-01T16:33:31.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.327+0000 7fb105e00640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fb0e40036b0 legacy=0x7fb0e4005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-04-01T16:33:31.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.528+0000 7fb0fd400640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7fb0e4007360 legacy=0x7fb0e4009820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-04-01T16:33:31.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.528+0000 7fb105e00640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fb0e40036b0 legacy=0x7fb0e4005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-04-01T16:33:31.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.929+0000 7fb0fd400640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7fb0e4007360 legacy=0x7fb0e4009820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-04-01T16:33:31.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:31.929+0000 7fb105e00640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fb0e40036b0 legacy=0x7fb0e4005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-04-01T16:33:32.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:32.730+0000 7fb0fd400640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7fb0e4007360 legacy=0x7fb0e4009820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-04-01T16:33:32.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:32.730+0000 7fb105e00640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fb0e40036b0 legacy=0x7fb0e4005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-04-01T16:33:34.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.327+0000 7fb0ffe00640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fb0e40036b0 legacy=0x7fb0e4005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T16:33:34.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.327+0000 7fb0ffe00640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7fb0e4007360 legacy=0x7fb0e4009820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T16:33:34.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.328+0000 7fb106800640 1 -- reap_dead start 2024-04-01T16:33:34.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.328+0000 7fb0ffe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 0x7fb0e400ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:34.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.328+0000 7fb0ffe00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e400d370 con 0x7fb0e4007360 2024-04-01T16:33:34.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.328+0000 7fb0ffe00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1080cac60 con 0x7fb0e4006260 2024-04-01T16:33:34.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.328+0000 7fb0ffe00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb1080b4ff0 con 0x7fb10815dd60 2024-04-01T16:33:34.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.328+0000 7fb105e00640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7fb0e4007360 legacy=0x7fb0e400c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-04-01T16:33:34.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.328+0000 7fb0fd400640 1 -- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 msgr2=0x7fb0e400ca20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3301/0 2024-04-01T16:33:34.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.328+0000 7fb106800640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fb0e4006260 legacy=0x7fb0e4005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-04-01T16:33:34.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.328+0000 7fb0fd400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 0x7fb0e400ca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T16:33:34.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.529+0000 7fb105e00640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7fb0e4007360 legacy=0x7fb0e400c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-04-01T16:33:34.530 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.529+0000 7fb106800640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fb0e4006260 legacy=0x7fb0e4005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-04-01T16:33:34.530 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.529+0000 7fb0fd400640 1 -- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 msgr2=0x7fb0e400ca20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3301/0 2024-04-01T16:33:34.530 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.529+0000 7fb0fd400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 0x7fb0e400ca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T16:33:34.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.931+0000 7fb0fd400640 1 -- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 msgr2=0x7fb0e400ca20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3301/0 2024-04-01T16:33:34.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.931+0000 7fb0fd400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 0x7fb0e400ca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T16:33:34.931 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.931+0000 7fb105e00640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7fb0e4007360 legacy=0x7fb0e400c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-04-01T16:33:34.931 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:34.931+0000 7fb106800640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fb0e4006260 legacy=0x7fb0e4005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-04-01T16:33:35.725 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:00:07.408 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:33:35.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:35.732+0000 7fb0fd400640 1 -- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 msgr2=0x7fb0e400ca20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3301/0 2024-04-01T16:33:35.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:35.732+0000 7fb0fd400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 0x7fb0e400ca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T16:33:35.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:35.732+0000 7fb106800640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fb0e4006260 legacy=0x7fb0e4005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-04-01T16:33:35.732 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:35.732+0000 7fb105e00640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7fb0e4007360 legacy=0x7fb0e400c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.163:6789/0 2024-04-01T16:33:35.994 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:00:07.662 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:33:36.011 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:00:07.679 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:33:36.046 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:00:07.729 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:33:36.329 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:00:07.997 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:33:36.346 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:00:08.013 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:33:37.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.329+0000 7fb0ffe00640 1 -- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 msgr2=0x7fb0e400ca20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T16:33:37.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.329+0000 7fb0ffe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb10815dd60 0x7fb0e400ca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:37.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.329+0000 7fb0ffe00640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fb0e4006260 legacy=0x7fb0e4005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T16:33:37.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.329+0000 7fb0ffe00640 1 -- >> v1:172.21.15.163:6789/0 conn(0x7fb0e4007360 legacy=0x7fb0e400c2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T16:33:37.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.329+0000 7fb0ffe00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 0x7fb0e40066c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:37.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.329+0000 7fb0ffe00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:37.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.329+0000 7fb0ffe00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb1080b4ff0 con 0x7fb0e4006c00 2024-04-01T16:33:37.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.329+0000 7fb0ffe00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb1080ca9a0 con 0x7fb0e400a7b0 2024-04-01T16:33:37.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.329+0000 7fb105e00640 1 -- >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 msgr2=0x7fb0e40066c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3300/0 2024-04-01T16:33:37.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.330+0000 7fb105e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 0x7fb0e40066c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T16:33:37.530 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.531+0000 7fb105e00640 1 -- >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 msgr2=0x7fb0e40066c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.189:3300/0 2024-04-01T16:33:37.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.531+0000 7fb105e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 0x7fb0e40066c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T16:33:37.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.823+0000 7fb0fd400640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 msgr2=0x7fb0e40136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T16:33:37.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.823+0000 7fb0fd400640 1 -- >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 msgr2=0x7fb0e40136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:37.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.823+0000 7fb0fd400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2024-04-01T16:33:37.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:37.823+0000 7fb0fd400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T16:33:38.092 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.093+0000 7fb0fd400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:38.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.095+0000 7fb0fd400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:43442/0 (socket says 172.21.15.163:43442) 2024-04-01T16:33:38.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.095+0000 7fb0fd400640 1 -- 172.21.15.163:0/278217241 learned_addr learned my addr 172.21.15.163:0/278217241 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:33:38.097 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.098+0000 7fb0fd400640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 msgr2=0x7fb0e40136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T16:33:38.097 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.098+0000 7fb0fd400640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 msgr2=0x7fb0e40136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:38.097 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.098+0000 7fb0fd400640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:38.097 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.098+0000 7fb0fd400640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T16:33:38.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.300+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 0x7fb0e40066c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:38.306 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.307+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 msgr2=0x7fb0e40066c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T16:33:38.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.307+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 msgr2=0x7fb0e40066c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:38.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.307+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 0x7fb0e40066c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:38.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.307+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 0x7fb0e40066c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T16:33:38.855 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.855+0000 7fb0fd400640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:38.871 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.872+0000 7fb0fd400640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 msgr2=0x7fb0e40136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T16:33:38.872 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.872+0000 7fb0fd400640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 msgr2=0x7fb0e40136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:38.872 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.872+0000 7fb0fd400640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:38.872 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:38.872+0000 7fb0fd400640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T16:33:39.471 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:39.472+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 0x7fb0e40066c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:39.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:39.603+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 msgr2=0x7fb0e40066c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T16:33:39.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:39.603+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 msgr2=0x7fb0e40066c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:39.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:39.603+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 0x7fb0e40066c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:39.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:39.603+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 0x7fb0e40066c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T16:33:39.797 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:39.797+0000 7fb0fd400640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:39.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:39.827+0000 7fb0fd400640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 msgr2=0x7fb0e40136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T16:33:39.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:39.827+0000 7fb0fd400640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 msgr2=0x7fb0e40136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:39.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:39.827+0000 7fb0fd400640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:39.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:39.827+0000 7fb0fd400640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T16:33:40.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.329+0000 7fb0ffe00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 msgr2=0x7fb0e40066c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T16:33:40.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.329+0000 7fb0ffe00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e400a7b0 0x7fb0e40066c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:40.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.330+0000 7fb0ffe00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 msgr2=0x7fb0e40136d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T16:33:40.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.330+0000 7fb0ffe00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e4006c00 0x7fb0e40136d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:40.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.330+0000 7fb106800640 1 -- 172.21.15.163:0/278217241 reap_dead start 2024-04-01T16:33:40.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.330+0000 7fb0ffe00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:40.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.330+0000 7fb0ffe00640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:40.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.330+0000 7fb0ffe00640 1 -- 172.21.15.163:0/278217241 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e400c0d0 con 0x7fb0e4005aa0 2024-04-01T16:33:40.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.330+0000 7fb0ffe00640 1 -- 172.21.15.163:0/278217241 --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb1080b4ff0 con 0x7fb0e4006260 2024-04-01T16:33:40.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.330+0000 7fb0ffe00640 1 -- 172.21.15.163:0/278217241 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb1080ca9a0 con 0x7fb0e400c9b0 2024-04-01T16:33:40.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.332+0000 7fb106800640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:40.347 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.348+0000 7fb106800640 1 -- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 msgr2=0x7fb0e400b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-01T16:33:40.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.348+0000 7fb106800640 1 -- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 msgr2=0x7fb0e400b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:40.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.348+0000 7fb106800640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:40.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.348+0000 7fb106800640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T16:33:40.389 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.390+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:40.404 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.404+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 msgr2=0x7fb0e4006640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T16:33:40.404 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.404+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 msgr2=0x7fb0e4006640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:40.404 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.404+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:40.404 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.404+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T16:33:40.550 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.550+0000 7fb106800640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:40.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.553+0000 7fb106800640 1 -- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 msgr2=0x7fb0e400b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T16:33:40.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.553+0000 7fb106800640 1 -- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 msgr2=0x7fb0e400b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:40.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.553+0000 7fb106800640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:40.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.553+0000 7fb106800640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T16:33:40.607 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.607+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:40.609 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.610+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 msgr2=0x7fb0e4006640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T16:33:40.609 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.610+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 msgr2=0x7fb0e4006640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:40.609 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.610+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:40.610 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.610+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T16:33:40.956 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.956+0000 7fb106800640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:40.959 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.959+0000 7fb106800640 1 -- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 msgr2=0x7fb0e400b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T16:33:40.959 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.959+0000 7fb106800640 1 -- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 msgr2=0x7fb0e400b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:40.959 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.959+0000 7fb106800640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:40.959 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:40.959+0000 7fb106800640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T16:33:41.012 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.013+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:41.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.016+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 msgr2=0x7fb0e4006640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T16:33:41.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.016+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 msgr2=0x7fb0e4006640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:41.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.016+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:41.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.016+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T16:33:41.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.763+0000 7fb106800640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:41.765 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.766+0000 7fb106800640 1 -- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 msgr2=0x7fb0e400b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T16:33:41.765 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.766+0000 7fb106800640 1 -- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 msgr2=0x7fb0e400b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:41.765 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.766+0000 7fb106800640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:41.766 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.766+0000 7fb106800640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T16:33:41.819 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.820+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:41.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.823+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 msgr2=0x7fb0e4006640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T16:33:41.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.823+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 msgr2=0x7fb0e4006640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T16:33:41.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.823+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T16:33:41.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:41.823+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T16:33:43.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.330+0000 7fb0ffe00640 1 -- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 msgr2=0x7fb0e400b080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T16:33:43.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.330+0000 7fb0ffe00640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb0e400c9b0 0x7fb0e400b080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:43.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.330+0000 7fb0ffe00640 1 -- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 msgr2=0x7fb0e4006640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T16:33:43.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.330+0000 7fb0ffe00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.189:3300/0 conn(0x7fb0e4006260 0x7fb0e4006640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:43.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.330+0000 7fb0ffe00640 1 -- 172.21.15.163:0/278217241 >> v1:172.21.15.189:6789/0 conn(0x7fb0e4005aa0 legacy=0x7fb0e400c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:43.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.330+0000 7fb0ffe00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e400b5c0 0x7fb0e400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:43.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.330+0000 7fb0ffe00640 1 -- 172.21.15.163:0/278217241 --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e400d370 con 0x7fb0e40116c0 2024-04-01T16:33:43.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.330+0000 7fb0ffe00640 1 -- 172.21.15.163:0/278217241 --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb1080b4ff0 con 0x7fb0e400b5c0 2024-04-01T16:33:43.367 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.368+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> v2:172.21.15.163:3300/0 conn(0x7fb0e400b5c0 0x7fb0e400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:43.466 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.466+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 >> v1:172.21.15.163:6789/0 conn(0x7fb0e40116c0 legacy=0x7fb0e4013ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:43.466 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.466+0000 7fb105e00640 1 -- 172.21.15.163:0/278217241 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1080cac60 con 0x7fb0e400b5c0 2024-04-01T16:33:43.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.491+0000 7fb105e00640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0e400b5c0 0x7fb0e400b9d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009440 tx=0x7fb0f002d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79d4da0b234ef23 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:43.692 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.693+0000 7fb105400640 1 -- 172.21.15.163:0/278217241 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f003c070 con 0x7fb0e400b5c0 2024-04-01T16:33:43.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.693+0000 7fb105400640 1 -- 172.21.15.163:0/278217241 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f00344d0 con 0x7fb0e400b5c0 2024-04-01T16:33:43.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.693+0000 7fb105400640 1 -- 172.21.15.163:0/278217241 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00348a0 con 0x7fb0e400b5c0 2024-04-01T16:33:43.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.694+0000 7fb10ca00640 1 -- 172.21.15.163:0/278217241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0e400b5c0 msgr2=0x7fb0e400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:43.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.694+0000 7fb10ca00640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0e400b5c0 0x7fb0e400b9d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009440 tx=0x7fb0f002d800 comp rx=0 tx=0).stop 2024-04-01T16:33:43.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.694+0000 7fb106800640 1 -- 172.21.15.163:0/278217241 reap_dead start 2024-04-01T16:33:43.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.694+0000 7fb10ca00640 1 -- 172.21.15.163:0/278217241 shutdown_connections 2024-04-01T16:33:43.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.694+0000 7fb10ca00640 1 --2- 172.21.15.163:0/278217241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0e400b5c0 0x7fb0e400b9d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:43.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.694+0000 7fb10ca00640 1 -- 172.21.15.163:0/278217241 >> 172.21.15.163:0/278217241 conn(0x7fb1080d0020 msgr2=0x7fb1080d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:43.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.694+0000 7fb10ca00640 1 -- 172.21.15.163:0/278217241 shutdown_connections 2024-04-01T16:33:43.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.694+0000 7fb10ca00640 1 -- 172.21.15.163:0/278217241 wait complete. 2024-04-01T16:33:43.696 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.697+0000 7fb10ca00640 1 Processor -- start 2024-04-01T16:33:43.696 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.697+0000 7fb10ca00640 1 -- start start 2024-04-01T16:33:43.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.698+0000 7fb10ca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1080c6300 0x7fb10814b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:43.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.698+0000 7fb10ca00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb10814beb0 0x7fb1081f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:43.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.698+0000 7fb10ca00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1080c66e0 0x7fb108148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:43.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.698+0000 7fb10ca00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb1080cb500 con 0x7fb10814beb0 2024-04-01T16:33:43.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.698+0000 7fb10ca00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb1080cb220 con 0x7fb1080c6300 2024-04-01T16:33:43.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.698+0000 7fb10ca00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb1080cb7e0 con 0x7fb1080c66e0 2024-04-01T16:33:43.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.704+0000 7fb105e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1080c6300 0x7fb10814b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:43.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.727+0000 7fb0fd400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb10814beb0 0x7fb1081f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:43.745 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.746+0000 7fb105e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1080c6300 0x7fb10814b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:33840/0 (socket says 172.21.15.163:33840) 2024-04-01T16:33:43.745 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.746+0000 7fb105e00640 1 -- 172.21.15.163:0/3253024478 learned_addr learned my addr 172.21.15.163:0/3253024478 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:33:43.793 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.794+0000 7fb105e00640 1 -- 172.21.15.163:0/3253024478 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1080c66e0 msgr2=0x7fb108148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:43.794 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.794+0000 7fb105e00640 1 --2- 172.21.15.163:0/3253024478 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1080c66e0 0x7fb108148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:43.794 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.794+0000 7fb105e00640 1 -- 172.21.15.163:0/3253024478 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb10814beb0 msgr2=0x7fb1081f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:43.794 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.794+0000 7fb105e00640 1 --2- 172.21.15.163:0/3253024478 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb10814beb0 0x7fb1081f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:43.794 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.794+0000 7fb105e00640 1 -- 172.21.15.163:0/3253024478 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1080cf340 con 0x7fb1080c6300 2024-04-01T16:33:43.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.805+0000 7fb105e00640 1 --2- 172.21.15.163:0/3253024478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1080c6300 0x7fb10814b970 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb0f003a040 tx=0x7fb0f0005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:43.815 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.816+0000 7fb0fea00640 1 -- 172.21.15.163:0/3253024478 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f003c040 con 0x7fb1080c6300 2024-04-01T16:33:43.815 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.816+0000 7fb0fea00640 1 -- 172.21.15.163:0/3253024478 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f0003960 con 0x7fb1080c6300 2024-04-01T16:33:43.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.816+0000 7fb0fea00640 1 -- 172.21.15.163:0/3253024478 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00150b0 con 0x7fb1080c6300 2024-04-01T16:33:43.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.816+0000 7fb10ca00640 1 -- 172.21.15.163:0/3253024478 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1080cf5e0 con 0x7fb1080c6300 2024-04-01T16:33:43.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.816+0000 7fb10ca00640 1 -- 172.21.15.163:0/3253024478 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1080cfba0 con 0x7fb1080c6300 2024-04-01T16:33:43.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.818+0000 7fb10ca00640 1 -- 172.21.15.163:0/3253024478 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1080756d0 con 0x7fb1080c6300 2024-04-01T16:33:43.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.844+0000 7fb0fea00640 1 -- 172.21.15.163:0/3253024478 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb0f003f070 con 0x7fb1080c6300 2024-04-01T16:33:43.871 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:43.872+0000 7fb0fea00640 1 -- 172.21.15.163:0/3253024478 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb0f0054860 con 0x7fb1080c6300 2024-04-01T16:33:43.939 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:33:43.947 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:33:44.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:44.139+0000 7fb0fea00640 1 -- 172.21.15.163:0/3253024478 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb0f0046020 con 0x7fb1080c6300 2024-04-01T16:33:44.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:44.253+0000 7fb10ca00640 1 -- 172.21.15.163:0/3253024478 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fb1080cc410 con 0x7fb1080c6300 2024-04-01T16:33:44.490 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:44.491+0000 7fa74f23c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T16:33:44.504 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:44.504+0000 7f30af838040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T16:33:44.559 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:44.559+0000 7fa74f23c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T16:33:44.571 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:44.571+0000 7f30af838040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T16:33:44.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:44.962+0000 7fb0fea00640 1 -- 172.21.15.163:0/3253024478 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fb0f0037890 con 0x7fb1080c6300 2024-04-01T16:33:44.962 INFO:teuthology.orchestra.run.smithi163.stderr:adjusted tunables profile to default 2024-04-01T16:33:44.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:44.964+0000 7fb10ca00640 1 -- 172.21.15.163:0/3253024478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1080c6300 msgr2=0x7fb10814b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:44.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:44.964+0000 7fb10ca00640 1 --2- 172.21.15.163:0/3253024478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1080c6300 0x7fb10814b970 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb0f003a040 tx=0x7fb0f0005c90 comp rx=0 tx=0).stop 2024-04-01T16:33:44.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:44.964+0000 7fb10ca00640 1 -- 172.21.15.163:0/3253024478 shutdown_connections 2024-04-01T16:33:44.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:44.964+0000 7fb10ca00640 1 --2- 172.21.15.163:0/3253024478 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb1080c66e0 0x7fb108148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:44.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:44.964+0000 7fb10ca00640 1 --2- 172.21.15.163:0/3253024478 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb10814beb0 0x7fb1081f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:44.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:44.964+0000 7fb10ca00640 1 --2- 172.21.15.163:0/3253024478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1080c6300 0x7fb10814b970 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:44.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:44.964+0000 7fb10ca00640 1 -- 172.21.15.163:0/3253024478 >> 172.21.15.163:0/3253024478 conn(0x7fb1080d0020 msgr2=0x7fb10814f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:44.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:44.964+0000 7fb10ca00640 1 -- 172.21.15.163:0/3253024478 shutdown_connections 2024-04-01T16:33:44.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:44.964+0000 7fb10ca00640 1 -- 172.21.15.163:0/3253024478 wait complete. 2024-04-01T16:33:44.984 INFO:tasks.ceph:check_enable_crimson: False 2024-04-01T16:33:44.984 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-01T16:33:44.984 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:44.984 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-01T16:33:45.062 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:45.062 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-01T16:33:45.189 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:45.189 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-01T16:33:45.207 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:45.207+0000 7fa74f23c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T16:33:45.251 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:45.251+0000 7f30af838040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T16:33:45.274 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:45.275+0000 7fa74f23c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T16:33:45.300 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:33:45.300 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-01T16:33:45.319 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:45.319+0000 7f30af838040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T16:33:45.328 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:45.329+0000 7fa74f23c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T16:33:45.374 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:45.374+0000 7f30af838040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T16:33:45.386 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:33:45.386 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-01T16:33:45.394 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:45.395+0000 7fa74f23c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T16:33:45.441 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:45.441+0000 7f30af838040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T16:33:45.444 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:45.445+0000 7fa74f23c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T16:33:45.470 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:33:45.470 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-01T16:33:45.497 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:45.497+0000 7f30af838040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T16:33:45.572 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:45.573+0000 7fa74f23c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T16:33:45.581 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:33:45.581 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-01T16:33:45.645 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:45.645+0000 7f30af838040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T16:33:45.656 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:45.657+0000 7fa74f23c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T16:33:45.706 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-01T16:33:45.706 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-01T16:33:45.713 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:45.714+0000 7fa74f23c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T16:33:45.755 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:45.750+0000 7f30af838040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T16:33:45.775 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:45.776+0000 7fa74f23c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T16:33:45.808 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:45.808+0000 7f30af838040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T16:33:45.832 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:45.832+0000 7fa74f23c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T16:33:45.836 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 8fca53e4-23ef-42eb-9b59-43e6d0ec307e 0 2024-04-01T16:33:45.871 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:45.871+0000 7f30af838040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T16:33:45.929 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:45.928+0000 7f30af838040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T16:33:46.060 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.060+0000 7f2cef200640 1 Processor -- start 2024-04-01T16:33:46.060 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.060+0000 7f2cef200640 1 -- start start 2024-04-01T16:33:46.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.061+0000 7f2cef200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2ce81548b0 0x7f2ce80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:46.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.061+0000 7f2cef200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce815e800 con 0x7f2ce80c5790 2024-04-01T16:33:46.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.061+0000 7f2cef200640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce80ca800 con 0x7f2ce80cbeb0 2024-04-01T16:33:46.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.061+0000 7f2cef200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f2ce806d980 con 0x7f2ce81548b0 2024-04-01T16:33:46.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.062+0000 7f2ced400640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f2ce80cbeb0 0x7f2ce80c5080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:48582/0 (socket says 172.21.15.189:48582) 2024-04-01T16:33:46.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.062+0000 7f2ced400640 1 -- 172.21.15.189:0/1609966094 learned_addr learned my addr 172.21.15.189:0/1609966094 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-04-01T16:33:46.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.063+0000 7f2cede00640 1 --2- 172.21.15.189:0/1609966094 >> v2:172.21.15.163:3300/0 conn(0x7f2ce81548b0 0x7f2ce80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:46.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.065+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728130905 0 0) 0x7f2ce80ca800 con 0x7f2ce80cbeb0 2024-04-01T16:33:46.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.065+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cd0003520 con 0x7f2ce80cbeb0 2024-04-01T16:33:46.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2039252468 0 0) 0x7f2cd0003520 con 0x7f2ce80cbeb0 2024-04-01T16:33:46.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 >> v2:172.21.15.163:3300/0 conn(0x7f2ce81548b0 msgr2=0x7f2ce80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:46.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 --2- 172.21.15.189:0/1609966094 >> v2:172.21.15.163:3300/0 conn(0x7f2ce81548b0 0x7f2ce80cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 >> v1:172.21.15.163:6789/0 conn(0x7f2ce80c5790 legacy=0x7f2ce8164fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:46.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce815eaa0 con 0x7f2ce80cbeb0 2024-04-01T16:33:46.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7f2cd8001670 con 0x7f2ce80cbeb0 2024-04-01T16:33:46.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 >> v1:172.21.15.189:6789/0 conn(0x7f2ce80cbeb0 legacy=0x7f2ce80c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:46.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 --2- 172.21.15.189:0/1609966094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cd0003a00 0x7f2cd0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:46.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 --2- 172.21.15.189:0/1609966094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd0004800 0x7f2cd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:46.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 --2- 172.21.15.189:0/1609966094 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cd00051c0 0x7f2cd000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:46.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce806d980 con 0x7f2cd0004800 2024-04-01T16:33:46.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd000c0a0 con 0x7f2cd0003a00 2024-04-01T16:33:46.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.072+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd000c2a0 con 0x7f2cd00051c0 2024-04-01T16:33:46.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.074+0000 7f2cee800640 1 --2- 172.21.15.189:0/1609966094 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cd00051c0 0x7f2cd000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:46.076 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.076+0000 7f2cede00640 1 --2- 172.21.15.189:0/1609966094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cd0003a00 0x7f2cd0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:46.092 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.092+0000 7f2ced400640 1 --2- 172.21.15.189:0/1609966094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd0004800 0x7f2cd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:46.093 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.093+0000 7f2cee800640 1 -- 172.21.15.189:0/1609966094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cd0003a00 msgr2=0x7f2cd0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:46.093 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.093+0000 7f2cee800640 1 --2- 172.21.15.189:0/1609966094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cd0003a00 0x7f2cd0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.093 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.093+0000 7f2cee800640 1 -- 172.21.15.189:0/1609966094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd0004800 msgr2=0x7f2cd0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:46.094 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.093+0000 7f2cee800640 1 --2- 172.21.15.189:0/1609966094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd0004800 0x7f2cd0004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.094 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.093+0000 7f2cee800640 1 -- 172.21.15.189:0/1609966094 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd0003520 con 0x7f2cd00051c0 2024-04-01T16:33:46.094 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.094+0000 7f2cee800640 1 -- 172.21.15.189:0/1609966094 reap_dead start 2024-04-01T16:33:46.097 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.097+0000 7f2cee800640 1 --2- 172.21.15.189:0/1609966094 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cd00051c0 0x7f2cd000b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4001e20 tx=0x7f2cd0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df94915aa7570b22 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:46.106 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.106+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4001a70 con 0x7f2cd00051c0 2024-04-01T16:33:46.106 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.106+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce4003b70 con 0x7f2cd00051c0 2024-04-01T16:33:46.106 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.106+0000 7f2ceca00640 1 -- 172.21.15.189:0/1609966094 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40050d0 con 0x7f2cd00051c0 2024-04-01T16:33:46.107 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.107+0000 7f2cef200640 1 -- 172.21.15.189:0/1609966094 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cd00051c0 msgr2=0x7f2cd000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:46.107 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.107+0000 7f2cef200640 1 --2- 172.21.15.189:0/1609966094 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cd00051c0 0x7f2cd000b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4001e20 tx=0x7f2cd0005830 comp rx=0 tx=0).stop 2024-04-01T16:33:46.107 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.107+0000 7f2cef200640 1 -- 172.21.15.189:0/1609966094 shutdown_connections 2024-04-01T16:33:46.107 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.107+0000 7f2cef200640 1 --2- 172.21.15.189:0/1609966094 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cd00051c0 0x7f2cd000b9c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.107 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.107+0000 7f2cef200640 1 -- 172.21.15.189:0/1609966094 >> 172.21.15.189:0/1609966094 conn(0x7f2ce8067280 msgr2=0x7f2ce8067690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:46.107 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.107+0000 7f2cef200640 1 -- 172.21.15.189:0/1609966094 shutdown_connections 2024-04-01T16:33:46.107 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.107+0000 7f2cef200640 1 -- 172.21.15.189:0/1609966094 wait complete. 2024-04-01T16:33:46.109 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.109+0000 7f2cef200640 1 Processor -- start 2024-04-01T16:33:46.109 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.109+0000 7f2cef200640 1 -- start start 2024-04-01T16:33:46.110 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.110+0000 7f2cef200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd00051c0 0x7f2ce815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:46.110 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.110+0000 7f2cef200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce8158fa0 0x7f2ce8153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:46.110 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.110+0000 7f2cef200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ce815b9f0 0x7f2ce815be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:46.111 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.110+0000 7f2cef200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce80cb760 con 0x7f2cd00051c0 2024-04-01T16:33:46.111 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.110+0000 7f2cef200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce80cada0 con 0x7f2ce8158fa0 2024-04-01T16:33:46.111 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.110+0000 7f2cef200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce80cb8e0 con 0x7f2ce815b9f0 2024-04-01T16:33:46.111 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.111+0000 7f2ced400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce8158fa0 0x7f2ce8153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:46.112 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.112+0000 7f2ced400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce8158fa0 0x7f2ce8153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:39884/0 (socket says 172.21.15.189:39884) 2024-04-01T16:33:46.112 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.112+0000 7f2ced400640 1 -- 172.21.15.189:0/4012123530 learned_addr learned my addr 172.21.15.189:0/4012123530 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:46.112 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.112+0000 7f2cede00640 1 --2- 172.21.15.189:0/4012123530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd00051c0 0x7f2ce815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:46.117 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.118+0000 7f2cee800640 1 --2- 172.21.15.189:0/4012123530 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ce815b9f0 0x7f2ce815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:46.119 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.119+0000 7f2ced400640 1 -- 172.21.15.189:0/4012123530 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ce815b9f0 msgr2=0x7f2ce815be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:46.119 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.119+0000 7f2ced400640 1 --2- 172.21.15.189:0/4012123530 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ce815b9f0 0x7f2ce815be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.119 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.119+0000 7f2ced400640 1 -- 172.21.15.189:0/4012123530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd00051c0 msgr2=0x7f2ce815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:46.119 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.119+0000 7f2ced400640 1 --2- 172.21.15.189:0/4012123530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd00051c0 0x7f2ce815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.119 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.119+0000 7f2ced400640 1 -- 172.21.15.189:0/4012123530 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce815c3b0 con 0x7f2ce8158fa0 2024-04-01T16:33:46.122 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.123+0000 7f2ced400640 1 --2- 172.21.15.189:0/4012123530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce8158fa0 0x7f2ce8153390 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800d7d0 tx=0x7f2cd800dbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:46.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.128+0000 7f2ce2000640 1 -- 172.21.15.189:0/4012123530 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8019070 con 0x7f2ce8158fa0 2024-04-01T16:33:46.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.128+0000 7f2ce2000640 1 -- 172.21.15.189:0/4012123530 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd80072d0 con 0x7f2ce8158fa0 2024-04-01T16:33:46.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.128+0000 7f2ce2000640 1 -- 172.21.15.189:0/4012123530 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd80047e0 con 0x7f2ce8158fa0 2024-04-01T16:33:46.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.128+0000 7f2cef200640 1 -- 172.21.15.189:0/4012123530 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce815d4f0 con 0x7f2ce8158fa0 2024-04-01T16:33:46.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.129+0000 7f2cef200640 1 -- 172.21.15.189:0/4012123530 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce815ab90 con 0x7f2ce8158fa0 2024-04-01T16:33:46.130 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.130+0000 7f2cef200640 1 -- 172.21.15.189:0/4012123530 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce80ca800 con 0x7f2ce8158fa0 2024-04-01T16:33:46.134 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.134+0000 7f2ce2000640 1 -- 172.21.15.189:0/4012123530 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2cd801c070 con 0x7f2ce8158fa0 2024-04-01T16:33:46.134 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.134+0000 7f2ce2000640 1 -- 172.21.15.189:0/4012123530 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2cd800bdf0 con 0x7f2ce8158fa0 2024-04-01T16:33:46.252 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.252+0000 7f2ce2000640 1 -- 172.21.15.189:0/4012123530 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f2ce815c3b0 con 0x7f2ce8158fa0 2024-04-01T16:33:46.283 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:46.284+0000 7fa74f23c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T16:33:46.338 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.338+0000 7f2cef200640 1 -- 172.21.15.189:0/4012123530 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8fca53e4-23ef-42eb-9b59-43e6d0ec307e", "id": 0} v 0) -- 0x7f2ce80c5ee0 con 0x7f2ce8158fa0 2024-04-01T16:33:46.407 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:46.407+0000 7f30af838040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T16:33:46.447 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:46.447+0000 7fa74f23c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T16:33:46.569 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:46.569+0000 7f30af838040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T16:33:46.593 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:46.594+0000 7fa74f23c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T16:33:46.650 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:46.651+0000 7fa74f23c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T16:33:46.704 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.704+0000 7f2ce2000640 1 -- 172.21.15.189:0/4012123530 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8fca53e4-23ef-42eb-9b59-43e6d0ec307e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f2cd800b650 con 0x7f2ce8158fa0 2024-04-01T16:33:46.705 INFO:teuthology.orchestra.run.smithi189.stdout:0 2024-04-01T16:33:46.707 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.706+0000 7f2cef200640 1 -- 172.21.15.189:0/4012123530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce8158fa0 msgr2=0x7f2ce8153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:46.707 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.706+0000 7f2cef200640 1 --2- 172.21.15.189:0/4012123530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce8158fa0 0x7f2ce8153390 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800d7d0 tx=0x7f2cd800dbd0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.707 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.706+0000 7f2cef200640 1 -- 172.21.15.189:0/4012123530 shutdown_connections 2024-04-01T16:33:46.707 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.706+0000 7f2cef200640 1 --2- 172.21.15.189:0/4012123530 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2ce815b9f0 0x7f2ce815be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.707 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.706+0000 7f2cef200640 1 --2- 172.21.15.189:0/4012123530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ce8158fa0 0x7f2ce8153390 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.707 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.706+0000 7f2cef200640 1 --2- 172.21.15.189:0/4012123530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd00051c0 0x7f2ce815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.707 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.706+0000 7f2cef200640 1 -- 172.21.15.189:0/4012123530 >> 172.21.15.189:0/4012123530 conn(0x7f2ce8067280 msgr2=0x7f2ce80cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:46.707 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.706+0000 7f2cef200640 1 -- 172.21.15.189:0/4012123530 shutdown_connections 2024-04-01T16:33:46.707 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.706+0000 7f2cef200640 1 -- 172.21.15.189:0/4012123530 wait complete. 2024-04-01T16:33:46.717 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:46.717+0000 7f30af838040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T16:33:46.724 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 60336f20-a3e0-44c9-a468-83dbaedb2d68 1 2024-04-01T16:33:46.781 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:46.781+0000 7fa74f23c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T16:33:46.787 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:46.787+0000 7f30af838040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T16:33:46.895 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:46.895+0000 7fa74f23c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T16:33:46.909 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.909+0000 7f0f3fe00640 1 Processor -- start 2024-04-01T16:33:46.909 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.909+0000 7f0f3fe00640 1 -- start start 2024-04-01T16:33:46.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.911+0000 7f0f3fe00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0f400c5e00 0x7f0f40158e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:46.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.911+0000 7f0f3fe00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f0f40072820 0x7f0f40072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:46.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.911+0000 7f0f3fe00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f400731f0 con 0x7f0f400c61e0 2024-04-01T16:33:46.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.911+0000 7f0f3fe00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f0f400738e0 con 0x7f0f400c5e00 2024-04-01T16:33:46.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.911+0000 7f0f3fe00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f0f400678e0 con 0x7f0f40072820 2024-04-01T16:33:46.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.912+0000 7f0f3f400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f0f40072820 0x7f0f40072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:46.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.912+0000 7f0f3f400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f0f40072820 0x7f0f40072cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:39888/0 (socket says 172.21.15.189:39888) 2024-04-01T16:33:46.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.912+0000 7f0f3f400640 1 -- 172.21.15.189:0/2970973615 learned_addr learned my addr 172.21.15.189:0/2970973615 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:46.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.913+0000 7f0f3ea00640 1 --2- 172.21.15.189:0/2970973615 >> v2:172.21.15.163:3300/0 conn(0x7f0f400c5e00 0x7f0f40158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:46.915 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.915+0000 7f0f3f400640 1 -- 172.21.15.189:0/2970973615 >> v2:172.21.15.163:3300/0 conn(0x7f0f400c5e00 msgr2=0x7f0f40158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:46.915 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.915+0000 7f0f3f400640 1 --2- 172.21.15.189:0/2970973615 >> v2:172.21.15.163:3300/0 conn(0x7f0f400c5e00 0x7f0f40158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.915+0000 7f0f3f400640 1 -- 172.21.15.189:0/2970973615 >> v1:172.21.15.189:6789/0 conn(0x7f0f400c61e0 legacy=0x7f0f4006b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:46.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.915+0000 7f0f3f400640 1 -- 172.21.15.189:0/2970973615 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f40067320 con 0x7f0f40072820 2024-04-01T16:33:46.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.917+0000 7f0f3f400640 1 --2- 172.21.15.189:0/2970973615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f40072820 0x7f0f40072cb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0f400c88d0 tx=0x7f0f3802be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c085fe4137da17c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:46.923 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.923+0000 7f0f3e000640 1 -- 172.21.15.189:0/2970973615 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3802c9f0 con 0x7f0f40072820 2024-04-01T16:33:46.923 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.923+0000 7f0f3e000640 1 -- 172.21.15.189:0/2970973615 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3802cb90 con 0x7f0f40072820 2024-04-01T16:33:46.923 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.923+0000 7f0f3e000640 1 -- 172.21.15.189:0/2970973615 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380343f0 con 0x7f0f40072820 2024-04-01T16:33:46.924 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.924+0000 7f0f3fe00640 1 -- 172.21.15.189:0/2970973615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f40072820 msgr2=0x7f0f40072cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:46.924 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.924+0000 7f0f3fe00640 1 --2- 172.21.15.189:0/2970973615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f40072820 0x7f0f40072cb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0f400c88d0 tx=0x7f0f3802be50 comp rx=0 tx=0).stop 2024-04-01T16:33:46.924 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.924+0000 7f0f3fe00640 1 -- 172.21.15.189:0/2970973615 shutdown_connections 2024-04-01T16:33:46.924 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.924+0000 7f0f3fe00640 1 --2- 172.21.15.189:0/2970973615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f40072820 0x7f0f40072cb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.924 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.924+0000 7f0f3fe00640 1 --2- 172.21.15.189:0/2970973615 >> v2:172.21.15.163:3300/0 conn(0x7f0f400c5e00 0x7f0f40158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.925 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.924+0000 7f0f3fe00640 1 -- 172.21.15.189:0/2970973615 >> 172.21.15.189:0/2970973615 conn(0x7f0f400cc480 msgr2=0x7f0f400cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:46.925 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.924+0000 7f0f3fe00640 1 -- 172.21.15.189:0/2970973615 shutdown_connections 2024-04-01T16:33:46.925 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.924+0000 7f0f3fe00640 1 -- 172.21.15.189:0/2970973615 wait complete. 2024-04-01T16:33:46.927 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.927+0000 7f0f3fe00640 1 Processor -- start 2024-04-01T16:33:46.927 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.927+0000 7f0f3fe00640 1 -- start start 2024-04-01T16:33:46.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.928+0000 7f0f3fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f40072820 0x7f0f40152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:46.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.928+0000 7f0f3fe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0f400c5e00 0x7f0f401547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:46.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.928+0000 7f0f3fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f400c61e0 0x7f0f401552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:46.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.928+0000 7f0f3fe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4006cbf0 con 0x7f0f40072820 2024-04-01T16:33:46.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.928+0000 7f0f3fe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4006c910 con 0x7f0f400c61e0 2024-04-01T16:33:46.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.928+0000 7f0f3fe00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0f401520b0 con 0x7f0f400c5e00 2024-04-01T16:33:46.930 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.929+0000 7f0f3f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f400c61e0 0x7f0f401552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:46.930 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.929+0000 7f0f37e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0f400c5e00 0x7f0f401547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:46.930 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.929+0000 7f0f3f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f400c61e0 0x7f0f401552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:39896/0 (socket says 172.21.15.189:39896) 2024-04-01T16:33:46.930 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.929+0000 7f0f3f400640 1 -- 172.21.15.189:0/477731705 learned_addr learned my addr 172.21.15.189:0/477731705 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:46.931 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.930+0000 7f0f3ea00640 1 --2- 172.21.15.189:0/477731705 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f40072820 0x7f0f40152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:46.931 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:46.930+0000 7f30af838040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T16:33:46.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.933+0000 7f0f3f400640 1 -- 172.21.15.189:0/477731705 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0f400c5e00 msgr2=0x7f0f401547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:46.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.933+0000 7f0f3f400640 1 --2- 172.21.15.189:0/477731705 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0f400c5e00 0x7f0f401547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.933+0000 7f0f3f400640 1 -- 172.21.15.189:0/477731705 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f40072820 msgr2=0x7f0f40152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:46.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.933+0000 7f0f3f400640 1 --2- 172.21.15.189:0/477731705 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f40072820 0x7f0f40152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:46.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.933+0000 7f0f3f400640 1 -- 172.21.15.189:0/477731705 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f40153e20 con 0x7f0f400c61e0 2024-04-01T16:33:46.936 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.936+0000 7f0f3f400640 1 --2- 172.21.15.189:0/477731705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f400c61e0 0x7f0f401552f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009f40 tx=0x7f0f38004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:46.941 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.940+0000 7f0f36a00640 1 -- 172.21.15.189:0/477731705 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38043020 con 0x7f0f400c61e0 2024-04-01T16:33:46.941 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.941+0000 7f0f36a00640 1 -- 172.21.15.189:0/477731705 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3803e450 con 0x7f0f400c61e0 2024-04-01T16:33:46.941 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.941+0000 7f0f3fe00640 1 -- 172.21.15.189:0/477731705 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f40150ec0 con 0x7f0f400c61e0 2024-04-01T16:33:46.941 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.941+0000 7f0f36a00640 1 -- 172.21.15.189:0/477731705 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38009510 con 0x7f0f400c61e0 2024-04-01T16:33:46.941 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.941+0000 7f0f3fe00640 1 -- 172.21.15.189:0/477731705 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f40151740 con 0x7f0f400c61e0 2024-04-01T16:33:46.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.942+0000 7f0f3fe00640 1 -- 172.21.15.189:0/477731705 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f400733c0 con 0x7f0f400c61e0 2024-04-01T16:33:46.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.945+0000 7f0f36a00640 1 -- 172.21.15.189:0/477731705 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0f38046020 con 0x7f0f400c61e0 2024-04-01T16:33:46.945 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:46.945+0000 7f0f36a00640 1 -- 172.21.15.189:0/477731705 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f0f380517e0 con 0x7f0f400c61e0 2024-04-01T16:33:47.046 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:47.046+0000 7f30af838040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T16:33:47.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.061+0000 7f0f36a00640 1 -- 172.21.15.189:0/477731705 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0f3804d030 con 0x7f0f400c61e0 2024-04-01T16:33:47.072 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:47.072+0000 7fa74f23c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T16:33:47.120 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:47.121+0000 7fa74f23c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T16:33:47.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.155+0000 7f0f3fe00640 1 -- 172.21.15.189:0/477731705 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "60336f20-a3e0-44c9-a468-83dbaedb2d68", "id": 1} v 0) -- 0x7f0f400c70a0 con 0x7f0f400c61e0 2024-04-01T16:33:47.252 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:47.252+0000 7f30af838040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T16:33:47.300 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:47.300+0000 7fa74f23c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T16:33:47.308 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:47.308+0000 7f30af838040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T16:33:47.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.445+0000 7f0f36a00640 1 -- 172.21.15.189:0/477731705 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60336f20-a3e0-44c9-a468-83dbaedb2d68", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f0f3803ee10 con 0x7f0f400c61e0 2024-04-01T16:33:47.446 INFO:teuthology.orchestra.run.smithi189.stdout:1 2024-04-01T16:33:47.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.447+0000 7f0f3fe00640 1 -- 172.21.15.189:0/477731705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f400c61e0 msgr2=0x7f0f401552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:47.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.447+0000 7f0f3fe00640 1 --2- 172.21.15.189:0/477731705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f400c61e0 0x7f0f401552f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009f40 tx=0x7f0f38004a40 comp rx=0 tx=0).stop 2024-04-01T16:33:47.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.447+0000 7f0f3fe00640 1 -- 172.21.15.189:0/477731705 shutdown_connections 2024-04-01T16:33:47.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.447+0000 7f0f3fe00640 1 --2- 172.21.15.189:0/477731705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f400c61e0 0x7f0f401552f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:47.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.447+0000 7f0f3fe00640 1 --2- 172.21.15.189:0/477731705 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0f400c5e00 0x7f0f401547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:47.448 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.447+0000 7f0f3fe00640 1 --2- 172.21.15.189:0/477731705 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f40072820 0x7f0f40152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:47.448 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.447+0000 7f0f3fe00640 1 -- 172.21.15.189:0/477731705 >> 172.21.15.189:0/477731705 conn(0x7f0f400cc480 msgr2=0x7f0f40148010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:47.448 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.448+0000 7f0f3fe00640 1 -- 172.21.15.189:0/477731705 shutdown_connections 2024-04-01T16:33:47.448 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.448+0000 7f0f3fe00640 1 -- 172.21.15.189:0/477731705 wait complete. 2024-04-01T16:33:47.464 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 86fa2618-f73f-4dda-b349-5abd65228c6c 2 2024-04-01T16:33:47.504 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:47.503+0000 7f30af838040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T16:33:47.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.650+0000 7f2d44a00640 1 Processor -- start 2024-04-01T16:33:47.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.650+0000 7f2d44a00640 1 -- start start 2024-04-01T16:33:47.652 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.652+0000 7f2d44a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2d401548b0 0x7f2d400cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:47.652 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.652+0000 7f2d44a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2d400cbeb0 0x7f2d400ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:47.652 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.652+0000 7f2d44a00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d4015e800 con 0x7f2d400c5080 2024-04-01T16:33:47.652 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.652+0000 7f2d44a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f2d4006d980 con 0x7f2d400cbeb0 2024-04-01T16:33:47.652 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.652+0000 7f2d44a00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f2d400ca800 con 0x7f2d401548b0 2024-04-01T16:33:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.653+0000 7f2d3e800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2d401548b0 0x7f2d400cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.653+0000 7f2d3e800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2d401548b0 0x7f2d400cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:39898/0 (socket says 172.21.15.189:39898) 2024-04-01T16:33:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.653+0000 7f2d3e800640 1 -- 172.21.15.189:0/1142404998 learned_addr learned my addr 172.21.15.189:0/1142404998 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:47.654 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.654+0000 7f2d37e00640 1 --2- 172.21.15.189:0/1142404998 >> v2:172.21.15.163:3300/0 conn(0x7f2d400cbeb0 0x7f2d400ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:47.656 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.656+0000 7f2d3e800640 1 -- 172.21.15.189:0/1142404998 >> v2:172.21.15.163:3300/0 conn(0x7f2d400cbeb0 msgr2=0x7f2d400ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:47.656 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.656+0000 7f2d3e800640 1 --2- 172.21.15.189:0/1142404998 >> v2:172.21.15.163:3300/0 conn(0x7f2d400cbeb0 0x7f2d400ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:47.656 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.656+0000 7f2d3e800640 1 -- 172.21.15.189:0/1142404998 >> v1:172.21.15.189:6789/0 conn(0x7f2d400c5080 legacy=0x7f2d4015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:47.656 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.656+0000 7f2d3e800640 1 -- 172.21.15.189:0/1142404998 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d4015eaa0 con 0x7f2d401548b0 2024-04-01T16:33:47.658 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.658+0000 7f2d3e800640 1 --2- 172.21.15.189:0/1142404998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d401548b0 0x7f2d400cc890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2d4008d1a0 tx=0x7f2d3002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e75134d2eb84fd67 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:47.664 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.664+0000 7f2d3de00640 1 -- 172.21.15.189:0/1142404998 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30034070 con 0x7f2d401548b0 2024-04-01T16:33:47.664 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.664+0000 7f2d3de00640 1 -- 172.21.15.189:0/1142404998 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d30030860 con 0x7f2d401548b0 2024-04-01T16:33:47.664 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.664+0000 7f2d3de00640 1 -- 172.21.15.189:0/1142404998 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30030c30 con 0x7f2d401548b0 2024-04-01T16:33:47.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.665+0000 7f2d44a00640 1 -- 172.21.15.189:0/1142404998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d401548b0 msgr2=0x7f2d400cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:47.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.665+0000 7f2d44a00640 1 --2- 172.21.15.189:0/1142404998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d401548b0 0x7f2d400cc890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2d4008d1a0 tx=0x7f2d3002b9a0 comp rx=0 tx=0).stop 2024-04-01T16:33:47.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.665+0000 7f2d44a00640 1 -- 172.21.15.189:0/1142404998 shutdown_connections 2024-04-01T16:33:47.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.665+0000 7f2d44a00640 1 --2- 172.21.15.189:0/1142404998 >> v2:172.21.15.163:3300/0 conn(0x7f2d400cbeb0 0x7f2d400ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:47.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.665+0000 7f2d44a00640 1 --2- 172.21.15.189:0/1142404998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d401548b0 0x7f2d400cc890 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:47.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.665+0000 7f2d44a00640 1 -- 172.21.15.189:0/1142404998 >> 172.21.15.189:0/1142404998 conn(0x7f2d40067280 msgr2=0x7f2d40067690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:47.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.665+0000 7f2d44a00640 1 -- 172.21.15.189:0/1142404998 shutdown_connections 2024-04-01T16:33:47.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.665+0000 7f2d44a00640 1 -- 172.21.15.189:0/1142404998 wait complete. 2024-04-01T16:33:47.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.667+0000 7f2d44a00640 1 Processor -- start 2024-04-01T16:33:47.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.667+0000 7f2d44a00640 1 -- start start 2024-04-01T16:33:47.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.668+0000 7f2d44a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d400c5080 0x7f2d401f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:47.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.668+0000 7f2d44a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d400cbeb0 0x7f2d40148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:47.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.668+0000 7f2d44a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d401548b0 0x7f2d40152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:47.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.668+0000 7f2d44a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2d400cb760 con 0x7f2d400c5080 2024-04-01T16:33:47.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.668+0000 7f2d44a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2d400cada0 con 0x7f2d400cbeb0 2024-04-01T16:33:47.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.668+0000 7f2d44a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2d400cb8e0 con 0x7f2d401548b0 2024-04-01T16:33:47.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.669+0000 7f2d37e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d400cbeb0 0x7f2d40148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:47.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.669+0000 7f2d3f200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d401548b0 0x7f2d40152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:47.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.669+0000 7f2d37e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d400cbeb0 0x7f2d40148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:39902/0 (socket says 172.21.15.189:39902) 2024-04-01T16:33:47.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.669+0000 7f2d37e00640 1 -- 172.21.15.189:0/2222544795 learned_addr learned my addr 172.21.15.189:0/2222544795 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:47.670 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.670+0000 7f2d3e800640 1 --2- 172.21.15.189:0/2222544795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d400c5080 0x7f2d401f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:47.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.674+0000 7f2d37e00640 1 -- 172.21.15.189:0/2222544795 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d401548b0 msgr2=0x7f2d40152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:47.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.674+0000 7f2d37e00640 1 --2- 172.21.15.189:0/2222544795 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d401548b0 0x7f2d40152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:47.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.675+0000 7f2d37e00640 1 -- 172.21.15.189:0/2222544795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d400c5080 msgr2=0x7f2d401f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:47.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.675+0000 7f2d37e00640 1 --2- 172.21.15.189:0/2222544795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d400c5080 0x7f2d401f4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:47.675 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.675+0000 7f2d37e00640 1 -- 172.21.15.189:0/2222544795 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d401f4ad0 con 0x7f2d400cbeb0 2024-04-01T16:33:47.678 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.678+0000 7f2d37e00640 1 --2- 172.21.15.189:0/2222544795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d400cbeb0 0x7f2d40148dd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800d830 tx=0x7f2d2800dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:47.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.682+0000 7f2d36a00640 1 -- 172.21.15.189:0/2222544795 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800b6c0 con 0x7f2d400cbeb0 2024-04-01T16:33:47.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.682+0000 7f2d36a00640 1 -- 172.21.15.189:0/2222544795 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d28019070 con 0x7f2d400cbeb0 2024-04-01T16:33:47.682 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.682+0000 7f2d36a00640 1 -- 172.21.15.189:0/2222544795 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800ba80 con 0x7f2d400cbeb0 2024-04-01T16:33:47.683 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.682+0000 7f2d44a00640 1 -- 172.21.15.189:0/2222544795 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d401f09a0 con 0x7f2d400cbeb0 2024-04-01T16:33:47.683 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.682+0000 7f2d44a00640 1 -- 172.21.15.189:0/2222544795 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d401f0f60 con 0x7f2d400cbeb0 2024-04-01T16:33:47.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.684+0000 7f2d44a00640 1 -- 172.21.15.189:0/2222544795 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d40151e30 con 0x7f2d400cbeb0 2024-04-01T16:33:47.687 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.687+0000 7f2d36a00640 1 -- 172.21.15.189:0/2222544795 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2d2801e460 con 0x7f2d400cbeb0 2024-04-01T16:33:47.687 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.687+0000 7f2d36a00640 1 -- 172.21.15.189:0/2222544795 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f2d28028ac0 con 0x7f2d400cbeb0 2024-04-01T16:33:47.806 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.806+0000 7f2d36a00640 1 -- 172.21.15.189:0/2222544795 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f2d28028cc0 con 0x7f2d400cbeb0 2024-04-01T16:33:47.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:47.916+0000 7f2d44a00640 1 -- 172.21.15.189:0/2222544795 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "86fa2618-f73f-4dda-b349-5abd65228c6c", "id": 2} v 0) -- 0x7f2d4014a1b0 con 0x7f2d400cbeb0 2024-04-01T16:33:48.124 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.124+0000 7f2d36a00640 1 -- 172.21.15.189:0/2222544795 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86fa2618-f73f-4dda-b349-5abd65228c6c", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f2d28028660 con 0x7f2d400cbeb0 2024-04-01T16:33:48.125 INFO:teuthology.orchestra.run.smithi189.stdout:2 2024-04-01T16:33:48.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.126+0000 7f2d44a00640 1 -- 172.21.15.189:0/2222544795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d400cbeb0 msgr2=0x7f2d40148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:48.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.126+0000 7f2d44a00640 1 --2- 172.21.15.189:0/2222544795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d400cbeb0 0x7f2d40148dd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800d830 tx=0x7f2d2800dcf0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.126+0000 7f2d44a00640 1 -- 172.21.15.189:0/2222544795 shutdown_connections 2024-04-01T16:33:48.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.126+0000 7f2d44a00640 1 --2- 172.21.15.189:0/2222544795 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2d401548b0 0x7f2d40152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.126+0000 7f2d44a00640 1 --2- 172.21.15.189:0/2222544795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d400cbeb0 0x7f2d40148dd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.126+0000 7f2d44a00640 1 --2- 172.21.15.189:0/2222544795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d400c5080 0x7f2d401f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.126+0000 7f2d44a00640 1 -- 172.21.15.189:0/2222544795 >> 172.21.15.189:0/2222544795 conn(0x7f2d40067280 msgr2=0x7f2d400cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:48.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.126+0000 7f2d44a00640 1 -- 172.21.15.189:0/2222544795 shutdown_connections 2024-04-01T16:33:48.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.126+0000 7f2d44a00640 1 -- 172.21.15.189:0/2222544795 wait complete. 2024-04-01T16:33:48.144 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd 3 2024-04-01T16:33:48.375 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:48.376+0000 7fa74f23c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T16:33:48.387 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.387+0000 7f5dbc200640 1 Processor -- start 2024-04-01T16:33:48.387 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.387+0000 7f5dbc200640 1 -- start start 2024-04-01T16:33:48.389 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.388+0000 7f5dbc200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5db4152830 0x7f5db4072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:48.389 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.389+0000 7f5dbc200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5db40c6b30 0x7f5db4072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:48.389 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.389+0000 7f5dbc200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5db4071ee0 0x7f5db415ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:48.389 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.389+0000 7f5dbc200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f5db4152c10 con 0x7f5db4152830 2024-04-01T16:33:48.389 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.389+0000 7f5dbc200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5db40737f0 con 0x7f5db4071ee0 2024-04-01T16:33:48.389 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.389+0000 7f5dbc200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5db40c72d0 con 0x7f5db40c6b30 2024-04-01T16:33:48.390 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.389+0000 7f5dba200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5db4071ee0 0x7f5db415ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:48.390 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.390+0000 7f5db8e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5db40c6b30 0x7f5db4072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:48.390 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.390+0000 7f5db8e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5db40c6b30 0x7f5db4072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:46000/0 (socket says 172.21.15.189:46000) 2024-04-01T16:33:48.390 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.390+0000 7f5dba200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5db4071ee0 0x7f5db415ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:39908/0 (socket says 172.21.15.189:39908) 2024-04-01T16:33:48.390 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.390+0000 7f5db8e00640 1 -- 172.21.15.189:0/3099430052 learned_addr learned my addr 172.21.15.189:0/3099430052 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:48.391 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.391+0000 7f5db9800640 1 --2- 172.21.15.189:0/3099430052 >> v2:172.21.15.163:3300/0 conn(0x7f5db4152830 0x7f5db4072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:48.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.393+0000 7f5dba200640 1 -- 172.21.15.189:0/3099430052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5db40c6b30 msgr2=0x7f5db4072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:48.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.393+0000 7f5dba200640 1 --2- 172.21.15.189:0/3099430052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5db40c6b30 0x7f5db4072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.393+0000 7f5dba200640 1 -- 172.21.15.189:0/3099430052 >> v2:172.21.15.163:3300/0 conn(0x7f5db4152830 msgr2=0x7f5db4072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:48.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.393+0000 7f5dba200640 1 --2- 172.21.15.189:0/3099430052 >> v2:172.21.15.163:3300/0 conn(0x7f5db4152830 0x7f5db4072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.394+0000 7f5dba200640 1 -- 172.21.15.189:0/3099430052 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db40c75b0 con 0x7f5db4071ee0 2024-04-01T16:33:48.396 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.396+0000 7f5dba200640 1 --2- 172.21.15.189:0/3099430052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4071ee0 0x7f5db415ba50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5db406d650 tx=0x7f5dac02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=204347fcc149a8e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:48.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.401+0000 7f5db3e00640 1 -- 172.21.15.189:0/3099430052 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac039070 con 0x7f5db4071ee0 2024-04-01T16:33:48.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.401+0000 7f5db3e00640 1 -- 172.21.15.189:0/3099430052 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dac02cbd0 con 0x7f5db4071ee0 2024-04-01T16:33:48.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.401+0000 7f5db3e00640 1 -- 172.21.15.189:0/3099430052 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac034440 con 0x7f5db4071ee0 2024-04-01T16:33:48.402 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.401+0000 7f5dbc200640 1 -- 172.21.15.189:0/3099430052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4071ee0 msgr2=0x7f5db415ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:48.402 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.401+0000 7f5dbc200640 1 --2- 172.21.15.189:0/3099430052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4071ee0 0x7f5db415ba50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5db406d650 tx=0x7f5dac02be20 comp rx=0 tx=0).stop 2024-04-01T16:33:48.402 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.402+0000 7f5dbc200640 1 -- 172.21.15.189:0/3099430052 shutdown_connections 2024-04-01T16:33:48.402 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.402+0000 7f5dbc200640 1 --2- 172.21.15.189:0/3099430052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4071ee0 0x7f5db415ba50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.402 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.402+0000 7f5dbc200640 1 --2- 172.21.15.189:0/3099430052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5db40c6b30 0x7f5db4072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.402 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.402+0000 7f5dbc200640 1 --2- 172.21.15.189:0/3099430052 >> v2:172.21.15.163:3300/0 conn(0x7f5db4152830 0x7f5db4072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.402 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.402+0000 7f5dbc200640 1 -- 172.21.15.189:0/3099430052 >> 172.21.15.189:0/3099430052 conn(0x7f5db40cbe20 msgr2=0x7f5db40cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:48.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.402+0000 7f5dbc200640 1 -- 172.21.15.189:0/3099430052 shutdown_connections 2024-04-01T16:33:48.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.402+0000 7f5dbc200640 1 -- 172.21.15.189:0/3099430052 wait complete. 2024-04-01T16:33:48.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.404+0000 7f5dbc200640 1 Processor -- start 2024-04-01T16:33:48.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.404+0000 7f5dbc200640 1 -- start start 2024-04-01T16:33:48.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.405+0000 7f5dbc200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4071ee0 0x7f5db414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:48.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.405+0000 7f5dbc200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5db40c6b30 0x7f5db4153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:48.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.405+0000 7f5dbc200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5db4152830 0x7f5db4154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:48.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.405+0000 7f5dbc200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5db4073a90 con 0x7f5db4152830 2024-04-01T16:33:48.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.405+0000 7f5dbc200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5db40c7b70 con 0x7f5db4071ee0 2024-04-01T16:33:48.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.405+0000 7f5dbc200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5db40707f0 con 0x7f5db40c6b30 2024-04-01T16:33:48.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.406+0000 7f5db9800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4071ee0 0x7f5db414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:48.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.406+0000 7f5db8e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5db40c6b30 0x7f5db4153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:48.407 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.406+0000 7f5db9800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4071ee0 0x7f5db414fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:39912/0 (socket says 172.21.15.189:39912) 2024-04-01T16:33:48.407 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.406+0000 7f5db9800640 1 -- 172.21.15.189:0/1039283483 learned_addr learned my addr 172.21.15.189:0/1039283483 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:48.407 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.407+0000 7f5dba200640 1 --2- 172.21.15.189:0/1039283483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5db4152830 0x7f5db4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:48.411 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.411+0000 7f5db9800640 1 -- 172.21.15.189:0/1039283483 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5db40c6b30 msgr2=0x7f5db4153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:48.411 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.411+0000 7f5db9800640 1 --2- 172.21.15.189:0/1039283483 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5db40c6b30 0x7f5db4153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.412 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.411+0000 7f5db9800640 1 -- 172.21.15.189:0/1039283483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5db4152830 msgr2=0x7f5db4154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:48.412 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.411+0000 7f5db9800640 1 --2- 172.21.15.189:0/1039283483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5db4152830 0x7f5db4154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.412 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.411+0000 7f5db9800640 1 -- 172.21.15.189:0/1039283483 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db40c4590 con 0x7f5db4071ee0 2024-04-01T16:33:48.415 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.415+0000 7f5db9800640 1 --2- 172.21.15.189:0/1039283483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4071ee0 0x7f5db414fad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5da800e870 tx=0x7f5da800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:48.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.419+0000 7f5db1600640 1 -- 172.21.15.189:0/1039283483 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da8017070 con 0x7f5db4071ee0 2024-04-01T16:33:48.420 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.419+0000 7f5db1600640 1 -- 172.21.15.189:0/1039283483 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5da800c940 con 0x7f5db4071ee0 2024-04-01T16:33:48.420 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.419+0000 7f5db1600640 1 -- 172.21.15.189:0/1039283483 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da800cd30 con 0x7f5db4071ee0 2024-04-01T16:33:48.420 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.419+0000 7f5dbc200640 1 -- 172.21.15.189:0/1039283483 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db414d780 con 0x7f5db4071ee0 2024-04-01T16:33:48.420 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.419+0000 7f5dbc200640 1 -- 172.21.15.189:0/1039283483 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db414dd40 con 0x7f5db4071ee0 2024-04-01T16:33:48.420 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.420+0000 7f5dbc200640 1 -- 172.21.15.189:0/1039283483 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db40756d0 con 0x7f5db4071ee0 2024-04-01T16:33:48.561 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.561+0000 7f5db1600640 1 -- 172.21.15.189:0/1039283483 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5da801a070 con 0x7f5db4071ee0 2024-04-01T16:33:48.561 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.561+0000 7f5db1600640 1 -- 172.21.15.189:0/1039283483 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f5da8013470 con 0x7f5db4071ee0 2024-04-01T16:33:48.561 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.561+0000 7f5db1600640 1 -- 172.21.15.189:0/1039283483 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5da8013700 con 0x7f5db4071ee0 2024-04-01T16:33:48.581 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:48.580+0000 7f30af838040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T16:33:48.649 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.649+0000 7f5dbc200640 1 -- 172.21.15.189:0/1039283483 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd", "id": 3} v 0) -- 0x7f5db40726e0 con 0x7f5db4071ee0 2024-04-01T16:33:48.721 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:48.722+0000 7fa74f23c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T16:33:48.787 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:48.787+0000 7fa74f23c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T16:33:48.827 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.827+0000 7f5db1600640 1 -- 172.21.15.189:0/1039283483 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5da80065b0 con 0x7f5db4071ee0 2024-04-01T16:33:48.828 INFO:teuthology.orchestra.run.smithi189.stdout:3 2024-04-01T16:33:48.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.829+0000 7f5dbc200640 1 -- 172.21.15.189:0/1039283483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4071ee0 msgr2=0x7f5db414fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:48.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.829+0000 7f5dbc200640 1 --2- 172.21.15.189:0/1039283483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4071ee0 0x7f5db414fad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5da800e870 tx=0x7f5da800ed30 comp rx=0 tx=0).stop 2024-04-01T16:33:48.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.829+0000 7f5dbc200640 1 -- 172.21.15.189:0/1039283483 shutdown_connections 2024-04-01T16:33:48.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.829+0000 7f5dbc200640 1 --2- 172.21.15.189:0/1039283483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5db4152830 0x7f5db4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.829+0000 7f5dbc200640 1 --2- 172.21.15.189:0/1039283483 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5db40c6b30 0x7f5db4153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.829+0000 7f5dbc200640 1 --2- 172.21.15.189:0/1039283483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5db4071ee0 0x7f5db414fad0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:48.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.829+0000 7f5dbc200640 1 -- 172.21.15.189:0/1039283483 >> 172.21.15.189:0/1039283483 conn(0x7f5db40cbe20 msgr2=0x7f5db414c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:48.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.830+0000 7f5dbc200640 1 -- 172.21.15.189:0/1039283483 shutdown_connections 2024-04-01T16:33:48.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:48.830+0000 7f5dbc200640 1 -- 172.21.15.189:0/1039283483 wait complete. 2024-04-01T16:33:48.853 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 83a46f56-4f0b-4276-8e71-938adf325a3b 4 2024-04-01T16:33:48.927 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:48.927+0000 7f30af838040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T16:33:48.928 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:48.928+0000 7fa74f23c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T16:33:49.012 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:49.012+0000 7f30af838040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T16:33:49.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.039+0000 7fb137600640 1 Processor -- start 2024-04-01T16:33:49.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.040+0000 7fb137600640 1 -- start start 2024-04-01T16:33:49.041 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.041+0000 7fb137600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb1301588f0 0x7fb130070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:49.041 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.041+0000 7fb137600640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb130158cd0 0x7fb130071360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:49.041 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.041+0000 7fb137600640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1300c9ed0 con 0x7fb1301591a0 2024-04-01T16:33:49.041 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.041+0000 7fb137600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb1300c3bd0 con 0x7fb1301588f0 2024-04-01T16:33:49.041 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.041+0000 7fb137600640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb130070e40 con 0x7fb130158cd0 2024-04-01T16:33:49.042 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.042+0000 7fb12fe00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb130158cd0 0x7fb130071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:49.042 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.042+0000 7fb12fe00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb130158cd0 0x7fb130071360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:39914/0 (socket says 172.21.15.189:39914) 2024-04-01T16:33:49.042 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.042+0000 7fb12fe00640 1 -- 172.21.15.189:0/616433267 learned_addr learned my addr 172.21.15.189:0/616433267 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:49.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.044+0000 7fb12fe00640 1 -- 172.21.15.189:0/616433267 >> v2:172.21.15.163:3300/0 conn(0x7fb1301588f0 msgr2=0x7fb130070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:49.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.044+0000 7fb12fe00640 1 --2- 172.21.15.189:0/616433267 >> v2:172.21.15.163:3300/0 conn(0x7fb1301588f0 0x7fb130070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:49.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.044+0000 7fb12fe00640 1 -- 172.21.15.189:0/616433267 >> v1:172.21.15.189:6789/0 conn(0x7fb1301591a0 legacy=0x7fb1300c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:49.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.044+0000 7fb12fe00640 1 -- 172.21.15.189:0/616433267 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1300c2fc0 con 0x7fb130158cd0 2024-04-01T16:33:49.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.047+0000 7fb12fe00640 1 --2- 172.21.15.189:0/616433267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb130158cd0 0x7fb130071360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb1300cbb60 tx=0x7fb11c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8b79fa7fbca7cf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:49.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.051+0000 7fb12f400640 1 -- 172.21.15.189:0/616433267 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c034070 con 0x7fb130158cd0 2024-04-01T16:33:49.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.051+0000 7fb12f400640 1 -- 172.21.15.189:0/616433267 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb11c030860 con 0x7fb130158cd0 2024-04-01T16:33:49.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.051+0000 7fb12f400640 1 -- 172.21.15.189:0/616433267 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c030c30 con 0x7fb130158cd0 2024-04-01T16:33:49.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.052+0000 7fb137600640 1 -- 172.21.15.189:0/616433267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb130158cd0 msgr2=0x7fb130071360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:49.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.052+0000 7fb137600640 1 --2- 172.21.15.189:0/616433267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb130158cd0 0x7fb130071360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb1300cbb60 tx=0x7fb11c02b9a0 comp rx=0 tx=0).stop 2024-04-01T16:33:49.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.052+0000 7fb137600640 1 -- 172.21.15.189:0/616433267 shutdown_connections 2024-04-01T16:33:49.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.052+0000 7fb137600640 1 --2- 172.21.15.189:0/616433267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb130158cd0 0x7fb130071360 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:49.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.052+0000 7fb137600640 1 --2- 172.21.15.189:0/616433267 >> v2:172.21.15.163:3300/0 conn(0x7fb1301588f0 0x7fb130070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:49.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.052+0000 7fb137600640 1 -- 172.21.15.189:0/616433267 >> 172.21.15.189:0/616433267 conn(0x7fb1300678b0 msgr2=0x7fb130071c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:49.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.052+0000 7fb137600640 1 -- 172.21.15.189:0/616433267 shutdown_connections 2024-04-01T16:33:49.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.052+0000 7fb137600640 1 -- 172.21.15.189:0/616433267 wait complete. 2024-04-01T16:33:49.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.054+0000 7fb137600640 1 Processor -- start 2024-04-01T16:33:49.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.054+0000 7fb137600640 1 -- start start 2024-04-01T16:33:49.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.055+0000 7fb137600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1301588f0 0x7fb13014df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:49.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.055+0000 7fb137600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb130158cd0 0x7fb13006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:49.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.055+0000 7fb137600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1301591a0 0x7fb1300cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:49.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.055+0000 7fb137600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb1300c3860 con 0x7fb1301588f0 2024-04-01T16:33:49.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.055+0000 7fb137600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb1300c3580 con 0x7fb1301591a0 2024-04-01T16:33:49.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.055+0000 7fb137600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb1300c4060 con 0x7fb130158cd0 2024-04-01T16:33:49.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.056+0000 7fb135600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1301591a0 0x7fb1300cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:49.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.056+0000 7fb12fe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb130158cd0 0x7fb13006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:49.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.056+0000 7fb135600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1301591a0 0x7fb1300cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:39926/0 (socket says 172.21.15.189:39926) 2024-04-01T16:33:49.057 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.056+0000 7fb135600640 1 -- 172.21.15.189:0/1599440317 learned_addr learned my addr 172.21.15.189:0/1599440317 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:49.060 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.060+0000 7fb135600640 1 -- 172.21.15.189:0/1599440317 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb130158cd0 msgr2=0x7fb13006d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:49.060 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.060+0000 7fb135600640 1 --2- 172.21.15.189:0/1599440317 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb130158cd0 0x7fb13006d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:49.060 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.060+0000 7fb135600640 1 -- 172.21.15.189:0/1599440317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1301588f0 msgr2=0x7fb13014df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:49.060 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.060+0000 7fb135600640 1 --2- 172.21.15.189:0/1599440317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1301588f0 0x7fb13014df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:49.060 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.060+0000 7fb135600640 1 -- 172.21.15.189:0/1599440317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1301f1470 con 0x7fb1301591a0 2024-04-01T16:33:49.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.062+0000 7fb135600640 1 --2- 172.21.15.189:0/1599440317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1301591a0 0x7fb1300cc460 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb12800b990 tx=0x7fb12800be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:49.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.066+0000 7fb12cc00640 1 -- 172.21.15.189:0/1599440317 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128019070 con 0x7fb1301591a0 2024-04-01T16:33:49.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.066+0000 7fb12cc00640 1 -- 172.21.15.189:0/1599440317 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12800cba0 con 0x7fb1301591a0 2024-04-01T16:33:49.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.066+0000 7fb12cc00640 1 -- 172.21.15.189:0/1599440317 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128014440 con 0x7fb1301591a0 2024-04-01T16:33:49.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.066+0000 7fb137600640 1 -- 172.21.15.189:0/1599440317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb13006e110 con 0x7fb1301591a0 2024-04-01T16:33:49.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.066+0000 7fb137600640 1 -- 172.21.15.189:0/1599440317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1300cdad0 con 0x7fb1301591a0 2024-04-01T16:33:49.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.068+0000 7fb137600640 1 -- 172.21.15.189:0/1599440317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb13006c480 con 0x7fb1301591a0 2024-04-01T16:33:49.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.070+0000 7fb12cc00640 1 -- 172.21.15.189:0/1599440317 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb128003970 con 0x7fb1301591a0 2024-04-01T16:33:49.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.070+0000 7fb12cc00640 1 -- 172.21.15.189:0/1599440317 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb128007880 con 0x7fb1301591a0 2024-04-01T16:33:49.154 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-04-01T16:33:49.153+0000 7f30af838040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T16:33:49.174 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.173+0000 7fb12cc00640 1 -- 172.21.15.189:0/1599440317 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb128022080 con 0x7fb1301591a0 2024-04-01T16:33:49.252 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.252+0000 7fb137600640 1 -- 172.21.15.189:0/1599440317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd new", "uuid": "83a46f56-4f0b-4276-8e71-938adf325a3b", "id": 4} v 0) -- 0x7fb13006e630 con 0x7fb1301591a0 2024-04-01T16:33:49.704 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:49.704+0000 7fb12cc00640 1 -- 172.21.15.189:0/1599440317 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mgrmap(e 2) ==== 45545+0+0 (secure 0 0 0) 0x7fb128007370 con 0x7fb1301591a0 2024-04-01T16:33:50.187 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.187+0000 7fb12cc00640 1 -- 172.21.15.189:0/1599440317 <== mon.1 v2:172.21.15.189:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83a46f56-4f0b-4276-8e71-938adf325a3b", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb13006e630 con 0x7fb1301591a0 2024-04-01T16:33:50.188 INFO:teuthology.orchestra.run.smithi189.stdout:4 2024-04-01T16:33:50.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.188+0000 7fb137600640 1 -- 172.21.15.189:0/1599440317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1301591a0 msgr2=0x7fb1300cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:50.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.188+0000 7fb137600640 1 --2- 172.21.15.189:0/1599440317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1301591a0 0x7fb1300cc460 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb12800b990 tx=0x7fb12800be50 comp rx=0 tx=0).stop 2024-04-01T16:33:50.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.189+0000 7fb137600640 1 -- 172.21.15.189:0/1599440317 shutdown_connections 2024-04-01T16:33:50.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.189+0000 7fb137600640 1 --2- 172.21.15.189:0/1599440317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1301591a0 0x7fb1300cc460 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:50.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.189+0000 7fb137600640 1 --2- 172.21.15.189:0/1599440317 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb130158cd0 0x7fb13006d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:50.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.189+0000 7fb137600640 1 --2- 172.21.15.189:0/1599440317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1301588f0 0x7fb13014df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:50.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.189+0000 7fb137600640 1 -- 172.21.15.189:0/1599440317 >> 172.21.15.189:0/1599440317 conn(0x7fb1300678b0 msgr2=0x7fb1300b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:50.190 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.189+0000 7fb137600640 1 -- 172.21.15.189:0/1599440317 shutdown_connections 2024-04-01T16:33:50.190 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.189+0000 7fb137600640 1 -- 172.21.15.189:0/1599440317 wait complete. 2024-04-01T16:33:50.209 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 46dba586-59d2-469e-8ce0-5e123e2dec72 5 2024-04-01T16:33:50.392 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.392+0000 7fe52fc00640 1 Processor -- start 2024-04-01T16:33:50.393 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.392+0000 7fe52fc00640 1 -- start start 2024-04-01T16:33:50.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.393+0000 7fe52fc00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe528158e80 0x7fe5280c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:50.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.394+0000 7fe52fc00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe5280c4a40 0x7fe5281694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:50.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.394+0000 7fe52fc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe52815efd0 con 0x7fe528073330 2024-04-01T16:33:50.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.394+0000 7fe52fc00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fe52806b670 con 0x7fe5280c4a40 2024-04-01T16:33:50.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.394+0000 7fe52fc00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe52806b910 con 0x7fe528158e80 2024-04-01T16:33:50.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.394+0000 7fe52d200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe528158e80 0x7fe5280c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:50.395 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.395+0000 7fe52d200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe528158e80 0x7fe5280c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:46026/0 (socket says 172.21.15.189:46026) 2024-04-01T16:33:50.395 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.395+0000 7fe52d200640 1 -- 172.21.15.189:0/2965494195 learned_addr learned my addr 172.21.15.189:0/2965494195 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:50.397 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.397+0000 7fe52d200640 1 -- 172.21.15.189:0/2965494195 >> v2:172.21.15.163:3300/0 conn(0x7fe5280c4a40 msgr2=0x7fe5281694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:50.397 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.397+0000 7fe52d200640 1 --2- 172.21.15.189:0/2965494195 >> v2:172.21.15.163:3300/0 conn(0x7fe5280c4a40 0x7fe5281694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:50.398 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.397+0000 7fe52d200640 1 -- 172.21.15.189:0/2965494195 >> v1:172.21.15.163:6789/0 conn(0x7fe528073330 legacy=0x7fe5280726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:50.398 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.397+0000 7fe52d200640 1 -- 172.21.15.189:0/2965494195 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5280c7a60 con 0x7fe528158e80 2024-04-01T16:33:50.399 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.399+0000 7fe52d200640 1 --2- 172.21.15.189:0/2965494195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe528158e80 0x7fe5280c7520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe51c009870 tx=0x7fe51c02b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6780eb9fe3d8aeaa server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:50.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.403+0000 7fe527400640 1 -- 172.21.15.189:0/2965494195 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c035020 con 0x7fe528158e80 2024-04-01T16:33:50.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.404+0000 7fe527400640 1 -- 172.21.15.189:0/2965494195 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe51c031870 con 0x7fe528158e80 2024-04-01T16:33:50.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.404+0000 7fe527400640 1 -- 172.21.15.189:0/2965494195 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c031c40 con 0x7fe528158e80 2024-04-01T16:33:50.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.404+0000 7fe52fc00640 1 -- 172.21.15.189:0/2965494195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe528158e80 msgr2=0x7fe5280c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:50.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.404+0000 7fe52fc00640 1 --2- 172.21.15.189:0/2965494195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe528158e80 0x7fe5280c7520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe51c009870 tx=0x7fe51c02b910 comp rx=0 tx=0).stop 2024-04-01T16:33:50.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.404+0000 7fe52fc00640 1 -- 172.21.15.189:0/2965494195 shutdown_connections 2024-04-01T16:33:50.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.405+0000 7fe52fc00640 1 --2- 172.21.15.189:0/2965494195 >> v2:172.21.15.163:3300/0 conn(0x7fe5280c4a40 0x7fe5281694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:50.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.405+0000 7fe52fc00640 1 --2- 172.21.15.189:0/2965494195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe528158e80 0x7fe5280c7520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:50.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.405+0000 7fe52fc00640 1 -- 172.21.15.189:0/2965494195 >> 172.21.15.189:0/2965494195 conn(0x7fe5280c8f80 msgr2=0x7fe5280c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:50.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.405+0000 7fe52fc00640 1 -- 172.21.15.189:0/2965494195 shutdown_connections 2024-04-01T16:33:50.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.405+0000 7fe52fc00640 1 -- 172.21.15.189:0/2965494195 wait complete. 2024-04-01T16:33:50.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.406+0000 7fe52fc00640 1 Processor -- start 2024-04-01T16:33:50.407 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.407+0000 7fe52fc00640 1 -- start start 2024-04-01T16:33:50.408 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.407+0000 7fe52fc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe528073330 0x7fe528152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:50.408 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.408+0000 7fe52fc00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5280c4a40 0x7fe52815e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:50.408 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.408+0000 7fe52fc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe528158e80 0x7fe5281f8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:50.408 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.408+0000 7fe52fc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe52806c1b0 con 0x7fe528073330 2024-04-01T16:33:50.408 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.408+0000 7fe52fc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe52806bed0 con 0x7fe528158e80 2024-04-01T16:33:50.408 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.408+0000 7fe52fc00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe5280c3980 con 0x7fe5280c4a40 2024-04-01T16:33:50.408 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.408+0000 7fe527e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5280c4a40 0x7fe52815e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:50.409 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.409+0000 7fe527e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5280c4a40 0x7fe52815e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:46028/0 (socket says 172.21.15.189:46028) 2024-04-01T16:33:50.409 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.409+0000 7fe527e00640 1 -- 172.21.15.189:0/2366529533 learned_addr learned my addr 172.21.15.189:0/2366529533 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:50.412 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.412+0000 7fe527e00640 1 -- 172.21.15.189:0/2366529533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe528158e80 msgr2=0x7fe5281f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:50.412 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.412+0000 7fe527e00640 1 --2- 172.21.15.189:0/2366529533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe528158e80 0x7fe5281f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:50.412 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.412+0000 7fe527e00640 1 -- 172.21.15.189:0/2366529533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe528073330 msgr2=0x7fe528152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:50.412 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.412+0000 7fe527e00640 1 --2- 172.21.15.189:0/2366529533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe528073330 0x7fe528152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:50.413 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.412+0000 7fe527e00640 1 -- 172.21.15.189:0/2366529533 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe52814cfb0 con 0x7fe5280c4a40 2024-04-01T16:33:50.415 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.415+0000 7fe527e00640 1 --2- 172.21.15.189:0/2366529533 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5280c4a40 0x7fe52815e350 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe51400c410 tx=0x7fe51400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:50.420 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.420+0000 7fe524c00640 1 -- 172.21.15.189:0/2366529533 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe514017070 con 0x7fe5280c4a40 2024-04-01T16:33:50.420 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.420+0000 7fe524c00640 1 -- 172.21.15.189:0/2366529533 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5140035f0 con 0x7fe5280c4a40 2024-04-01T16:33:50.420 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.420+0000 7fe52fc00640 1 -- 172.21.15.189:0/2366529533 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe52814c190 con 0x7fe5280c4a40 2024-04-01T16:33:50.420 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.420+0000 7fe524c00640 1 -- 172.21.15.189:0/2366529533 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5140039e0 con 0x7fe5280c4a40 2024-04-01T16:33:50.420 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.420+0000 7fe52fc00640 1 -- 172.21.15.189:0/2366529533 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe52814c430 con 0x7fe5280c4a40 2024-04-01T16:33:50.422 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.422+0000 7fe52fc00640 1 -- 172.21.15.189:0/2366529533 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5281f8160 con 0x7fe5280c4a40 2024-04-01T16:33:50.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.439+0000 7fe524c00640 1 -- 172.21.15.189:0/2366529533 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 2) ==== 45545+0+0 (secure 0 0 0) 0x7fe51401a070 con 0x7fe5280c4a40 2024-04-01T16:33:50.440 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.440+0000 7fe524c00640 1 -- 172.21.15.189:0/2366529533 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe51404a190 con 0x7fe5280c4a40 2024-04-01T16:33:50.660 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.659+0000 7fe524c00640 1 -- 172.21.15.189:0/2366529533 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe514021020 con 0x7fe5280c4a40 2024-04-01T16:33:50.743 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:50.743+0000 7fe52fc00640 1 -- 172.21.15.189:0/2366529533 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd new", "uuid": "46dba586-59d2-469e-8ce0-5e123e2dec72", "id": 5} v 0) -- 0x7fe5280756d0 con 0x7fe5280c4a40 2024-04-01T16:33:51.111 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.111+0000 7fe524c00640 1 -- 172.21.15.189:0/2366529533 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mgrmap(e 3) ==== 90751+0+0 (secure 0 0 0) 0x7fe514048db0 con 0x7fe5280c4a40 2024-04-01T16:33:51.565 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.565+0000 7fe524c00640 1 -- 172.21.15.189:0/2366529533 <== mon.2 v2:172.21.15.189:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46dba586-59d2-469e-8ce0-5e123e2dec72", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe52814cfb0 con 0x7fe5280c4a40 2024-04-01T16:33:51.566 INFO:teuthology.orchestra.run.smithi189.stdout:5 2024-04-01T16:33:51.568 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.567+0000 7fe52fc00640 1 -- 172.21.15.189:0/2366529533 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5280c4a40 msgr2=0x7fe52815e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:51.568 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.567+0000 7fe52fc00640 1 --2- 172.21.15.189:0/2366529533 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5280c4a40 0x7fe52815e350 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe51400c410 tx=0x7fe51400c8d0 comp rx=0 tx=0).stop 2024-04-01T16:33:51.568 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.567+0000 7fe52fc00640 1 -- 172.21.15.189:0/2366529533 shutdown_connections 2024-04-01T16:33:51.568 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.567+0000 7fe52fc00640 1 --2- 172.21.15.189:0/2366529533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe528158e80 0x7fe5281f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:51.568 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.567+0000 7fe52fc00640 1 --2- 172.21.15.189:0/2366529533 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe5280c4a40 0x7fe52815e350 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:51.568 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.567+0000 7fe52fc00640 1 --2- 172.21.15.189:0/2366529533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe528073330 0x7fe528152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:51.568 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.567+0000 7fe52fc00640 1 -- 172.21.15.189:0/2366529533 >> 172.21.15.189:0/2366529533 conn(0x7fe5280c8f80 msgr2=0x7fe5281551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:51.568 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.568+0000 7fe52fc00640 1 -- 172.21.15.189:0/2366529533 shutdown_connections 2024-04-01T16:33:51.568 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.568+0000 7fe52fc00640 1 -- 172.21.15.189:0/2366529533 wait complete. 2024-04-01T16:33:51.589 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 7b1b4401-c302-489f-a20f-a4e51455c90e 6 2024-04-01T16:33:51.779 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.779+0000 7febc0a00640 1 Processor -- start 2024-04-01T16:33:51.780 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.779+0000 7febc0a00640 1 -- start start 2024-04-01T16:33:51.781 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.780+0000 7febc0a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc154af0 0x7febbc15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:51.781 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.781+0000 7febc0a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febbc0cacf0 con 0x7febbc0b4490 2024-04-01T16:33:51.781 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.781+0000 7febc0a00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febbc0cafd0 con 0x7febbc06d050 2024-04-01T16:33:51.781 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.781+0000 7febc0a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7febbc15b8f0 con 0x7febbc154af0 2024-04-01T16:33:51.806 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.806+0000 7febb9e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc154af0 0x7febbc15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:51.807 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.807+0000 7febb9e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc154af0 0x7febbc15b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:46034/0 (socket says 172.21.15.189:46034) 2024-04-01T16:33:51.807 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.807+0000 7febb9e00640 1 -- 172.21.15.189:0/2866858521 learned_addr learned my addr 172.21.15.189:0/2866858521 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:51.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.810+0000 7febb9e00640 1 -- 172.21.15.189:0/2866858521 >> v1:172.21.15.189:6789/0 conn(0x7febbc06d050 legacy=0x7febbc06c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:51.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.810+0000 7febb9e00640 1 -- 172.21.15.189:0/2866858521 >> v1:172.21.15.163:6789/0 conn(0x7febbc0b4490 legacy=0x7febbc0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:51.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.810+0000 7febb9e00640 1 -- 172.21.15.189:0/2866858521 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febbc0cb2b0 con 0x7febbc154af0 2024-04-01T16:33:51.812 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.812+0000 7febb9e00640 1 --2- 172.21.15.189:0/2866858521 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc154af0 0x7febbc15b3b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7febac0098a0 tx=0x7febac02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cac8a6fc4b769956 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:51.820 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.820+0000 7febb8a00640 1 -- 172.21.15.189:0/2866858521 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac035020 con 0x7febbc154af0 2024-04-01T16:33:51.820 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.820+0000 7febb8a00640 1 -- 172.21.15.189:0/2866858521 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febac031640 con 0x7febbc154af0 2024-04-01T16:33:51.820 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.820+0000 7febb8a00640 1 -- 172.21.15.189:0/2866858521 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac02d040 con 0x7febbc154af0 2024-04-01T16:33:51.821 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.821+0000 7febc0a00640 1 -- 172.21.15.189:0/2866858521 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc154af0 msgr2=0x7febbc15b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:51.821 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.821+0000 7febc0a00640 1 --2- 172.21.15.189:0/2866858521 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc154af0 0x7febbc15b3b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7febac0098a0 tx=0x7febac02b8f0 comp rx=0 tx=0).stop 2024-04-01T16:33:51.822 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.821+0000 7febc0a00640 1 -- 172.21.15.189:0/2866858521 shutdown_connections 2024-04-01T16:33:51.822 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.821+0000 7febc0a00640 1 --2- 172.21.15.189:0/2866858521 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc154af0 0x7febbc15b3b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:51.822 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.821+0000 7febc0a00640 1 -- 172.21.15.189:0/2866858521 >> 172.21.15.189:0/2866858521 conn(0x7febbc0cffa0 msgr2=0x7febbc0d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:51.822 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.822+0000 7febc0a00640 1 -- 172.21.15.189:0/2866858521 shutdown_connections 2024-04-01T16:33:51.822 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.822+0000 7febc0a00640 1 -- 172.21.15.189:0/2866858521 wait complete. 2024-04-01T16:33:51.824 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.824+0000 7febc0a00640 1 Processor -- start 2024-04-01T16:33:51.824 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.824+0000 7febc0a00640 1 -- start start 2024-04-01T16:33:51.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.825+0000 7febc0a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc06d050 0x7febbc1f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:51.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.825+0000 7febc0a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febbc0b4490 0x7febbc0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:51.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.825+0000 7febc0a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febbc154af0 0x7febbc151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:51.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.825+0000 7febc0a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7febbc0cbb50 con 0x7febbc0b4490 2024-04-01T16:33:51.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.825+0000 7febc0a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7febbc0cb870 con 0x7febbc154af0 2024-04-01T16:33:51.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.825+0000 7febc0a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7febbc0ca920 con 0x7febbc06d050 2024-04-01T16:33:51.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.826+0000 7febb9e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc06d050 0x7febbc1f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:51.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.826+0000 7febb9e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc06d050 0x7febbc1f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:46046/0 (socket says 172.21.15.189:46046) 2024-04-01T16:33:51.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.826+0000 7febb9e00640 1 -- 172.21.15.189:0/3058591623 learned_addr learned my addr 172.21.15.189:0/3058591623 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:51.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.833+0000 7febb9e00640 1 -- 172.21.15.189:0/3058591623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febbc154af0 msgr2=0x7febbc151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:51.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.833+0000 7febb9e00640 1 --2- 172.21.15.189:0/3058591623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febbc154af0 0x7febbc151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:51.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.833+0000 7febb9e00640 1 -- 172.21.15.189:0/3058591623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febbc0b4490 msgr2=0x7febbc0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:51.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.833+0000 7febb9e00640 1 --2- 172.21.15.189:0/3058591623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febbc0b4490 0x7febbc0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:51.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.833+0000 7febb9e00640 1 -- 172.21.15.189:0/3058591623 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febbc14b180 con 0x7febbc06d050 2024-04-01T16:33:51.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.837+0000 7febb9e00640 1 --2- 172.21.15.189:0/3058591623 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc06d050 0x7febbc1f4410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7febac000c00 tx=0x7febac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:51.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.844+0000 7febb2000640 1 -- 172.21.15.189:0/3058591623 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac03ac60 con 0x7febbc06d050 2024-04-01T16:33:51.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.845+0000 7febb2000640 1 -- 172.21.15.189:0/3058591623 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febac03ae20 con 0x7febbc06d050 2024-04-01T16:33:51.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.845+0000 7febc0a00640 1 -- 172.21.15.189:0/3058591623 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febbc14b460 con 0x7febbc06d050 2024-04-01T16:33:51.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.845+0000 7febb2000640 1 -- 172.21.15.189:0/3058591623 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac044630 con 0x7febbc06d050 2024-04-01T16:33:51.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.845+0000 7febc0a00640 1 -- 172.21.15.189:0/3058591623 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7febbc1f0ac0 con 0x7febbc06d050 2024-04-01T16:33:51.846 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.846+0000 7febc0a00640 1 -- 172.21.15.189:0/3058591623 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febbc0756d0 con 0x7febbc06d050 2024-04-01T16:33:51.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:51.997+0000 7febb2000640 1 -- 172.21.15.189:0/3058591623 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 3) ==== 90751+0+0 (secure 0 0 0) 0x7febac04b060 con 0x7febbc06d050 2024-04-01T16:33:52.011 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:52.010+0000 7febb2000640 1 -- 172.21.15.189:0/3058591623 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7febac0315e0 con 0x7febbc06d050 2024-04-01T16:33:52.011 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:52.011+0000 7febb2000640 1 -- 172.21.15.189:0/3058591623 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7febac03f070 con 0x7febbc06d050 2024-04-01T16:33:52.096 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:52.096+0000 7febc0a00640 1 -- 172.21.15.189:0/3058591623 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7b1b4401-c302-489f-a20f-a4e51455c90e", "id": 6} v 0) -- 0x7febbc0756d0 con 0x7febbc06d050 2024-04-01T16:33:52.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:52.726+0000 7febb2000640 1 -- 172.21.15.189:0/3058591623 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7febac038020 con 0x7febbc06d050 2024-04-01T16:33:52.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:52.727+0000 7febb2000640 1 --2- 172.21.15.189:0/3058591623 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7feb9c06d890 0x7feb9c06fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:52.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:52.727+0000 7febb9400640 1 --2- 172.21.15.189:0/3058591623 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7feb9c06d890 0x7feb9c06fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:52.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:52.729+0000 7febb9400640 1 --2- 172.21.15.189:0/3058591623 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7feb9c06d890 0x7feb9c06fc80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7febbc0c5d70 tx=0x7feba8007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:52.888 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:52.888+0000 7fa6efc00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-01T16:33:52.965 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T16:33:52.965+0000 7fa6efc00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-01T16:33:53.416 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.415+0000 7febb2000640 1 -- 172.21.15.189:0/3058591623 <== mon.2 v2:172.21.15.189:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7b1b4401-c302-489f-a20f-a4e51455c90e", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7febac07c050 con 0x7febbc06d050 2024-04-01T16:33:53.416 INFO:teuthology.orchestra.run.smithi189.stdout:6 2024-04-01T16:33:53.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.417+0000 7febc0a00640 1 -- 172.21.15.189:0/3058591623 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7feb9c06d890 msgr2=0x7feb9c06fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:53.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.417+0000 7febc0a00640 1 --2- 172.21.15.189:0/3058591623 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7feb9c06d890 0x7feb9c06fc80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7febbc0c5d70 tx=0x7feba8007990 comp rx=0 tx=0).stop 2024-04-01T16:33:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.417+0000 7febc0a00640 1 -- 172.21.15.189:0/3058591623 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc06d050 msgr2=0x7febbc1f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.417+0000 7febc0a00640 1 --2- 172.21.15.189:0/3058591623 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc06d050 0x7febbc1f4410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7febac000c00 tx=0x7febac0046c0 comp rx=0 tx=0).stop 2024-04-01T16:33:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.417+0000 7febc0a00640 1 -- 172.21.15.189:0/3058591623 shutdown_connections 2024-04-01T16:33:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.418+0000 7febc0a00640 1 --2- 172.21.15.189:0/3058591623 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7feb9c06d890 0x7feb9c06fc80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.418+0000 7febc0a00640 1 --2- 172.21.15.189:0/3058591623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7febbc154af0 0x7febbc151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.418+0000 7febc0a00640 1 --2- 172.21.15.189:0/3058591623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febbc0b4490 0x7febbc0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.418+0000 7febc0a00640 1 --2- 172.21.15.189:0/3058591623 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7febbc06d050 0x7febbc1f4410 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.418+0000 7febc0a00640 1 -- 172.21.15.189:0/3058591623 >> 172.21.15.189:0/3058591623 conn(0x7febbc0cffa0 msgr2=0x7febbc14f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.418+0000 7febc0a00640 1 -- 172.21.15.189:0/3058591623 shutdown_connections 2024-04-01T16:33:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.418+0000 7febc0a00640 1 -- 172.21.15.189:0/3058591623 wait complete. 2024-04-01T16:33:53.437 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 02292040-b6f3-47b0-b872-d9a1ee3b0173 7 2024-04-01T16:33:53.633 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.633+0000 7fa6d3000640 1 Processor -- start 2024-04-01T16:33:53.633 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.633+0000 7fa6d3000640 1 -- start start 2024-04-01T16:33:53.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.635+0000 7fa6d3000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa6cc151700 0x7fa6cc15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:53.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.635+0000 7fa6d3000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc070100 0x7fa6cc0c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:53.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.635+0000 7fa6d3000640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6cc15b040 con 0x7fa6cc0c8160 2024-04-01T16:33:53.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.635+0000 7fa6d3000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fa6cc0c3060 con 0x7fa6cc151700 2024-04-01T16:33:53.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.635+0000 7fa6d3000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa6cc15b8e0 con 0x7fa6cc070100 2024-04-01T16:33:53.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.636+0000 7fa6c3400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc070100 0x7fa6cc0c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:53.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.636+0000 7fa6d1000640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fa6cc0c8160 0x7fa6cc0c0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:40444/0 (socket says 172.21.15.189:40444) 2024-04-01T16:33:53.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.636+0000 7fa6d1000640 1 -- 172.21.15.189:0/1392983617 learned_addr learned my addr 172.21.15.189:0/1392983617 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-04-01T16:33:53.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.639+0000 7fa6c3400640 1 -- 172.21.15.189:0/1392983617 >> v2:172.21.15.163:3300/0 conn(0x7fa6cc151700 msgr2=0x7fa6cc15aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:53.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.639+0000 7fa6c3400640 1 --2- 172.21.15.189:0/1392983617 >> v2:172.21.15.163:3300/0 conn(0x7fa6cc151700 0x7fa6cc15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:53.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.639+0000 7fa6c3400640 1 -- 172.21.15.189:0/1392983617 >> v1:172.21.15.189:6789/0 conn(0x7fa6cc0c8160 legacy=0x7fa6cc0c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:53.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.639+0000 7fa6c3400640 1 -- 172.21.15.189:0/1392983617 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc15b320 con 0x7fa6cc070100 2024-04-01T16:33:53.641 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.641+0000 7fa6c3400640 1 --2- 172.21.15.189:0/1392983617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc070100 0x7fa6cc0c7820 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40097a0 tx=0x7fa6b402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d566d29fcd842da3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:53.645 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.645+0000 7fa6cb400640 1 -- 172.21.15.189:0/1392983617 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4035020 con 0x7fa6cc070100 2024-04-01T16:33:53.645 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.645+0000 7fa6cb400640 1 -- 172.21.15.189:0/1392983617 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b4031830 con 0x7fa6cc070100 2024-04-01T16:33:53.645 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.645+0000 7fa6cb400640 1 -- 172.21.15.189:0/1392983617 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4031c00 con 0x7fa6cc070100 2024-04-01T16:33:53.646 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.645+0000 7fa6d3000640 1 -- 172.21.15.189:0/1392983617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc070100 msgr2=0x7fa6cc0c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:53.646 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.645+0000 7fa6d3000640 1 --2- 172.21.15.189:0/1392983617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc070100 0x7fa6cc0c7820 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40097a0 tx=0x7fa6b402b8d0 comp rx=0 tx=0).stop 2024-04-01T16:33:53.646 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.646+0000 7fa6d3000640 1 -- 172.21.15.189:0/1392983617 shutdown_connections 2024-04-01T16:33:53.646 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.646+0000 7fa6d3000640 1 --2- 172.21.15.189:0/1392983617 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc070100 0x7fa6cc0c7820 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:53.646 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.646+0000 7fa6d3000640 1 --2- 172.21.15.189:0/1392983617 >> v2:172.21.15.163:3300/0 conn(0x7fa6cc151700 0x7fa6cc15aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:53.646 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.646+0000 7fa6d3000640 1 -- 172.21.15.189:0/1392983617 >> 172.21.15.189:0/1392983617 conn(0x7fa6cc0cbe20 msgr2=0x7fa6cc0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:53.646 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.646+0000 7fa6d3000640 1 -- 172.21.15.189:0/1392983617 shutdown_connections 2024-04-01T16:33:53.646 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.646+0000 7fa6d3000640 1 -- 172.21.15.189:0/1392983617 wait complete. 2024-04-01T16:33:53.647 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.647+0000 7fa6d3000640 1 Processor -- start 2024-04-01T16:33:53.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.648+0000 7fa6d3000640 1 -- start start 2024-04-01T16:33:53.649 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.648+0000 7fa6d3000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6cc070100 0x7fa6cc14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:53.649 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.648+0000 7fa6d3000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6cc0c8160 0x7fa6cc1589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:53.649 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.648+0000 7fa6d3000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc151700 0x7fa6cc159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:53.649 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.648+0000 7fa6d3000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc0c7020 con 0x7fa6cc0c8160 2024-04-01T16:33:53.649 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.649+0000 7fa6d3000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc0c7390 con 0x7fa6cc070100 2024-04-01T16:33:53.649 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.649+0000 7fa6d3000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa6cc151ae0 con 0x7fa6cc151700 2024-04-01T16:33:53.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.649+0000 7fa6d1000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc151700 0x7fa6cc159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:53.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.649+0000 7fa6cbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6cc070100 0x7fa6cc14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:53.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.650+0000 7fa6d1000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc151700 0x7fa6cc159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.189:43586/0 (socket says 172.21.15.189:43586) 2024-04-01T16:33:53.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.650+0000 7fa6d1000640 1 -- 172.21.15.189:0/2442421109 learned_addr learned my addr 172.21.15.189:0/2442421109 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-01T16:33:53.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.653+0000 7fa6d1000640 1 -- 172.21.15.189:0/2442421109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6cc070100 msgr2=0x7fa6cc14bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:53.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.653+0000 7fa6d1000640 1 --2- 172.21.15.189:0/2442421109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6cc070100 0x7fa6cc14bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:53.654 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.653+0000 7fa6d1000640 1 -- 172.21.15.189:0/2442421109 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6cc0c8160 msgr2=0x7fa6cc1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:53.654 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.653+0000 7fa6d1000640 1 --2- 172.21.15.189:0/2442421109 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6cc0c8160 0x7fa6cc1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:53.654 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.653+0000 7fa6d1000640 1 -- 172.21.15.189:0/2442421109 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc158780 con 0x7fa6cc151700 2024-04-01T16:33:53.656 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.656+0000 7fa6d1000640 1 --2- 172.21.15.189:0/2442421109 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc151700 0x7fa6cc159580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400ca20 tx=0x7fa6c400ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:53.661 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.661+0000 7fa6c8c00640 1 -- 172.21.15.189:0/2442421109 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4017070 con 0x7fa6cc151700 2024-04-01T16:33:53.661 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.661+0000 7fa6c8c00640 1 -- 172.21.15.189:0/2442421109 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c400ab10 con 0x7fa6cc151700 2024-04-01T16:33:53.661 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.661+0000 7fa6c8c00640 1 -- 172.21.15.189:0/2442421109 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4012400 con 0x7fa6cc151700 2024-04-01T16:33:53.661 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.661+0000 7fa6d3000640 1 -- 172.21.15.189:0/2442421109 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6cc1f1710 con 0x7fa6cc151700 2024-04-01T16:33:53.661 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.661+0000 7fa6d3000640 1 -- 172.21.15.189:0/2442421109 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6cc1f0950 con 0x7fa6cc151700 2024-04-01T16:33:53.662 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.662+0000 7fa6d3000640 1 -- 172.21.15.189:0/2442421109 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6cc0756d0 con 0x7fa6cc151700 2024-04-01T16:33:53.683 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.683+0000 7fa6c8c00640 1 -- 172.21.15.189:0/2442421109 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fa6c401a070 con 0x7fa6cc151700 2024-04-01T16:33:53.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.684+0000 7fa6c8c00640 1 --2- 172.21.15.189:0/2442421109 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa6a806c8b0 0x7fa6a806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:53.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.684+0000 7fa6c8c00640 1 -- 172.21.15.189:0/2442421109 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa6c408aa30 con 0x7fa6cc151700 2024-04-01T16:33:53.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.685+0000 7fa6cbe00640 1 --2- 172.21.15.189:0/2442421109 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa6a806c8b0 0x7fa6a806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:53.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.686+0000 7fa6cbe00640 1 --2- 172.21.15.189:0/2442421109 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa6a806c8b0 0x7fa6a806ed70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009990 tx=0x7fa6bc009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:53.985 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:53.983+0000 7fa6c8c00640 1 -- 172.21.15.189:0/2442421109 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa6c4021020 con 0x7fa6cc151700 2024-04-01T16:33:54.209 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.208+0000 7fa6d3000640 1 -- 172.21.15.189:0/2442421109 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd new", "uuid": "02292040-b6f3-47b0-b872-d9a1ee3b0173", "id": 7} v 0) -- 0x7fa6cc0739e0 con 0x7fa6cc151700 2024-04-01T16:33:54.613 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.612+0000 7fa6c8c00640 1 -- 172.21.15.189:0/2442421109 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02292040-b6f3-47b0-b872-d9a1ee3b0173", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa6c4059fe0 con 0x7fa6cc151700 2024-04-01T16:33:54.613 INFO:teuthology.orchestra.run.smithi189.stdout:7 2024-04-01T16:33:54.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.616+0000 7fa6d3000640 1 -- 172.21.15.189:0/2442421109 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa6a806c8b0 msgr2=0x7fa6a806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:54.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.616+0000 7fa6d3000640 1 --2- 172.21.15.189:0/2442421109 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa6a806c8b0 0x7fa6a806ed70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009990 tx=0x7fa6bc009110 comp rx=0 tx=0).stop 2024-04-01T16:33:54.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.616+0000 7fa6d3000640 1 -- 172.21.15.189:0/2442421109 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc151700 msgr2=0x7fa6cc159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:54.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.616+0000 7fa6d3000640 1 --2- 172.21.15.189:0/2442421109 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc151700 0x7fa6cc159580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400ca20 tx=0x7fa6c400ce20 comp rx=0 tx=0).stop 2024-04-01T16:33:54.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.616+0000 7fa6d3000640 1 -- 172.21.15.189:0/2442421109 shutdown_connections 2024-04-01T16:33:54.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.616+0000 7fa6d3000640 1 --2- 172.21.15.189:0/2442421109 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa6a806c8b0 0x7fa6a806ed70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:54.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.616+0000 7fa6d3000640 1 --2- 172.21.15.189:0/2442421109 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa6cc151700 0x7fa6cc159580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:54.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.616+0000 7fa6d3000640 1 --2- 172.21.15.189:0/2442421109 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6cc0c8160 0x7fa6cc1589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:54.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.616+0000 7fa6d3000640 1 --2- 172.21.15.189:0/2442421109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6cc070100 0x7fa6cc14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:54.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.616+0000 7fa6d3000640 1 -- 172.21.15.189:0/2442421109 >> 172.21.15.189:0/2442421109 conn(0x7fa6cc0cbe20 msgr2=0x7fa6cc0c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:54.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.617+0000 7fa6d3000640 1 -- 172.21.15.189:0/2442421109 shutdown_connections 2024-04-01T16:33:54.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-01T16:33:54.617+0000 7fa6d3000640 1 -- 172.21.15.189:0/2442421109 wait complete. 2024-04-01T16:33:54.638 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-01T16:33:54.638 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-04-01T16:33:54.646 INFO:tasks.ceph.osd.0:Started 2024-04-01T16:33:54.646 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-01T16:33:54.646 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-04-01T16:33:54.653 INFO:tasks.ceph.osd.1:Started 2024-04-01T16:33:54.653 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-01T16:33:54.653 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-04-01T16:33:54.658 INFO:tasks.ceph.osd.2:Started 2024-04-01T16:33:54.658 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-01T16:33:54.659 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-04-01T16:33:54.664 INFO:tasks.ceph.osd.3:Started 2024-04-01T16:33:54.664 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-01T16:33:54.664 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-04-01T16:33:54.668 INFO:tasks.ceph.osd.4:Started 2024-04-01T16:33:54.669 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-01T16:33:54.669 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-04-01T16:33:54.673 INFO:tasks.ceph.osd.5:Started 2024-04-01T16:33:54.673 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-01T16:33:54.673 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-04-01T16:33:54.678 INFO:tasks.ceph.osd.6:Started 2024-04-01T16:33:54.678 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-01T16:33:54.678 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-04-01T16:33:54.683 INFO:tasks.ceph.osd.7:Started 2024-04-01T16:33:54.684 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T16:33:54.882 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.882+0000 7f47ffe00640 1 Processor -- start 2024-04-01T16:33:54.882 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.883+0000 7f47ffe00640 1 -- start start 2024-04-01T16:33:54.883 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.884+0000 7f47ffe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f81529e0 0x7f47f80ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:54.883 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.884+0000 7f47ffe00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f47f80ca620 0x7f47f80cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:54.883 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.884+0000 7f47ffe00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f815c060 con 0x7f47f80c3230 2024-04-01T16:33:54.883 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.884+0000 7f47ffe00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f47f815c340 con 0x7f47f80ca620 2024-04-01T16:33:54.883 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.884+0000 7f47ffe00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f47f815c620 con 0x7f47f81529e0 2024-04-01T16:33:54.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.885+0000 7f47fd400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f81529e0 0x7f47f80ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:54.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.885+0000 7f47fde00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f47f80c3230 0x7f47f8158d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:46308/0 (socket says 172.21.15.163:46308) 2024-04-01T16:33:54.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.885+0000 7f47fde00640 1 -- 172.21.15.163:0/1927270848 learned_addr learned my addr 172.21.15.163:0/1927270848 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:33:54.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.885+0000 7f47fca00640 1 --2- 172.21.15.163:0/1927270848 >> v2:172.21.15.163:3300/0 conn(0x7f47f80ca620 0x7f47f80cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:54.887 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.888+0000 7f47fca00640 1 -- 172.21.15.163:0/1927270848 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f81529e0 msgr2=0x7f47f80ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:54.887 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.888+0000 7f47fca00640 1 --2- 172.21.15.163:0/1927270848 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f81529e0 0x7f47f80ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:54.887 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.888+0000 7f47fca00640 1 -- 172.21.15.163:0/1927270848 >> v1:172.21.15.189:6789/0 conn(0x7f47f80c3230 legacy=0x7f47f8158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:54.887 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.888+0000 7f47fca00640 1 -- 172.21.15.163:0/1927270848 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f815c900 con 0x7f47f80ca620 2024-04-01T16:33:54.889 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.890+0000 7f47fca00640 1 --2- 172.21.15.163:0/1927270848 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f80ca620 0x7f47f80cdfa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f47e80097a0 tx=0x7f47e802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181185acec788559 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:54.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.892+0000 7f47f7e00640 1 -- 172.21.15.163:0/1927270848 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8035020 con 0x7f47f80ca620 2024-04-01T16:33:54.893 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.894+0000 7f47f7e00640 1 -- 172.21.15.163:0/1927270848 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e8031810 con 0x7f47f80ca620 2024-04-01T16:33:54.893 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.894+0000 7f47f7e00640 1 -- 172.21.15.163:0/1927270848 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8031be0 con 0x7f47f80ca620 2024-04-01T16:33:54.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.895+0000 7f47ffe00640 1 -- 172.21.15.163:0/1927270848 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f80ca620 msgr2=0x7f47f80cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:54.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.895+0000 7f47ffe00640 1 --2- 172.21.15.163:0/1927270848 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f80ca620 0x7f47f80cdfa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f47e80097a0 tx=0x7f47e802b8b0 comp rx=0 tx=0).stop 2024-04-01T16:33:54.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.895+0000 7f47ffe00640 1 -- 172.21.15.163:0/1927270848 shutdown_connections 2024-04-01T16:33:54.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.895+0000 7f47ffe00640 1 --2- 172.21.15.163:0/1927270848 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f80ca620 0x7f47f80cdfa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:54.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.895+0000 7f47ffe00640 1 --2- 172.21.15.163:0/1927270848 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f81529e0 0x7f47f80ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:54.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.895+0000 7f47ffe00640 1 -- 172.21.15.163:0/1927270848 >> 172.21.15.163:0/1927270848 conn(0x7f47f8067280 msgr2=0x7f47f8067660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:54.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.895+0000 7f47ffe00640 1 -- 172.21.15.163:0/1927270848 shutdown_connections 2024-04-01T16:33:54.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.895+0000 7f47ffe00640 1 -- 172.21.15.163:0/1927270848 wait complete. 2024-04-01T16:33:54.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.897+0000 7f47ffe00640 1 Processor -- start 2024-04-01T16:33:54.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.897+0000 7f47ffe00640 1 -- start start 2024-04-01T16:33:54.897 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.898+0000 7f47ffe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f80c3230 0x7f47f8156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:54.897 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.898+0000 7f47ffe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f81529e0 0x7f47f80c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:54.897 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.898+0000 7f47ffe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f80adc60 0x7f47f81f0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:54.897 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.898+0000 7f47ffe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8152dc0 con 0x7f47f80c3230 2024-04-01T16:33:54.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.898+0000 7f47ffe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8158840 con 0x7f47f81529e0 2024-04-01T16:33:54.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.898+0000 7f47ffe00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f47f815bd20 con 0x7f47f80adc60 2024-04-01T16:33:54.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.898+0000 7f47fd400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f80c3230 0x7f47f8156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:54.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.898+0000 7f47fca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f81529e0 0x7f47f80c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:54.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.899+0000 7f47fde00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f80adc60 0x7f47f81f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:54.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.899+0000 7f47fd400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f80c3230 0x7f47f8156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:42798/0 (socket says 172.21.15.163:42798) 2024-04-01T16:33:54.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.899+0000 7f47fd400640 1 -- 172.21.15.163:0/1082507194 learned_addr learned my addr 172.21.15.163:0/1082507194 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:33:54.902 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.902+0000 7f47fd400640 1 -- 172.21.15.163:0/1082507194 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f80adc60 msgr2=0x7f47f81f0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:54.902 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.902+0000 7f47fd400640 1 --2- 172.21.15.163:0/1082507194 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f80adc60 0x7f47f81f0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:54.902 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.902+0000 7f47fd400640 1 -- 172.21.15.163:0/1082507194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f81529e0 msgr2=0x7f47f80c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:54.902 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.902+0000 7f47fd400640 1 --2- 172.21.15.163:0/1082507194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f81529e0 0x7f47f80c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:54.902 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.902+0000 7f47fd400640 1 -- 172.21.15.163:0/1082507194 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f81f4b80 con 0x7f47f80c3230 2024-04-01T16:33:54.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.905+0000 7f47fd400640 1 --2- 172.21.15.163:0/1082507194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f80c3230 0x7f47f8156d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00e8d0 tx=0x7f47ec00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:54.908 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.908+0000 7f47f5600640 1 -- 172.21.15.163:0/1082507194 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec017070 con 0x7f47f80c3230 2024-04-01T16:33:54.908 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.908+0000 7f47f5600640 1 -- 172.21.15.163:0/1082507194 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ec00c940 con 0x7f47f80c3230 2024-04-01T16:33:54.908 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.908+0000 7f47f5600640 1 -- 172.21.15.163:0/1082507194 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00cd30 con 0x7f47f80c3230 2024-04-01T16:33:54.908 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.908+0000 7f47ffe00640 1 -- 172.21.15.163:0/1082507194 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f80b3c90 con 0x7f47f80c3230 2024-04-01T16:33:54.908 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.909+0000 7f47ffe00640 1 -- 172.21.15.163:0/1082507194 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f81f40a0 con 0x7f47f80c3230 2024-04-01T16:33:54.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.910+0000 7f47ffe00640 1 -- 172.21.15.163:0/1082507194 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f80756d0 con 0x7f47f80c3230 2024-04-01T16:33:54.931 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.932+0000 7f47f5600640 1 -- 172.21.15.163:0/1082507194 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f47ec01a070 con 0x7f47f80c3230 2024-04-01T16:33:54.932 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.933+0000 7f47f5600640 1 --2- 172.21.15.163:0/1082507194 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f47dc06c8e0 0x7f47dc06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:54.932 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.933+0000 7f47fca00640 1 --2- 172.21.15.163:0/1082507194 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f47dc06c8e0 0x7f47dc06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:54.933 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.934+0000 7f47f5600640 1 -- 172.21.15.163:0/1082507194 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f47ec058bd0 con 0x7f47f80c3230 2024-04-01T16:33:54.933 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:54.934+0000 7f47fca00640 1 --2- 172.21.15.163:0/1082507194 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f47dc06c8e0 0x7f47dc06eda0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f47e8036000 tx=0x7f47e8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:55.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.223+0000 7f47f5600640 1 -- 172.21.15.163:0/1082507194 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f47ec059f40 con 0x7f47f80c3230 2024-04-01T16:33:55.377 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-04-01T16:33:55.377+0000 7f8888e11640 -1 Falling back to public interface 2024-04-01T16:33:55.378 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-04-01T16:33:55.379+0000 7fc2f8ac6640 -1 Falling back to public interface 2024-04-01T16:33:55.384 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-04-01T16:33:55.383+0000 7f3918d11640 -1 Falling back to public interface 2024-04-01T16:33:55.384 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-04-01T16:33:55.383+0000 7fbd35217640 -1 Falling back to public interface 2024-04-01T16:33:55.387 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-04-01T16:33:55.387+0000 7f0cbdc0e640 -1 Falling back to public interface 2024-04-01T16:33:55.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2024-04-01T16:33:55.394+0000 7f9a9e0a0640 -1 Falling back to public interface 2024-04-01T16:33:55.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-04-01T16:33:55.397+0000 7f91fef8c640 -1 Falling back to public interface 2024-04-01T16:33:55.397 INFO:tasks.ceph.osd.3.smithi163.stderr:2024-04-01T16:33:55.397+0000 7f5556f36640 -1 Falling back to public interface 2024-04-01T16:33:55.447 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.448+0000 7f47ffe00640 1 -- 172.21.15.163:0/1082507194 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47f8159910 con 0x7f47f80c3230 2024-04-01T16:33:55.503 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.503+0000 7f47f5600640 1 -- 172.21.15.163:0/1082507194 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f47ec05e240 con 0x7f47f80c3230 2024-04-01T16:33:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:33:55.503 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":10,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:33:54.255861+0000","last_up_change":"0.000000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:33:55.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.506+0000 7f47ffe00640 1 -- 172.21.15.163:0/1082507194 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f47dc06c8e0 msgr2=0x7f47dc06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:55.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.506+0000 7f47ffe00640 1 --2- 172.21.15.163:0/1082507194 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f47dc06c8e0 0x7f47dc06eda0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f47e8036000 tx=0x7f47e8008030 comp rx=0 tx=0).stop 2024-04-01T16:33:55.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.506+0000 7f47ffe00640 1 -- 172.21.15.163:0/1082507194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f80c3230 msgr2=0x7f47f8156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:55.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.506+0000 7f47ffe00640 1 --2- 172.21.15.163:0/1082507194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f80c3230 0x7f47f8156d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00e8d0 tx=0x7f47ec00ed90 comp rx=0 tx=0).stop 2024-04-01T16:33:55.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.506+0000 7f47ffe00640 1 -- 172.21.15.163:0/1082507194 shutdown_connections 2024-04-01T16:33:55.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.506+0000 7f47ffe00640 1 --2- 172.21.15.163:0/1082507194 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f47dc06c8e0 0x7f47dc06eda0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:55.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.506+0000 7f47ffe00640 1 --2- 172.21.15.163:0/1082507194 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f47f80adc60 0x7f47f81f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:55.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.506+0000 7f47ffe00640 1 --2- 172.21.15.163:0/1082507194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47f81529e0 0x7f47f80c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:55.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.506+0000 7f47ffe00640 1 --2- 172.21.15.163:0/1082507194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f80c3230 0x7f47f8156d80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:55.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.506+0000 7f47ffe00640 1 -- 172.21.15.163:0/1082507194 >> 172.21.15.163:0/1082507194 conn(0x7f47f8067280 msgr2=0x7f47f80cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:55.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.506+0000 7f47ffe00640 1 -- 172.21.15.163:0/1082507194 shutdown_connections 2024-04-01T16:33:55.507 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:33:55.506+0000 7f47ffe00640 1 -- 172.21.15.163:0/1082507194 wait complete. 2024-04-01T16:33:55.522 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-01T16:33:55.522 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-01T16:33:56.330 DEBUG:teuthology.orchestra.run.smithi163:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-01T16:33:56.501 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.502+0000 7fa209a00640 1 Processor -- start 2024-04-01T16:33:56.501 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.502+0000 7fa209a00640 1 -- start start 2024-04-01T16:33:56.503 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.503+0000 7fa209a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa204150f40 0x7fa2040c3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:56.503 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.503+0000 7fa209a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2040c56b0 0x7fa20415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:56.503 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.503+0000 7fa209a00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2040c72c0 con 0x7fa20415a730 2024-04-01T16:33:56.503 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.503+0000 7fa209a00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa204157bd0 con 0x7fa204150f40 2024-04-01T16:33:56.503 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.503+0000 7fa209a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa2040c7560 con 0x7fa2040c56b0 2024-04-01T16:33:56.504 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.505+0000 7fa202a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa204150f40 0x7fa2040c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:56.504 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.505+0000 7fa202000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2040c56b0 0x7fa20415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:56.505 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.506+0000 7fa202000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2040c56b0 0x7fa20415a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:51914/0 (socket says 172.21.15.163:51914) 2024-04-01T16:33:56.505 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.506+0000 7fa202000640 1 -- 172.21.15.163:0/3713488499 learned_addr learned my addr 172.21.15.163:0/3713488499 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:33:56.509 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.510+0000 7fa202000640 1 -- 172.21.15.163:0/3713488499 >> v2:172.21.15.189:3300/0 conn(0x7fa204150f40 msgr2=0x7fa2040c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:33:56.510 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.510+0000 7fa202000640 1 --2- 172.21.15.163:0/3713488499 >> v2:172.21.15.189:3300/0 conn(0x7fa204150f40 0x7fa2040c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:56.510 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.510+0000 7fa202000640 1 -- 172.21.15.163:0/3713488499 >> v1:172.21.15.189:6789/0 conn(0x7fa20415a730 legacy=0x7fa2040c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:56.510 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.510+0000 7fa202000640 1 -- 172.21.15.163:0/3713488499 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa204156e10 con 0x7fa2040c56b0 2024-04-01T16:33:56.513 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.514+0000 7fa202000640 1 --2- 172.21.15.163:0/3713488499 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2040c56b0 0x7fa20415a1f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00d150 tx=0x7fa1ec02e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70581c338fe83cde server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:56.518 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.519+0000 7fa201600640 1 -- 172.21.15.163:0/3713488499 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec034070 con 0x7fa2040c56b0 2024-04-01T16:33:56.518 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.519+0000 7fa201600640 1 -- 172.21.15.163:0/3713488499 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ec038400 con 0x7fa2040c56b0 2024-04-01T16:33:56.519 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.519+0000 7fa201600640 1 -- 172.21.15.163:0/3713488499 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec0387d0 con 0x7fa2040c56b0 2024-04-01T16:33:56.519 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.519+0000 7fa209a00640 1 -- 172.21.15.163:0/3713488499 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2040c56b0 msgr2=0x7fa20415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:56.519 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.519+0000 7fa209a00640 1 --2- 172.21.15.163:0/3713488499 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2040c56b0 0x7fa20415a1f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00d150 tx=0x7fa1ec02e160 comp rx=0 tx=0).stop 2024-04-01T16:33:56.520 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.520+0000 7fa209a00640 1 -- 172.21.15.163:0/3713488499 shutdown_connections 2024-04-01T16:33:56.520 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.520+0000 7fa209a00640 1 --2- 172.21.15.163:0/3713488499 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa2040c56b0 0x7fa20415a1f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:56.520 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.520+0000 7fa209a00640 1 --2- 172.21.15.163:0/3713488499 >> v2:172.21.15.189:3300/0 conn(0x7fa204150f40 0x7fa2040c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:56.520 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.520+0000 7fa209a00640 1 -- 172.21.15.163:0/3713488499 >> 172.21.15.163:0/3713488499 conn(0x7fa20406ea70 msgr2=0x7fa20406ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:56.520 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.520+0000 7fa209a00640 1 -- 172.21.15.163:0/3713488499 shutdown_connections 2024-04-01T16:33:56.520 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.520+0000 7fa209a00640 1 -- 172.21.15.163:0/3713488499 wait complete. 2024-04-01T16:33:56.521 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.521+0000 7fa209a00640 1 Processor -- start 2024-04-01T16:33:56.521 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.522+0000 7fa209a00640 1 -- start start 2024-04-01T16:33:56.522 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.522+0000 7fa209a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa2040c56b0 0x7fa204149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:56.522 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.522+0000 7fa209a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa204150f40 0x7fa2041f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:56.522 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.522+0000 7fa209a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa20415a730 0x7fa2041f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:56.522 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.522+0000 7fa209a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa2041576b0 con 0x7fa2040c56b0 2024-04-01T16:33:56.522 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.522+0000 7fa209a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa2041573d0 con 0x7fa20415a730 2024-04-01T16:33:56.522 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.522+0000 7fa209a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa204151320 con 0x7fa204150f40 2024-04-01T16:33:56.523 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.523+0000 7fa202a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa2040c56b0 0x7fa204149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:56.523 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.523+0000 7fa203400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa20415a730 0x7fa2041f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:56.523 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.524+0000 7fa202000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa204150f40 0x7fa2041f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:56.523 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.524+0000 7fa202a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa2040c56b0 0x7fa204149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:42808/0 (socket says 172.21.15.163:42808) 2024-04-01T16:33:56.524 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.524+0000 7fa202a00640 1 -- 172.21.15.163:0/3575045250 learned_addr learned my addr 172.21.15.163:0/3575045250 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:33:56.527 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.528+0000 7fa203400640 1 -- 172.21.15.163:0/3575045250 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa204150f40 msgr2=0x7fa2041f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:56.527 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.528+0000 7fa203400640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa204150f40 0x7fa2041f0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:56.527 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.528+0000 7fa203400640 1 -- 172.21.15.163:0/3575045250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa2040c56b0 msgr2=0x7fa204149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:56.528 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.528+0000 7fa203400640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa2040c56b0 0x7fa204149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:56.528 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.528+0000 7fa203400640 1 -- 172.21.15.163:0/3575045250 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2040c2da0 con 0x7fa20415a730 2024-04-01T16:33:56.528 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.528+0000 7fa202a00640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa2040c56b0 0x7fa204149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T16:33:56.530 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.531+0000 7fa203400640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa20415a730 0x7fa2041f1250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c3f0 tx=0x7fa1fc00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:56.538 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.539+0000 7fa1faa00640 1 -- 172.21.15.163:0/3575045250 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc017070 con 0x7fa20415a730 2024-04-01T16:33:56.539 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.539+0000 7fa1faa00640 1 -- 172.21.15.163:0/3575045250 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc0052f0 con 0x7fa20415a730 2024-04-01T16:33:56.539 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.539+0000 7fa1faa00640 1 -- 172.21.15.163:0/3575045250 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc003850 con 0x7fa20415a730 2024-04-01T16:33:56.539 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.539+0000 7fa209a00640 1 -- 172.21.15.163:0/3575045250 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20414a6c0 con 0x7fa20415a730 2024-04-01T16:33:56.539 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.539+0000 7fa209a00640 1 -- 172.21.15.163:0/3575045250 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa20414fc30 con 0x7fa20415a730 2024-04-01T16:33:56.539 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.540+0000 7fa209a00640 1 -- 172.21.15.163:0/3575045250 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2040755f0 con 0x7fa20415a730 2024-04-01T16:33:56.864 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.865+0000 7fa1faa00640 1 -- 172.21.15.163:0/3575045250 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fa1fc01a070 con 0x7fa20415a730 2024-04-01T16:33:56.866 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.867+0000 7fa1faa00640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa1e006c8b0 0x7fa1e006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:33:56.866 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.867+0000 7fa202a00640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa1e006c8b0 0x7fa1e006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:33:56.868 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.868+0000 7fa202a00640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa1e006c8b0 0x7fa1e006ed70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40112c0 tx=0x7fa1f4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:33:56.891 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.891+0000 7fa1faa00640 1 -- 172.21.15.163:0/3575045250 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa1fc057bc0 con 0x7fa20415a730 2024-04-01T16:33:56.892 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:56.892+0000 7fa1faa00640 1 -- 172.21.15.163:0/3575045250 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa1fc021020 con 0x7fa20415a730 2024-04-01T16:33:57.109 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.110+0000 7fa209a00640 1 -- 172.21.15.163:0/3575045250 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa20406c1c0 con 0x7fa20415a730 2024-04-01T16:33:57.212 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.213+0000 7fa1faa00640 1 -- 172.21.15.163:0/3575045250 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa1fc05cbb0 con 0x7fa20415a730 2024-04-01T16:33:57.213 INFO:teuthology.misc.health.smithi163.stdout: 2024-04-01T16:33:57.213 INFO:teuthology.misc.health.smithi163.stdout:{"epoch":10,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:33:54.255861+0000","last_up_change":"0.000000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:33:57.216 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.216+0000 7fa209a00640 1 -- 172.21.15.163:0/3575045250 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa1e006c8b0 msgr2=0x7fa1e006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:57.216 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.216+0000 7fa209a00640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa1e006c8b0 0x7fa1e006ed70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40112c0 tx=0x7fa1f4009190 comp rx=0 tx=0).stop 2024-04-01T16:33:57.216 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.216+0000 7fa209a00640 1 -- 172.21.15.163:0/3575045250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa20415a730 msgr2=0x7fa2041f1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:33:57.216 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.216+0000 7fa209a00640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa20415a730 0x7fa2041f1250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c3f0 tx=0x7fa1fc00c8b0 comp rx=0 tx=0).stop 2024-04-01T16:33:57.217 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.217+0000 7fa209a00640 1 -- 172.21.15.163:0/3575045250 shutdown_connections 2024-04-01T16:33:57.217 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.217+0000 7fa209a00640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa1e006c8b0 0x7fa1e006ed70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:57.217 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.217+0000 7fa209a00640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa20415a730 0x7fa2041f1250 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:57.217 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.217+0000 7fa209a00640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa204150f40 0x7fa2041f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:57.217 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.217+0000 7fa209a00640 1 --2- 172.21.15.163:0/3575045250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa2040c56b0 0x7fa204149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:33:57.217 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.217+0000 7fa209a00640 1 -- 172.21.15.163:0/3575045250 >> 172.21.15.163:0/3575045250 conn(0x7fa20406ea70 msgr2=0x7fa2040c31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:33:57.217 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.217+0000 7fa209a00640 1 -- 172.21.15.163:0/3575045250 shutdown_connections 2024-04-01T16:33:57.217 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:33:57.217+0000 7fa209a00640 1 -- 172.21.15.163:0/3575045250 wait complete. 2024-04-01T16:33:57.231 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-01T16:33:58.973 INFO:tasks.ceph.osd.3.smithi163.stderr:2024-04-01T16:33:58.973+0000 7f5556f36640 -1 osd.3 0 log_to_monitors true 2024-04-01T16:33:58.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-04-01T16:33:58.978+0000 7f91fef8c640 -1 osd.1 0 log_to_monitors true 2024-04-01T16:33:58.983 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-04-01T16:33:58.984+0000 7f3918d11640 -1 osd.6 0 log_to_monitors true 2024-04-01T16:33:59.129 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-04-01T16:33:59.130+0000 7fc2f8ac6640 -1 osd.2 0 log_to_monitors true 2024-04-01T16:33:59.139 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-04-01T16:33:59.140+0000 7f8888e11640 -1 osd.5 0 log_to_monitors true 2024-04-01T16:33:59.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2024-04-01T16:33:59.180+0000 7f9a9e0a0640 -1 osd.0 0 log_to_monitors true 2024-04-01T16:33:59.197 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-04-01T16:33:59.198+0000 7f0cbdc0e640 -1 osd.4 0 log_to_monitors true 2024-04-01T16:33:59.220 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-04-01T16:33:59.221+0000 7fbd35217640 -1 osd.7 0 log_to_monitors true 2024-04-01T16:34:01.956 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-04-01T16:34:01.957+0000 7f3913c00640 -1 osd.6 0 waiting for initial osdmap 2024-04-01T16:34:02.009 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-04-01T16:34:02.009+0000 7f3909c00640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T16:34:02.080 INFO:tasks.ceph.osd.3.smithi163.stderr:2024-04-01T16:34:02.081+0000 7f5551e00640 -1 osd.3 0 waiting for initial osdmap 2024-04-01T16:34:02.121 INFO:tasks.ceph.osd.3.smithi163.stderr:2024-04-01T16:34:02.121+0000 7f5547e00640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T16:34:02.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-04-01T16:34:02.137+0000 7f91f9e00640 -1 osd.1 0 waiting for initial osdmap 2024-04-01T16:34:02.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-04-01T16:34:02.167+0000 7f91efe00640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T16:34:02.866 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-04-01T16:34:02.866+0000 7fc2f4400640 -1 osd.2 0 waiting for initial osdmap 2024-04-01T16:34:02.884 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-04-01T16:34:02.885+0000 7fc2e9a00640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T16:34:02.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2024-04-01T16:34:02.893+0000 7f9a99000640 -1 osd.0 0 waiting for initial osdmap 2024-04-01T16:34:03.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2024-04-01T16:34:03.029+0000 7f9a8f000640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T16:34:03.346 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-04-01T16:34:03.347+0000 7fbd2fc00640 -1 osd.7 0 waiting for initial osdmap 2024-04-01T16:34:03.370 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-04-01T16:34:03.371+0000 7f8883600640 -1 osd.5 0 waiting for initial osdmap 2024-04-01T16:34:03.374 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-04-01T16:34:03.376+0000 7f0cb8400640 -1 osd.4 0 waiting for initial osdmap 2024-04-01T16:34:03.391 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-04-01T16:34:03.392+0000 7f0cae400640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T16:34:03.406 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-04-01T16:34:03.407+0000 7f8879600640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T16:34:03.449 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-04-01T16:34:03.450+0000 7fbd25c00640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T16:34:04.038 DEBUG:teuthology.orchestra.run.smithi163:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-01T16:34:04.223 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.223+0000 7fb84ce00640 1 Processor -- start 2024-04-01T16:34:04.224 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.223+0000 7fb84ce00640 1 -- start start 2024-04-01T16:34:04.224 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.225+0000 7fb84ce00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb848154a30 0x7fb84815e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:04.224 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.225+0000 7fb84ce00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8480cc4c0 0x7fb8480c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:04.224 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.225+0000 7fb84ce00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb84815b950 con 0x7fb8480c5610 2024-04-01T16:34:04.224 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.225+0000 7fb84ce00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb84815ee70 con 0x7fb848154a30 2024-04-01T16:34:04.224 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.225+0000 7fb84ce00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb848154e10 con 0x7fb8480cc4c0 2024-04-01T16:34:04.229 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.230+0000 7fb845e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb848154a30 0x7fb84815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:04.229 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.230+0000 7fb845e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb848154a30 0x7fb84815e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46164/0 (socket says 172.21.15.163:46164) 2024-04-01T16:34:04.229 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.230+0000 7fb845e00640 1 -- 172.21.15.163:0/2775939574 learned_addr learned my addr 172.21.15.163:0/2775939574 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:04.232 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.233+0000 7fb845e00640 1 -- 172.21.15.163:0/2775939574 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8480cc4c0 msgr2=0x7fb8480c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:04.233 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.233+0000 7fb845e00640 1 --2- 172.21.15.163:0/2775939574 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8480cc4c0 0x7fb8480c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:04.233 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.233+0000 7fb845e00640 1 -- 172.21.15.163:0/2775939574 >> v1:172.21.15.189:6789/0 conn(0x7fb8480c5610 legacy=0x7fb8480d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:04.233 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.233+0000 7fb845e00640 1 -- 172.21.15.163:0/2775939574 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8480cb4c0 con 0x7fb848154a30 2024-04-01T16:34:04.235 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.236+0000 7fb845e00640 1 --2- 172.21.15.163:0/2775939574 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb848154a30 0x7fb84815e930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb838009870 tx=0x7fb83802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9e504d3eddac8b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:04.242 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.243+0000 7fb844a00640 1 -- 172.21.15.163:0/2775939574 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8380317c0 con 0x7fb848154a30 2024-04-01T16:34:04.242 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.243+0000 7fb844a00640 1 -- 172.21.15.163:0/2775939574 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb838037070 con 0x7fb848154a30 2024-04-01T16:34:04.242 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.243+0000 7fb844a00640 1 -- 172.21.15.163:0/2775939574 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838031b80 con 0x7fb848154a30 2024-04-01T16:34:04.243 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.244+0000 7fb84ce00640 1 -- 172.21.15.163:0/2775939574 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb848154a30 msgr2=0x7fb84815e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:04.244 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.244+0000 7fb84ce00640 1 --2- 172.21.15.163:0/2775939574 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb848154a30 0x7fb84815e930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb838009870 tx=0x7fb83802b860 comp rx=0 tx=0).stop 2024-04-01T16:34:04.244 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.244+0000 7fb84ce00640 1 -- 172.21.15.163:0/2775939574 shutdown_connections 2024-04-01T16:34:04.244 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.244+0000 7fb84ce00640 1 --2- 172.21.15.163:0/2775939574 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8480cc4c0 0x7fb8480c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:04.244 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.244+0000 7fb84ce00640 1 --2- 172.21.15.163:0/2775939574 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb848154a30 0x7fb84815e930 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:04.244 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.244+0000 7fb84ce00640 1 -- 172.21.15.163:0/2775939574 >> 172.21.15.163:0/2775939574 conn(0x7fb84806d1d0 msgr2=0x7fb84808c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:04.244 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.244+0000 7fb84ce00640 1 -- 172.21.15.163:0/2775939574 shutdown_connections 2024-04-01T16:34:04.244 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.244+0000 7fb84ce00640 1 -- 172.21.15.163:0/2775939574 wait complete. 2024-04-01T16:34:04.246 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.246+0000 7fb84ce00640 1 Processor -- start 2024-04-01T16:34:04.246 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.247+0000 7fb84ce00640 1 -- start start 2024-04-01T16:34:04.247 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.248+0000 7fb84ce00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8480c5610 0x7fb8481f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:04.247 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.248+0000 7fb84ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8480cc4c0 0x7fb8480b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:04.247 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.248+0000 7fb84ce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb848154a30 0x7fb8480c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:04.247 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.248+0000 7fb84ce00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb84815b150 con 0x7fb848154a30 2024-04-01T16:34:04.247 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.248+0000 7fb84ce00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb84815ae70 con 0x7fb8480cc4c0 2024-04-01T16:34:04.248 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.248+0000 7fb84ce00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb84815b430 con 0x7fb8480c5610 2024-04-01T16:34:04.248 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.248+0000 7fb846800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb848154a30 0x7fb8480c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:04.248 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.249+0000 7fb846800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb848154a30 0x7fb8480c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46166/0 (socket says 172.21.15.163:46166) 2024-04-01T16:34:04.248 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.249+0000 7fb846800640 1 -- 172.21.15.163:0/2397725909 learned_addr learned my addr 172.21.15.163:0/2397725909 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:04.252 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.252+0000 7fb846800640 1 -- 172.21.15.163:0/2397725909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8480c5610 msgr2=0x7fb8481f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:04.252 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.252+0000 7fb846800640 1 --2- 172.21.15.163:0/2397725909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8480c5610 0x7fb8481f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:04.252 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.252+0000 7fb846800640 1 -- 172.21.15.163:0/2397725909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8480cc4c0 msgr2=0x7fb8480b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:04.252 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.252+0000 7fb846800640 1 --2- 172.21.15.163:0/2397725909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8480cc4c0 0x7fb8480b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:04.252 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.253+0000 7fb846800640 1 -- 172.21.15.163:0/2397725909 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8480cf3f0 con 0x7fb848154a30 2024-04-01T16:34:04.254 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.255+0000 7fb846800640 1 --2- 172.21.15.163:0/2397725909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb848154a30 0x7fb8480c73f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb84000b990 tx=0x7fb84000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:04.258 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.259+0000 7fb83e000640 1 -- 172.21.15.163:0/2397725909 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb840019070 con 0x7fb848154a30 2024-04-01T16:34:04.258 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.259+0000 7fb83e000640 1 -- 172.21.15.163:0/2397725909 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84000cb40 con 0x7fb848154a30 2024-04-01T16:34:04.258 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.259+0000 7fb83e000640 1 -- 172.21.15.163:0/2397725909 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb840014440 con 0x7fb848154a30 2024-04-01T16:34:04.259 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.259+0000 7fb84ce00640 1 -- 172.21.15.163:0/2397725909 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8480cf6b0 con 0x7fb848154a30 2024-04-01T16:34:04.259 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.259+0000 7fb84ce00640 1 -- 172.21.15.163:0/2397725909 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8481f3ac0 con 0x7fb848154a30 2024-04-01T16:34:04.259 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.260+0000 7fb84ce00640 1 -- 172.21.15.163:0/2397725909 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8480755f0 con 0x7fb848154a30 2024-04-01T16:34:04.562 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.563+0000 7fb83e000640 1 -- 172.21.15.163:0/2397725909 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fb840003970 con 0x7fb848154a30 2024-04-01T16:34:04.563 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.564+0000 7fb83e000640 1 --2- 172.21.15.163:0/2397725909 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb82806c8e0 0x7fb82806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:04.564 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.565+0000 7fb845e00640 1 --2- 172.21.15.163:0/2397725909 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb82806c8e0 0x7fb82806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:04.566 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.566+0000 7fb845e00640 1 --2- 172.21.15.163:0/2397725909 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb82806c8e0 0x7fb82806eda0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb838036000 tx=0x7fb838030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:04.600 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.601+0000 7fb83e000640 1 -- 172.21.15.163:0/2397725909 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3071+0+0 (secure 0 0 0) 0x7fb840057720 con 0x7fb848154a30 2024-04-01T16:34:04.601 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.602+0000 7fb83e000640 1 -- 172.21.15.163:0/2397725909 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb840059d80 con 0x7fb848154a30 2024-04-01T16:34:04.837 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:04.838+0000 7fb84ce00640 1 -- 172.21.15.163:0/2397725909 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8480cbc20 con 0x7fb848154a30 2024-04-01T16:34:05.018 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.018+0000 7fb83e000640 1 -- 172.21.15.163:0/2397725909 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8539 (secure 0 0 0) 0x7fb840059680 con 0x7fb848154a30 2024-04-01T16:34:05.018 INFO:teuthology.misc.health.smithi163.stdout: 2024-04-01T16:34:05.018 INFO:teuthology.misc.health.smithi163.stdout:{"epoch":14,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:02.777281+0000","last_up_change":"2024-04-01T16:34:02.777281+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:34:05.021 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.021+0000 7fb84ce00640 1 -- 172.21.15.163:0/2397725909 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb82806c8e0 msgr2=0x7fb82806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:05.021 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.021+0000 7fb84ce00640 1 --2- 172.21.15.163:0/2397725909 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb82806c8e0 0x7fb82806eda0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb838036000 tx=0x7fb838030000 comp rx=0 tx=0).stop 2024-04-01T16:34:05.021 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.021+0000 7fb84ce00640 1 -- 172.21.15.163:0/2397725909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb848154a30 msgr2=0x7fb8480c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:05.021 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.021+0000 7fb84ce00640 1 --2- 172.21.15.163:0/2397725909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb848154a30 0x7fb8480c73f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb84000b990 tx=0x7fb84000be50 comp rx=0 tx=0).stop 2024-04-01T16:34:05.021 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.022+0000 7fb84ce00640 1 -- 172.21.15.163:0/2397725909 shutdown_connections 2024-04-01T16:34:05.021 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.022+0000 7fb84ce00640 1 --2- 172.21.15.163:0/2397725909 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb82806c8e0 0x7fb82806eda0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:05.022 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.022+0000 7fb84ce00640 1 --2- 172.21.15.163:0/2397725909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb848154a30 0x7fb8480c73f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:05.022 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.022+0000 7fb84ce00640 1 --2- 172.21.15.163:0/2397725909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8480cc4c0 0x7fb8480b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:05.022 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.022+0000 7fb84ce00640 1 --2- 172.21.15.163:0/2397725909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb8480c5610 0x7fb8481f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:05.022 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.022+0000 7fb84ce00640 1 -- 172.21.15.163:0/2397725909 >> 172.21.15.163:0/2397725909 conn(0x7fb84806d1d0 msgr2=0x7fb8480c6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:05.022 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.022+0000 7fb84ce00640 1 -- 172.21.15.163:0/2397725909 shutdown_connections 2024-04-01T16:34:05.022 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:05.022+0000 7fb84ce00640 1 -- 172.21.15.163:0/2397725909 wait complete. 2024-04-01T16:34:05.038 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-04-01T16:34:11.845 DEBUG:teuthology.orchestra.run.smithi163:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-01T16:34:12.025 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.024+0000 7f7290800640 1 Processor -- start 2024-04-01T16:34:12.025 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.024+0000 7f7290800640 1 -- start start 2024-04-01T16:34:12.027 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.026+0000 7f7290800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f72880ce220 0x7f728815b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:12.027 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.026+0000 7f7290800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f728815b870 con 0x7f72880c8f00 2024-04-01T16:34:12.027 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.026+0000 7f7290800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f728815e230 con 0x7f72880ce600 2024-04-01T16:34:12.027 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.026+0000 7f7290800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f72880ca5c0 con 0x7f72880ce220 2024-04-01T16:34:12.028 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.028+0000 7f728d400640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f72880ce600 0x7f7288154730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:55200/0 (socket says 172.21.15.163:55200) 2024-04-01T16:34:12.028 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.028+0000 7f728d400640 1 -- 172.21.15.163:0/69928452 learned_addr learned my addr 172.21.15.163:0/69928452 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:12.036 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.036+0000 7f728ca00640 1 -- 172.21.15.163:0/69928452 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342000550 0 0) 0x7f728815e230 con 0x7f72880ce600 2024-04-01T16:34:12.037 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.036+0000 7f728ca00640 1 -- 172.21.15.163:0/69928452 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7270003520 con 0x7f72880ce600 2024-04-01T16:34:12.061 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.060+0000 7f728de00640 1 --2- 172.21.15.163:0/69928452 >> v2:172.21.15.163:3300/0 conn(0x7f72880ce220 0x7f728815b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:12.071 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.071+0000 7f728de00640 1 -- 172.21.15.163:0/69928452 >> v1:172.21.15.189:6789/0 conn(0x7f72880ce600 legacy=0x7f7288154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:12.071 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.071+0000 7f728de00640 1 -- 172.21.15.163:0/69928452 >> v1:172.21.15.163:6789/0 conn(0x7f72880c8f00 legacy=0x7f72880caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:12.071 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.071+0000 7f728de00640 1 -- 172.21.15.163:0/69928452 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728815e510 con 0x7f72880ce220 2024-04-01T16:34:12.080 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.080+0000 7f728de00640 1 --2- 172.21.15.163:0/69928452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72880ce220 0x7f728815b330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f727c0097a0 tx=0x7f727c02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3793d001b42be2e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:12.528 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.527+0000 7f728ca00640 1 -- 172.21.15.163:0/69928452 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c02f810 con 0x7f72880ce220 2024-04-01T16:34:12.529 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.528+0000 7f728ca00640 1 -- 172.21.15.163:0/69928452 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727c02f9b0 con 0x7f72880ce220 2024-04-01T16:34:12.529 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.528+0000 7f728ca00640 1 -- 172.21.15.163:0/69928452 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c02fd80 con 0x7f72880ce220 2024-04-01T16:34:12.529 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.529+0000 7f7290800640 1 -- 172.21.15.163:0/69928452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72880ce220 msgr2=0x7f728815b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:12.530 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.529+0000 7f7290800640 1 --2- 172.21.15.163:0/69928452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72880ce220 0x7f728815b330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f727c0097a0 tx=0x7f727c02b9f0 comp rx=0 tx=0).stop 2024-04-01T16:34:12.530 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.529+0000 7f7290800640 1 -- 172.21.15.163:0/69928452 shutdown_connections 2024-04-01T16:34:12.530 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.529+0000 7f7290800640 1 --2- 172.21.15.163:0/69928452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72880ce220 0x7f728815b330 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:12.530 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.529+0000 7f7290800640 1 -- 172.21.15.163:0/69928452 >> 172.21.15.163:0/69928452 conn(0x7f7288070620 msgr2=0x7f7288071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:12.531 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.529+0000 7f7290800640 1 -- 172.21.15.163:0/69928452 shutdown_connections 2024-04-01T16:34:12.531 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.530+0000 7f7290800640 1 -- 172.21.15.163:0/69928452 wait complete. 2024-04-01T16:34:12.535 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.534+0000 7f7290800640 1 Processor -- start 2024-04-01T16:34:12.535 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.535+0000 7f7290800640 1 -- start start 2024-04-01T16:34:12.537 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.536+0000 7f7290800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72880c8f00 0x7f7288156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:12.537 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.536+0000 7f7290800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72880ce220 0x7f72881f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:12.537 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.536+0000 7f7290800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72880ce600 0x7f728806d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:12.537 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.536+0000 7f7290800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f728815edb0 con 0x7f72880ce220 2024-04-01T16:34:12.537 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.536+0000 7f7290800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f728815ead0 con 0x7f72880c8f00 2024-04-01T16:34:12.538 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.536+0000 7f7290800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f728815dea0 con 0x7f72880ce600 2024-04-01T16:34:12.539 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.538+0000 7f728de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72880c8f00 0x7f7288156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:12.539 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.538+0000 7f728e800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72880ce600 0x7f728806d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:12.539 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.539+0000 7f728de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72880c8f00 0x7f7288156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:34888/0 (socket says 172.21.15.163:34888) 2024-04-01T16:34:12.540 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.539+0000 7f728e800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72880ce600 0x7f728806d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:46192/0 (socket says 172.21.15.163:46192) 2024-04-01T16:34:12.540 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.539+0000 7f728de00640 1 -- 172.21.15.163:0/2132127577 learned_addr learned my addr 172.21.15.163:0/2132127577 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:12.549 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.549+0000 7f728de00640 1 -- 172.21.15.163:0/2132127577 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72880ce600 msgr2=0x7f728806d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:12.550 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.549+0000 7f728de00640 1 --2- 172.21.15.163:0/2132127577 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72880ce600 0x7f728806d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:12.550 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.549+0000 7f728de00640 1 -- 172.21.15.163:0/2132127577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72880ce220 msgr2=0x7f72881f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:12.550 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.549+0000 7f728de00640 1 --2- 172.21.15.163:0/2132127577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72880ce220 0x7f72881f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:12.550 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.549+0000 7f728de00640 1 -- 172.21.15.163:0/2132127577 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728814e3f0 con 0x7f72880c8f00 2024-04-01T16:34:12.564 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.564+0000 7f728de00640 1 --2- 172.21.15.163:0/2132127577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72880c8f00 0x7f7288156c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f727c02c000 tx=0x7f727c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:12.589 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.589+0000 7f7282000640 1 -- 172.21.15.163:0/2132127577 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c0378d0 con 0x7f72880c8f00 2024-04-01T16:34:12.589 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.589+0000 7f7282000640 1 -- 172.21.15.163:0/2132127577 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727c037a70 con 0x7f72880c8f00 2024-04-01T16:34:12.589 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.589+0000 7f7282000640 1 -- 172.21.15.163:0/2132127577 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c037e60 con 0x7f72880c8f00 2024-04-01T16:34:12.589 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.589+0000 7f7290800640 1 -- 172.21.15.163:0/2132127577 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7288157bc0 con 0x7f72880c8f00 2024-04-01T16:34:12.589 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.589+0000 7f7290800640 1 -- 172.21.15.163:0/2132127577 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7288158160 con 0x7f72880c8f00 2024-04-01T16:34:12.590 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.590+0000 7f7290800640 1 -- 172.21.15.163:0/2132127577 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72880c33c0 con 0x7f72880c8f00 2024-04-01T16:34:12.925 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.925+0000 7f7282000640 1 -- 172.21.15.163:0/2132127577 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f727c040070 con 0x7f72880c8f00 2024-04-01T16:34:12.927 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.926+0000 7f7282000640 1 --2- 172.21.15.163:0/2132127577 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f726c06c940 0x7f726c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:12.928 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.927+0000 7f728d400640 1 --2- 172.21.15.163:0/2132127577 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f726c06c940 0x7f726c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:12.929 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.929+0000 7f728d400640 1 --2- 172.21.15.163:0/2132127577 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f726c06c940 0x7f726c06ee00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f728814e610 tx=0x7f72780078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:12.941 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.941+0000 7f7282000640 1 -- 172.21.15.163:0/2132127577 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f727c082690 con 0x7f72880c8f00 2024-04-01T16:34:12.971 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:12.971+0000 7f7282000640 1 -- 172.21.15.163:0/2132127577 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f72880c33c0 con 0x7f72880c8f00 2024-04-01T16:34:13.208 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.207+0000 7f7290800640 1 -- 172.21.15.163:0/2132127577 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72880c9a60 con 0x7f72880c8f00 2024-04-01T16:34:13.912 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.911+0000 7f7282000640 1 -- 172.21.15.163:0/2132127577 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12932 (secure 0 0 0) 0x7f727c033030 con 0x7f72880c8f00 2024-04-01T16:34:13.912 INFO:teuthology.misc.health.smithi163.stdout: 2024-04-01T16:34:13.913 INFO:teuthology.misc.health.smithi163.stdout:{"epoch":18,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:08.789893+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:34:13.916 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.915+0000 7f7290800640 1 -- 172.21.15.163:0/2132127577 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f726c06c940 msgr2=0x7f726c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:13.916 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.915+0000 7f7290800640 1 --2- 172.21.15.163:0/2132127577 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f726c06c940 0x7f726c06ee00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f728814e610 tx=0x7f72780078f0 comp rx=0 tx=0).stop 2024-04-01T16:34:13.916 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.915+0000 7f7290800640 1 -- 172.21.15.163:0/2132127577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72880c8f00 msgr2=0x7f7288156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:13.917 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.915+0000 7f7290800640 1 --2- 172.21.15.163:0/2132127577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72880c8f00 0x7f7288156c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f727c02c000 tx=0x7f727c0046c0 comp rx=0 tx=0).stop 2024-04-01T16:34:13.917 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.915+0000 7f7290800640 1 -- 172.21.15.163:0/2132127577 shutdown_connections 2024-04-01T16:34:13.917 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.915+0000 7f7290800640 1 --2- 172.21.15.163:0/2132127577 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f726c06c940 0x7f726c06ee00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:13.917 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.915+0000 7f7290800640 1 --2- 172.21.15.163:0/2132127577 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f72880ce600 0x7f728806d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:13.917 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.915+0000 7f7290800640 1 --2- 172.21.15.163:0/2132127577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72880ce220 0x7f72881f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:13.917 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.915+0000 7f7290800640 1 --2- 172.21.15.163:0/2132127577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72880c8f00 0x7f7288156c40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:13.917 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.916+0000 7f7290800640 1 -- 172.21.15.163:0/2132127577 >> 172.21.15.163:0/2132127577 conn(0x7f7288070620 msgr2=0x7f728815b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:13.917 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.916+0000 7f7290800640 1 -- 172.21.15.163:0/2132127577 shutdown_connections 2024-04-01T16:34:13.917 INFO:teuthology.misc.health.smithi163.stderr:2024-04-01T16:34:13.916+0000 7f7290800640 1 -- 172.21.15.163:0/2132127577 wait complete. 2024-04-01T16:34:13.933 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-01T16:34:13.933 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-01T16:34:13.933 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-01T16:34:13.934 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-01T16:34:13.934 DEBUG:teuthology.orchestra.run.smithi163:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-04-01T16:34:13.940 INFO:tasks.ceph.mds.a:Started 2024-04-01T16:34:13.940 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-01T16:34:13.940 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-01T16:34:13.940 DEBUG:teuthology.orchestra.run.smithi163:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-04-01T16:34:13.947 INFO:tasks.ceph.mds.c:Started 2024-04-01T16:34:13.947 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-01T16:34:13.947 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-01T16:34:13.947 DEBUG:teuthology.orchestra.run.smithi163:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-04-01T16:34:13.954 INFO:tasks.ceph.mds.e:Started 2024-04-01T16:34:13.955 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-01T16:34:13.955 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-01T16:34:13.955 DEBUG:teuthology.orchestra.run.smithi189:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-04-01T16:34:13.963 INFO:tasks.ceph.mds.b:Started 2024-04-01T16:34:13.963 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-01T16:34:13.963 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-01T16:34:13.963 DEBUG:teuthology.orchestra.run.smithi189:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-04-01T16:34:13.970 INFO:tasks.ceph.mds.d:Started 2024-04-01T16:34:13.971 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-01T16:34:13.971 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-01T16:34:13.971 DEBUG:teuthology.orchestra.run.smithi189:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-04-01T16:34:13.976 INFO:tasks.ceph.mds.f:Started 2024-04-01T16:34:13.976 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-01T16:34:13.976 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T16:34:14.055 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:34:14.062 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:34:14.204 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.203+0000 7f86f0400640 1 Processor -- start 2024-04-01T16:34:14.204 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.203+0000 7f86f0400640 1 -- start start 2024-04-01T16:34:14.205 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.204+0000 7f86f0400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f86e80c6b30 0x7f86e815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:14.205 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.205+0000 7f86f0400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f86e8071ee0 0x7f86e815bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:14.205 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.205+0000 7f86f0400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86e80737f0 con 0x7f86e8152830 2024-04-01T16:34:14.205 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.205+0000 7f86f0400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f86e8152c10 con 0x7f86e8071ee0 2024-04-01T16:34:14.205 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.205+0000 7f86f0400640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f86e80c72d0 con 0x7f86e80c6b30 2024-04-01T16:34:14.206 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.206+0000 7f86ee400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f86e8071ee0 0x7f86e815bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:14.206 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.206+0000 7f86ed000640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f86e80c6b30 0x7f86e815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:14.206 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.206+0000 7f86ed000640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f86e80c6b30 0x7f86e815ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:34908/0 (socket says 172.21.15.163:34908) 2024-04-01T16:34:14.207 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.206+0000 7f86eda00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f86e8152830 0x7f86e8072900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:45618/0 (socket says 172.21.15.163:45618) 2024-04-01T16:34:14.207 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.206+0000 7f86ed000640 1 -- 172.21.15.163:0/3693554377 learned_addr learned my addr 172.21.15.163:0/3693554377 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:14.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.209+0000 7f86ed000640 1 -- 172.21.15.163:0/3693554377 >> v2:172.21.15.163:3300/0 conn(0x7f86e8071ee0 msgr2=0x7f86e815bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:14.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.209+0000 7f86ed000640 1 --2- 172.21.15.163:0/3693554377 >> v2:172.21.15.163:3300/0 conn(0x7f86e8071ee0 0x7f86e815bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:14.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.209+0000 7f86ed000640 1 -- 172.21.15.163:0/3693554377 >> v1:172.21.15.163:6789/0 conn(0x7f86e8152830 legacy=0x7f86e8072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:14.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.209+0000 7f86ed000640 1 -- 172.21.15.163:0/3693554377 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e80c75b0 con 0x7f86e80c6b30 2024-04-01T16:34:14.212 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.212+0000 7f86ed000640 1 --2- 172.21.15.163:0/3693554377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86e80c6b30 0x7f86e815ba50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f86e8156070 tx=0x7f86d402b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1884bbb10295859 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:14.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.219+0000 7f86e7e00640 1 -- 172.21.15.163:0/3693554377 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4034070 con 0x7f86e80c6b30 2024-04-01T16:34:14.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.219+0000 7f86e7e00640 1 -- 172.21.15.163:0/3693554377 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d4030870 con 0x7f86e80c6b30 2024-04-01T16:34:14.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.219+0000 7f86e7e00640 1 -- 172.21.15.163:0/3693554377 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4030c40 con 0x7f86e80c6b30 2024-04-01T16:34:14.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.220+0000 7f86f0400640 1 -- 172.21.15.163:0/3693554377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86e80c6b30 msgr2=0x7f86e815ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:14.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.220+0000 7f86f0400640 1 --2- 172.21.15.163:0/3693554377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86e80c6b30 0x7f86e815ba50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f86e8156070 tx=0x7f86d402b9b0 comp rx=0 tx=0).stop 2024-04-01T16:34:14.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.220+0000 7f86f0400640 1 -- 172.21.15.163:0/3693554377 shutdown_connections 2024-04-01T16:34:14.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.220+0000 7f86f0400640 1 --2- 172.21.15.163:0/3693554377 >> v2:172.21.15.163:3300/0 conn(0x7f86e8071ee0 0x7f86e815bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:14.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.220+0000 7f86f0400640 1 --2- 172.21.15.163:0/3693554377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86e80c6b30 0x7f86e815ba50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:14.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.220+0000 7f86f0400640 1 -- 172.21.15.163:0/3693554377 >> 172.21.15.163:0/3693554377 conn(0x7f86e80cbe20 msgr2=0x7f86e80cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:14.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.220+0000 7f86f0400640 1 -- 172.21.15.163:0/3693554377 shutdown_connections 2024-04-01T16:34:14.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.220+0000 7f86f0400640 1 -- 172.21.15.163:0/3693554377 wait complete. 2024-04-01T16:34:14.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.222+0000 7f86f0400640 1 Processor -- start 2024-04-01T16:34:14.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.222+0000 7f86f0400640 1 -- start start 2024-04-01T16:34:14.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.223+0000 7f86f0400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e8071ee0 0x7f86e81f02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:14.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.223+0000 7f86f0400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86e80c6b30 0x7f86e8072b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:14.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.223+0000 7f86f0400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86e8152830 0x7f86e81e2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:14.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.223+0000 7f86f0400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f86e8073a90 con 0x7f86e8071ee0 2024-04-01T16:34:14.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.223+0000 7f86f0400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f86e80c7b70 con 0x7f86e80c6b30 2024-04-01T16:34:14.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.223+0000 7f86f0400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f86e80707f0 con 0x7f86e8152830 2024-04-01T16:34:14.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.224+0000 7f86eda00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e8071ee0 0x7f86e81f02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:14.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.224+0000 7f86ed000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86e80c6b30 0x7f86e8072b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:14.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.224+0000 7f86eda00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e8071ee0 0x7f86e81f02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:51302/0 (socket says 172.21.15.163:51302) 2024-04-01T16:34:14.226 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.224+0000 7f86eda00640 1 -- 172.21.15.163:0/1693769686 learned_addr learned my addr 172.21.15.163:0/1693769686 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:14.226 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.225+0000 7f86ee400640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86e8152830 0x7f86e81e2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:14.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.228+0000 7f86eda00640 1 -- 172.21.15.163:0/1693769686 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86e8152830 msgr2=0x7f86e81e2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:14.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.229+0000 7f86eda00640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86e8152830 0x7f86e81e2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:14.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.229+0000 7f86eda00640 1 -- 172.21.15.163:0/1693769686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86e80c6b30 msgr2=0x7f86e8072b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:14.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.229+0000 7f86eda00640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86e80c6b30 0x7f86e8072b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:14.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.229+0000 7f86eda00640 1 -- 172.21.15.163:0/1693769686 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e81f09d0 con 0x7f86e8071ee0 2024-04-01T16:34:14.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.232+0000 7f86eda00640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e8071ee0 0x7f86e81f02d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c400 tx=0x7f86dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:14.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.237+0000 7f86e5600640 1 -- 172.21.15.163:0/1693769686 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0074e0 con 0x7f86e8071ee0 2024-04-01T16:34:14.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.238+0000 7f86e5600640 1 -- 172.21.15.163:0/1693769686 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86dc007680 con 0x7f86e8071ee0 2024-04-01T16:34:14.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.238+0000 7f86e5600640 1 -- 172.21.15.163:0/1693769686 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc004a00 con 0x7f86e8071ee0 2024-04-01T16:34:14.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.238+0000 7f86f0400640 1 -- 172.21.15.163:0/1693769686 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e81f0c70 con 0x7f86e8071ee0 2024-04-01T16:34:14.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.238+0000 7f86f0400640 1 -- 172.21.15.163:0/1693769686 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e81f1230 con 0x7f86e8071ee0 2024-04-01T16:34:14.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.239+0000 7f86f0400640 1 -- 172.21.15.163:0/1693769686 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e80756d0 con 0x7f86e8071ee0 2024-04-01T16:34:14.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.277+0000 7f86e5600640 1 -- 172.21.15.163:0/1693769686 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86dc01a020 con 0x7f86e8071ee0 2024-04-01T16:34:14.278 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.278+0000 7f86e5600640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f86c806c970 0x7f86c806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:14.278 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.278+0000 7f86ed000640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f86c806c970 0x7f86c806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:14.279 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.279+0000 7f86ed000640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f86c806c970 0x7f86c806ee30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f86d4036000 tx=0x7f86d4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:14.284 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.284+0000 7f86e5600640 1 -- 172.21.15.163:0/1693769686 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f86dc057830 con 0x7f86e8071ee0 2024-04-01T16:34:14.575 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.574+0000 7f86e5600640 1 -- 172.21.15.163:0/1693769686 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f86dc021070 con 0x7f86e8071ee0 2024-04-01T16:34:14.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.779+0000 7f86f0400640 1 -- 172.21.15.163:0/1693769686 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86e80b19e0 con 0x7f86e8071ee0 2024-04-01T16:34:14.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.906+0000 7f86e5600640 1 -- 172.21.15.163:0/1693769686 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12932 (secure 0 0 0) 0x7f86dc059790 con 0x7f86e8071ee0 2024-04-01T16:34:14.907 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:14.907 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":18,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:08.789893+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:34:14.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.909+0000 7f86f0400640 1 -- 172.21.15.163:0/1693769686 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f86c806c970 msgr2=0x7f86c806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:14.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.909+0000 7f86f0400640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f86c806c970 0x7f86c806ee30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f86d4036000 tx=0x7f86d4008030 comp rx=0 tx=0).stop 2024-04-01T16:34:14.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.909+0000 7f86f0400640 1 -- 172.21.15.163:0/1693769686 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e8071ee0 msgr2=0x7f86e81f02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:14.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.909+0000 7f86f0400640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e8071ee0 0x7f86e81f02d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c400 tx=0x7f86dc00c8c0 comp rx=0 tx=0).stop 2024-04-01T16:34:14.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.910+0000 7f86f0400640 1 -- 172.21.15.163:0/1693769686 shutdown_connections 2024-04-01T16:34:14.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.910+0000 7f86f0400640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f86c806c970 0x7f86c806ee30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:14.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.910+0000 7f86f0400640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86e8152830 0x7f86e81e2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:14.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.910+0000 7f86f0400640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86e80c6b30 0x7f86e8072b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:14.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.910+0000 7f86f0400640 1 --2- 172.21.15.163:0/1693769686 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e8071ee0 0x7f86e81f02d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:14.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.910+0000 7f86f0400640 1 -- 172.21.15.163:0/1693769686 >> 172.21.15.163:0/1693769686 conn(0x7f86e80cbe20 msgr2=0x7f86e8151b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:14.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.911+0000 7f86f0400640 1 -- 172.21.15.163:0/1693769686 shutdown_connections 2024-04-01T16:34:14.912 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:14.911+0000 7f86f0400640 1 -- 172.21.15.163:0/1693769686 wait complete. 2024-04-01T16:34:14.931 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T16:34:05.291874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T16:34:14.931 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T16:34:15.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.209+0000 7ff68bc00640 1 Processor -- start 2024-04-01T16:34:15.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.209+0000 7ff68bc00640 1 -- start start 2024-04-01T16:34:15.212 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.211+0000 7ff68bc00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff6840cd4c0 0x7ff68415a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:15.212 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.211+0000 7ff68bc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68406c590 con 0x7ff6840cd0e0 2024-04-01T16:34:15.212 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.211+0000 7ff68bc00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68406c850 con 0x7ff684154c60 2024-04-01T16:34:15.212 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.211+0000 7ff68bc00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff68406cb30 con 0x7ff6840cd4c0 2024-04-01T16:34:15.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.213+0000 7ff683e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff6840cd4c0 0x7ff68415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:15.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.213+0000 7ff689c00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ff684154c60 0x7ff6840cbae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:55216/0 (socket says 172.21.15.163:55216) 2024-04-01T16:34:15.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.213+0000 7ff689c00640 1 -- 172.21.15.163:0/3370683651 learned_addr learned my addr 172.21.15.163:0/3370683651 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:15.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.223+0000 7ff683e00640 1 -- 172.21.15.163:0/3370683651 >> v1:172.21.15.189:6789/0 conn(0x7ff684154c60 legacy=0x7ff6840cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:15.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.223+0000 7ff683e00640 1 -- 172.21.15.163:0/3370683651 >> v1:172.21.15.163:6789/0 conn(0x7ff6840cd0e0 legacy=0x7ff684154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:15.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.223+0000 7ff683e00640 1 -- 172.21.15.163:0/3370683651 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68406ce10 con 0x7ff6840cd4c0 2024-04-01T16:34:15.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.231+0000 7ff683e00640 1 --2- 172.21.15.163:0/3370683651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6840cd4c0 0x7ff68415a740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff6700097d0 tx=0x7ff67002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=686f4c33242bd31c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:15.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.239+0000 7ff683400640 1 -- 172.21.15.163:0/3370683651 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6700315a0 con 0x7ff6840cd4c0 2024-04-01T16:34:15.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.239+0000 7ff683400640 1 -- 172.21.15.163:0/3370683651 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff670037070 con 0x7ff6840cd4c0 2024-04-01T16:34:15.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.239+0000 7ff683400640 1 -- 172.21.15.163:0/3370683651 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670031960 con 0x7ff6840cd4c0 2024-04-01T16:34:15.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.240+0000 7ff68bc00640 1 -- 172.21.15.163:0/3370683651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6840cd4c0 msgr2=0x7ff68415a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:15.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.240+0000 7ff68bc00640 1 --2- 172.21.15.163:0/3370683651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6840cd4c0 0x7ff68415a740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff6700097d0 tx=0x7ff67002b840 comp rx=0 tx=0).stop 2024-04-01T16:34:15.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.240+0000 7ff68bc00640 1 -- 172.21.15.163:0/3370683651 shutdown_connections 2024-04-01T16:34:15.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.240+0000 7ff68bc00640 1 --2- 172.21.15.163:0/3370683651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff6840cd4c0 0x7ff68415a740 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:15.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.240+0000 7ff68bc00640 1 -- 172.21.15.163:0/3370683651 >> 172.21.15.163:0/3370683651 conn(0x7ff684067460 msgr2=0x7ff684067870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:15.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.240+0000 7ff68bc00640 1 -- 172.21.15.163:0/3370683651 shutdown_connections 2024-04-01T16:34:15.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.240+0000 7ff68bc00640 1 -- 172.21.15.163:0/3370683651 wait complete. 2024-04-01T16:34:15.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.243+0000 7ff68bc00640 1 Processor -- start 2024-04-01T16:34:15.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.243+0000 7ff68bc00640 1 -- start start 2024-04-01T16:34:15.245 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.244+0000 7ff68bc00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6840cd0e0 0x7ff68415a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:15.245 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.244+0000 7ff68bc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6840cd4c0 0x7ff6840b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:15.245 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.244+0000 7ff68bc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff684154c60 0x7ff6841f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:15.245 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.244+0000 7ff68bc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff6840cc1f0 con 0x7ff6840cd4c0 2024-04-01T16:34:15.245 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.244+0000 7ff68bc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff68406d3d0 con 0x7ff684154c60 2024-04-01T16:34:15.245 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.244+0000 7ff68bc00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff6840cc370 con 0x7ff6840cd0e0 2024-04-01T16:34:15.246 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.246+0000 7ff689c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff684154c60 0x7ff6841f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:15.246 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.246+0000 7ff689200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6840cd0e0 0x7ff68415a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:15.247 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.247+0000 7ff689200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6840cd0e0 0x7ff68415a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:46210/0 (socket says 172.21.15.163:46210) 2024-04-01T16:34:15.247 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.247+0000 7ff689200640 1 -- 172.21.15.163:0/137701102 learned_addr learned my addr 172.21.15.163:0/137701102 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:15.256 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.256+0000 7ff683e00640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6840cd4c0 0x7ff6840b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:15.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.256+0000 7ff689200640 1 -- 172.21.15.163:0/137701102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff684154c60 msgr2=0x7ff6841f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:15.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.256+0000 7ff689200640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff684154c60 0x7ff6841f3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:15.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.256+0000 7ff689200640 1 -- 172.21.15.163:0/137701102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6840cd4c0 msgr2=0x7ff6840b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:15.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.256+0000 7ff689200640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6840cd4c0 0x7ff6840b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:15.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.256+0000 7ff689200640 1 -- 172.21.15.163:0/137701102 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6840cf9e0 con 0x7ff6840cd0e0 2024-04-01T16:34:15.265 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.264+0000 7ff689200640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6840cd0e0 0x7ff68415a1d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff67800b3e0 tx=0x7ff67800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:15.353 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.352+0000 7ff680c00640 1 -- 172.21.15.163:0/137701102 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678015020 con 0x7ff6840cd0e0 2024-04-01T16:34:15.353 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.352+0000 7ff680c00640 1 -- 172.21.15.163:0/137701102 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff678011850 con 0x7ff6840cd0e0 2024-04-01T16:34:15.353 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.352+0000 7ff680c00640 1 -- 172.21.15.163:0/137701102 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678011c40 con 0x7ff6840cd0e0 2024-04-01T16:34:15.353 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.352+0000 7ff68bc00640 1 -- 172.21.15.163:0/137701102 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff684155680 con 0x7ff6840cd0e0 2024-04-01T16:34:15.353 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.352+0000 7ff68bc00640 1 -- 172.21.15.163:0/137701102 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6840cf390 con 0x7ff6840cd0e0 2024-04-01T16:34:15.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.354+0000 7ff68bc00640 1 -- 172.21.15.163:0/137701102 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff684073bb0 con 0x7ff6840cd0e0 2024-04-01T16:34:15.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.390+0000 7ff680c00640 1 -- 172.21.15.163:0/137701102 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff678018020 con 0x7ff6840cd0e0 2024-04-01T16:34:15.391 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.391+0000 7ff680c00640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff66406c8f0 0x7ff66406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:15.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.391+0000 7ff683e00640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff66406c8f0 0x7ff66406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:15.393 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.393+0000 7ff683e00640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff66406c8f0 0x7ff66406edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff670036000 tx=0x7ff670008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:15.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.396+0000 7ff680c00640 1 -- 172.21.15.163:0/137701102 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff678011de0 con 0x7ff6840cd0e0 2024-04-01T16:34:15.686 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.686+0000 7ff680c00640 1 -- 172.21.15.163:0/137701102 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff67801f020 con 0x7ff6840cd0e0 2024-04-01T16:34:15.921 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.920+0000 7ff68bc00640 1 -- 172.21.15.163:0/137701102 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff68415b1a0 con 0x7ff6840cd0e0 2024-04-01T16:34:15.959 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.958+0000 7ff680c00640 1 -- 172.21.15.163:0/137701102 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7ff67805a4a0 con 0x7ff6840cd0e0 2024-04-01T16:34:15.959 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2024-04-01T16:34:15.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.961+0000 7ff68bc00640 1 -- 172.21.15.163:0/137701102 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff66406c8f0 msgr2=0x7ff66406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:15.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.961+0000 7ff68bc00640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff66406c8f0 0x7ff66406edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff670036000 tx=0x7ff670008030 comp rx=0 tx=0).stop 2024-04-01T16:34:15.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.961+0000 7ff68bc00640 1 -- 172.21.15.163:0/137701102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6840cd0e0 msgr2=0x7ff68415a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:15.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.961+0000 7ff68bc00640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6840cd0e0 0x7ff68415a1d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff67800b3e0 tx=0x7ff67800b8a0 comp rx=0 tx=0).stop 2024-04-01T16:34:15.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.962+0000 7ff68bc00640 1 -- 172.21.15.163:0/137701102 shutdown_connections 2024-04-01T16:34:15.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.962+0000 7ff68bc00640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff66406c8f0 0x7ff66406edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:15.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.962+0000 7ff68bc00640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff684154c60 0x7ff6841f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:15.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.962+0000 7ff68bc00640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6840cd4c0 0x7ff6840b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:15.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.962+0000 7ff68bc00640 1 --2- 172.21.15.163:0/137701102 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff6840cd0e0 0x7ff68415a1d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:15.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.962+0000 7ff68bc00640 1 -- 172.21.15.163:0/137701102 >> 172.21.15.163:0/137701102 conn(0x7ff684067460 msgr2=0x7ff684067840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:15.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.962+0000 7ff68bc00640 1 -- 172.21.15.163:0/137701102 shutdown_connections 2024-04-01T16:34:15.964 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:15.962+0000 7ff68bc00640 1 -- 172.21.15.163:0/137701102 wait complete. 2024-04-01T16:34:15.988 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T16:34:16.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.169+0000 7fb396800640 1 Processor -- start 2024-04-01T16:34:16.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.169+0000 7fb396800640 1 -- start start 2024-04-01T16:34:16.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.170+0000 7fb396800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb390152830 0x7fb390072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:16.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.171+0000 7fb396800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb39015c160 0x7fb390072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:16.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.171+0000 7fb396800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3900737f0 con 0x7fb3900c6b30 2024-04-01T16:34:16.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.171+0000 7fb396800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb390152c10 con 0x7fb390152830 2024-04-01T16:34:16.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.171+0000 7fb396800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb3900c72d0 con 0x7fb39015c160 2024-04-01T16:34:16.172 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.171+0000 7fb38f400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb390152830 0x7fb390072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:16.172 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.172+0000 7fb38f400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb390152830 0x7fb390072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:51320/0 (socket says 172.21.15.163:51320) 2024-04-01T16:34:16.172 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.172+0000 7fb38f400640 1 -- 172.21.15.163:0/1638275315 learned_addr learned my addr 172.21.15.163:0/1638275315 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:16.173 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.172+0000 7fb38fe00640 1 --2- 172.21.15.163:0/1638275315 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb39015c160 0x7fb390072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:16.176 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.175+0000 7fb38f400640 1 -- 172.21.15.163:0/1638275315 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb39015c160 msgr2=0x7fb390072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:16.176 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.175+0000 7fb38f400640 1 --2- 172.21.15.163:0/1638275315 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb39015c160 0x7fb390072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:16.176 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.175+0000 7fb38f400640 1 -- 172.21.15.163:0/1638275315 >> v1:172.21.15.189:6789/0 conn(0x7fb3900c6b30 legacy=0x7fb39015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:16.176 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.175+0000 7fb38f400640 1 -- 172.21.15.163:0/1638275315 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3900c75b0 con 0x7fb390152830 2024-04-01T16:34:16.178 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.178+0000 7fb38f400640 1 --2- 172.21.15.163:0/1638275315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb390152830 0x7fb390072900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb380009870 tx=0x7fb38002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d857b37dea36cad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:16.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.183+0000 7fb38e000640 1 -- 172.21.15.163:0/1638275315 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380034070 con 0x7fb390152830 2024-04-01T16:34:16.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.183+0000 7fb38e000640 1 -- 172.21.15.163:0/1638275315 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb380030840 con 0x7fb390152830 2024-04-01T16:34:16.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.183+0000 7fb38e000640 1 -- 172.21.15.163:0/1638275315 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380030c10 con 0x7fb390152830 2024-04-01T16:34:16.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.184+0000 7fb396800640 1 -- 172.21.15.163:0/1638275315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb390152830 msgr2=0x7fb390072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:16.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.184+0000 7fb396800640 1 --2- 172.21.15.163:0/1638275315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb390152830 0x7fb390072900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb380009870 tx=0x7fb38002b980 comp rx=0 tx=0).stop 2024-04-01T16:34:16.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.184+0000 7fb396800640 1 -- 172.21.15.163:0/1638275315 shutdown_connections 2024-04-01T16:34:16.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.184+0000 7fb396800640 1 --2- 172.21.15.163:0/1638275315 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb39015c160 0x7fb390072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:16.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.184+0000 7fb396800640 1 --2- 172.21.15.163:0/1638275315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb390152830 0x7fb390072900 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:16.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.184+0000 7fb396800640 1 -- 172.21.15.163:0/1638275315 >> 172.21.15.163:0/1638275315 conn(0x7fb3900cbe20 msgr2=0x7fb3900cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:16.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.184+0000 7fb396800640 1 -- 172.21.15.163:0/1638275315 shutdown_connections 2024-04-01T16:34:16.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.184+0000 7fb396800640 1 -- 172.21.15.163:0/1638275315 wait complete. 2024-04-01T16:34:16.186 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.186+0000 7fb396800640 1 Processor -- start 2024-04-01T16:34:16.186 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.186+0000 7fb396800640 1 -- start start 2024-04-01T16:34:16.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.187+0000 7fb396800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3900c6b30 0x7fb3901e25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:16.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.187+0000 7fb396800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb390152830 0x7fb3901e1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:16.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.187+0000 7fb396800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb39006f510 0x7fb390149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:16.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.187+0000 7fb396800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb390073a90 con 0x7fb3900c6b30 2024-04-01T16:34:16.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.187+0000 7fb396800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb3900c7b70 con 0x7fb390152830 2024-04-01T16:34:16.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.187+0000 7fb396800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb3900707f0 con 0x7fb39006f510 2024-04-01T16:34:16.189 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.188+0000 7fb38f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3900c6b30 0x7fb3901e25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:16.189 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.188+0000 7fb38f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3900c6b30 0x7fb3901e25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:51324/0 (socket says 172.21.15.163:51324) 2024-04-01T16:34:16.189 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.188+0000 7fb38f400640 1 -- 172.21.15.163:0/1505627890 learned_addr learned my addr 172.21.15.163:0/1505627890 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:16.189 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.189+0000 7fb38fe00640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb39006f510 0x7fb390149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:16.192 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.192+0000 7fb38ea00640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb390152830 0x7fb3901e1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:16.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.194+0000 7fb38f400640 1 -- 172.21.15.163:0/1505627890 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb39006f510 msgr2=0x7fb390149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:16.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.194+0000 7fb38f400640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb39006f510 0x7fb390149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:16.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.194+0000 7fb38f400640 1 -- 172.21.15.163:0/1505627890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb390152830 msgr2=0x7fb3901e1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:16.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.194+0000 7fb38f400640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb390152830 0x7fb3901e1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:16.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.194+0000 7fb38f400640 1 -- 172.21.15.163:0/1505627890 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3901e2db0 con 0x7fb3900c6b30 2024-04-01T16:34:16.199 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.199+0000 7fb38f400640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3900c6b30 0x7fb3901e25a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb380009990 tx=0x7fb380004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:16.207 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.206+0000 7fb387400640 1 -- 172.21.15.163:0/1505627890 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380048070 con 0x7fb3900c6b30 2024-04-01T16:34:16.208 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.206+0000 7fb387400640 1 -- 172.21.15.163:0/1505627890 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb380030640 con 0x7fb3900c6b30 2024-04-01T16:34:16.208 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.207+0000 7fb387400640 1 -- 172.21.15.163:0/1505627890 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380034040 con 0x7fb3900c6b30 2024-04-01T16:34:16.208 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.207+0000 7fb396800640 1 -- 172.21.15.163:0/1505627890 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3901f01b0 con 0x7fb3900c6b30 2024-04-01T16:34:16.208 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.207+0000 7fb396800640 1 -- 172.21.15.163:0/1505627890 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3901f0470 con 0x7fb3900c6b30 2024-04-01T16:34:16.209 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.208+0000 7fb396800640 1 -- 172.21.15.163:0/1505627890 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3900756d0 con 0x7fb3900c6b30 2024-04-01T16:34:16.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.491+0000 7fb387400640 1 -- 172.21.15.163:0/1505627890 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb38004b070 con 0x7fb3900c6b30 2024-04-01T16:34:16.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.493+0000 7fb387400640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb37006c970 0x7fb37006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:16.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.493+0000 7fb38ea00640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb37006c970 0x7fb37006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:16.494 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.494+0000 7fb38ea00640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb37006c970 0x7fb37006ee30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb3900c6980 tx=0x7fb37c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:16.521 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.520+0000 7fb387400640 1 -- 172.21.15.163:0/1505627890 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fb3800307f0 con 0x7fb3900c6b30 2024-04-01T16:34:16.521 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.521+0000 7fb387400640 1 -- 172.21.15.163:0/1505627890 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb380052020 con 0x7fb3900c6b30 2024-04-01T16:34:16.769 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.769+0000 7fb396800640 1 -- 172.21.15.163:0/1505627890 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb390072ea0 con 0x7fb3900c6b30 2024-04-01T16:34:16.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.788+0000 7fb387400640 1 -- 172.21.15.163:0/1505627890 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7fb38007bcd0 con 0x7fb3900c6b30 2024-04-01T16:34:16.788 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:16.788 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-01T16:34:16.788 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 1 2024-04-01T16:34:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.791+0000 7fb396800640 1 -- 172.21.15.163:0/1505627890 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb37006c970 msgr2=0x7fb37006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.791+0000 7fb396800640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb37006c970 0x7fb37006ee30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb3900c6980 tx=0x7fb37c009040 comp rx=0 tx=0).stop 2024-04-01T16:34:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.791+0000 7fb396800640 1 -- 172.21.15.163:0/1505627890 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3900c6b30 msgr2=0x7fb3901e25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.791+0000 7fb396800640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3900c6b30 0x7fb3901e25a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb380009990 tx=0x7fb380004730 comp rx=0 tx=0).stop 2024-04-01T16:34:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.792+0000 7fb396800640 1 -- 172.21.15.163:0/1505627890 shutdown_connections 2024-04-01T16:34:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.792+0000 7fb396800640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb37006c970 0x7fb37006ee30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.792+0000 7fb396800640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb39006f510 0x7fb390149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.792+0000 7fb396800640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb390152830 0x7fb3901e1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.792+0000 7fb396800640 1 --2- 172.21.15.163:0/1505627890 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3900c6b30 0x7fb3901e25a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.792+0000 7fb396800640 1 -- 172.21.15.163:0/1505627890 >> 172.21.15.163:0/1505627890 conn(0x7fb3900cbe20 msgr2=0x7fb3900ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.792+0000 7fb396800640 1 -- 172.21.15.163:0/1505627890 shutdown_connections 2024-04-01T16:34:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:16.792+0000 7fb396800640 1 -- 172.21.15.163:0/1505627890 wait complete. 2024-04-01T16:34:18.808 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T16:34:18.978 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.979+0000 7ff0c4800640 1 Processor -- start 2024-04-01T16:34:18.978 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.979+0000 7ff0c4800640 1 -- start start 2024-04-01T16:34:18.979 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.980+0000 7ff0c4800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff0bc152420 0x7ff0bc0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:18.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.980+0000 7ff0c4800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0bc152800 0x7ff0bc15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:18.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.980+0000 7ff0c4800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0bc0cb750 con 0x7ff0bc0c89a0 2024-04-01T16:34:18.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.980+0000 7ff0c4800640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff0bc159100 con 0x7ff0bc152420 2024-04-01T16:34:18.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.980+0000 7ff0c4800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff0bc1587d0 con 0x7ff0bc152800 2024-04-01T16:34:18.981 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.981+0000 7ff0c1e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff0bc152420 0x7ff0bc0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:18.981 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.982+0000 7ff0c1400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0bc152800 0x7ff0bc15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:18.981 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.982+0000 7ff0c1e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff0bc152420 0x7ff0bc0ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:34936/0 (socket says 172.21.15.163:34936) 2024-04-01T16:34:18.982 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.982+0000 7ff0c1e00640 1 -- 172.21.15.163:0/1882093550 learned_addr learned my addr 172.21.15.163:0/1882093550 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:18.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.986+0000 7ff0c1400640 1 -- 172.21.15.163:0/1882093550 >> v2:172.21.15.189:3300/0 conn(0x7ff0bc152420 msgr2=0x7ff0bc0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:18.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.986+0000 7ff0c1400640 1 --2- 172.21.15.163:0/1882093550 >> v2:172.21.15.189:3300/0 conn(0x7ff0bc152420 0x7ff0bc0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:18.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.986+0000 7ff0c1400640 1 -- 172.21.15.163:0/1882093550 >> v1:172.21.15.189:6789/0 conn(0x7ff0bc0c89a0 legacy=0x7ff0bc071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:18.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.986+0000 7ff0c1400640 1 -- 172.21.15.163:0/1882093550 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc158ab0 con 0x7ff0bc152800 2024-04-01T16:34:18.989 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.990+0000 7ff0c1400640 1 --2- 172.21.15.163:0/1882093550 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0bc152800 0x7ff0bc15bbb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0097a0 tx=0x7ff0ac02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a1e713200baa114 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:18.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.997+0000 7ff0c0a00640 1 -- 172.21.15.163:0/1882093550 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac034070 con 0x7ff0bc152800 2024-04-01T16:34:18.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.998+0000 7ff0c0a00640 1 -- 172.21.15.163:0/1882093550 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ac030800 con 0x7ff0bc152800 2024-04-01T16:34:18.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.998+0000 7ff0c0a00640 1 -- 172.21.15.163:0/1882093550 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac030bd0 con 0x7ff0bc152800 2024-04-01T16:34:18.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.998+0000 7ff0c4800640 1 -- 172.21.15.163:0/1882093550 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0bc152800 msgr2=0x7ff0bc15bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:18.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.998+0000 7ff0c4800640 1 --2- 172.21.15.163:0/1882093550 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0bc152800 0x7ff0bc15bbb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0097a0 tx=0x7ff0ac02b940 comp rx=0 tx=0).stop 2024-04-01T16:34:18.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.999+0000 7ff0c4800640 1 -- 172.21.15.163:0/1882093550 shutdown_connections 2024-04-01T16:34:18.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.999+0000 7ff0c4800640 1 --2- 172.21.15.163:0/1882093550 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0bc152800 0x7ff0bc15bbb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:18.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.999+0000 7ff0c4800640 1 --2- 172.21.15.163:0/1882093550 >> v2:172.21.15.189:3300/0 conn(0x7ff0bc152420 0x7ff0bc0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:18.999 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.999+0000 7ff0c4800640 1 -- 172.21.15.163:0/1882093550 >> 172.21.15.163:0/1882093550 conn(0x7ff0bc0713b0 msgr2=0x7ff0bc06fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:18.999 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.999+0000 7ff0c4800640 1 -- 172.21.15.163:0/1882093550 shutdown_connections 2024-04-01T16:34:18.999 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:18.999+0000 7ff0c4800640 1 -- 172.21.15.163:0/1882093550 wait complete. 2024-04-01T16:34:19.000 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.001+0000 7ff0c4800640 1 Processor -- start 2024-04-01T16:34:19.000 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.001+0000 7ff0c4800640 1 -- start start 2024-04-01T16:34:19.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.002+0000 7ff0c4800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff0bc0c89a0 0x7ff0bc1e2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:19.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.002+0000 7ff0c4800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0bc152420 0x7ff0bc0b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:19.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.002+0000 7ff0c4800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0bc1e46f0 0x7ff0bc06c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:19.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.002+0000 7ff0c4800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc0cb380 con 0x7ff0bc0c89a0 2024-04-01T16:34:19.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.002+0000 7ff0c4800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc0c9740 con 0x7ff0bc152420 2024-04-01T16:34:19.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.002+0000 7ff0c4800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff0bc0cb500 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.004+0000 7ff0c2800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0bc1e46f0 0x7ff0bc06c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:19.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.004+0000 7ff0c1400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0bc152420 0x7ff0bc0b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:19.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.004+0000 7ff0c1400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0bc152420 0x7ff0bc0b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:34942/0 (socket says 172.21.15.163:34942) 2024-04-01T16:34:19.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.004+0000 7ff0c1400640 1 -- 172.21.15.163:0/3635455005 learned_addr learned my addr 172.21.15.163:0/3635455005 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:19.009 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.010+0000 7ff0c2800640 1 -- 172.21.15.163:0/3635455005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0bc152420 msgr2=0x7ff0bc0b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:19.010 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.010+0000 7ff0c2800640 1 --2- 172.21.15.163:0/3635455005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0bc152420 0x7ff0bc0b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:19.010 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.010+0000 7ff0c2800640 1 -- 172.21.15.163:0/3635455005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff0bc0c89a0 msgr2=0x7ff0bc1e2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:19.010 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.010+0000 7ff0c2800640 1 --2- 172.21.15.163:0/3635455005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff0bc0c89a0 0x7ff0bc1e2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:19.010 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.010+0000 7ff0c2800640 1 -- 172.21.15.163:0/3635455005 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc1e2870 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.014+0000 7ff0c2800640 1 --2- 172.21.15.163:0/3635455005 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0bc1e46f0 0x7ff0bc06c750 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800c730 tx=0x7ff0b800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:19.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.020+0000 7ff0b6000640 1 -- 172.21.15.163:0/3635455005 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8003b70 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.020+0000 7ff0b6000640 1 -- 172.21.15.163:0/3635455005 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b8003d10 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.020+0000 7ff0b6000640 1 -- 172.21.15.163:0/3635455005 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8005310 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.020+0000 7ff0c4800640 1 -- 172.21.15.163:0/3635455005 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0bc1f0480 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.020+0000 7ff0c4800640 1 -- 172.21.15.163:0/3635455005 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0bc1f0a40 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.021 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.022+0000 7ff0c4800640 1 -- 172.21.15.163:0/3635455005 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0bc0756d0 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.320 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.320+0000 7ff0b6000640 1 -- 172.21.15.163:0/3635455005 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0b80054b0 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.321 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.322+0000 7ff0b6000640 1 --2- 172.21.15.163:0/3635455005 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff0a006c940 0x7ff0a006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:19.321 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.322+0000 7ff0c1e00640 1 --2- 172.21.15.163:0/3635455005 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff0a006c940 0x7ff0a006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:19.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.323+0000 7ff0c1e00640 1 --2- 172.21.15.163:0/3635455005 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff0a006c940 0x7ff0a006ee00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00094a0 tx=0x7ff0b00093f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:19.323 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.324+0000 7ff0b6000640 1 -- 172.21.15.163:0/3635455005 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff0b80057a0 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.343 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.344+0000 7ff0b6000640 1 -- 172.21.15.163:0/3635455005 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff0b805a720 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.587 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.587+0000 7ff0c4800640 1 -- 172.21.15.163:0/3635455005 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0bc06ffc0 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.616+0000 7ff0b6000640 1 -- 172.21.15.163:0/3635455005 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7ff0b805a020 con 0x7ff0bc1e46f0 2024-04-01T16:34:19.615 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:19.616 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-01T16:34:19.616 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 1 2024-04-01T16:34:19.619 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.619+0000 7ff0c4800640 1 -- 172.21.15.163:0/3635455005 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff0a006c940 msgr2=0x7ff0a006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:19.619 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.619+0000 7ff0c4800640 1 --2- 172.21.15.163:0/3635455005 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff0a006c940 0x7ff0a006ee00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00094a0 tx=0x7ff0b00093f0 comp rx=0 tx=0).stop 2024-04-01T16:34:19.619 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.619+0000 7ff0c4800640 1 -- 172.21.15.163:0/3635455005 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0bc1e46f0 msgr2=0x7ff0bc06c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:19.619 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.619+0000 7ff0c4800640 1 --2- 172.21.15.163:0/3635455005 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0bc1e46f0 0x7ff0bc06c750 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800c730 tx=0x7ff0b800cbf0 comp rx=0 tx=0).stop 2024-04-01T16:34:19.619 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.619+0000 7ff0c4800640 1 -- 172.21.15.163:0/3635455005 shutdown_connections 2024-04-01T16:34:19.619 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.619+0000 7ff0c4800640 1 --2- 172.21.15.163:0/3635455005 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff0a006c940 0x7ff0a006ee00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:19.619 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.619+0000 7ff0c4800640 1 --2- 172.21.15.163:0/3635455005 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff0bc1e46f0 0x7ff0bc06c750 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:19.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.619+0000 7ff0c4800640 1 --2- 172.21.15.163:0/3635455005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0bc152420 0x7ff0bc0b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:19.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.619+0000 7ff0c4800640 1 --2- 172.21.15.163:0/3635455005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff0bc0c89a0 0x7ff0bc1e2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:19.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.619+0000 7ff0c4800640 1 -- 172.21.15.163:0/3635455005 >> 172.21.15.163:0/3635455005 conn(0x7ff0bc0713b0 msgr2=0x7ff0bc1516e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:19.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.619+0000 7ff0c4800640 1 -- 172.21.15.163:0/3635455005 shutdown_connections 2024-04-01T16:34:19.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:19.619+0000 7ff0c4800640 1 -- 172.21.15.163:0/3635455005 wait complete. 2024-04-01T16:34:21.037 INFO:tasks.ceph.mds.e.smithi163.stdout:starting mds.e at 2024-04-01T16:34:21.146 INFO:tasks.ceph.mds.a.smithi163.stdout:starting mds.a at 2024-04-01T16:34:21.155 INFO:tasks.ceph.mds.c.smithi163.stdout:starting mds.c at 2024-04-01T16:34:21.167 INFO:tasks.ceph.mds.b.smithi189.stdout:starting mds.b at 2024-04-01T16:34:21.168 INFO:tasks.ceph.mds.d.smithi189.stdout:starting mds.d at 2024-04-01T16:34:21.202 INFO:tasks.ceph.mds.f.smithi189.stdout:starting mds.f at 2024-04-01T16:34:21.645 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T16:34:21.835 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.836+0000 7f6e64400640 1 Processor -- start 2024-04-01T16:34:21.836 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.836+0000 7f6e64400640 1 -- start start 2024-04-01T16:34:21.837 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.837+0000 7f6e64400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6e5c151970 0x7f6e5c0c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:21.837 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.837+0000 7f6e64400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6e5c0c1f30 0x7f6e5c157580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:21.837 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.837+0000 7f6e64400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e5c157ac0 0x7f6e5c157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:21.837 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.837+0000 7f6e64400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f6e5c151d50 con 0x7f6e5c0c1f30 2024-04-01T16:34:21.837 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.837+0000 7f6e64400640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6e5c070140 con 0x7f6e5c151970 2024-04-01T16:34:21.837 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.837+0000 7f6e64400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5c158450 con 0x7f6e5c157ac0 2024-04-01T16:34:21.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.844+0000 7f6e61000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6e5c0c1f30 0x7f6e5c157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:21.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.844+0000 7f6e61000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6e5c0c1f30 0x7f6e5c157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:41430/0 (socket says 172.21.15.163:41430) 2024-04-01T16:34:21.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.844+0000 7f6e61000640 1 -- 172.21.15.163:0/2317116311 learned_addr learned my addr 172.21.15.163:0/2317116311 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:21.846 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.847+0000 7f6e61000640 1 -- 172.21.15.163:0/2317116311 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e5c157ac0 msgr2=0x7f6e5c157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:21.846 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.847+0000 7f6e61000640 1 --2- 172.21.15.163:0/2317116311 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e5c157ac0 0x7f6e5c157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:21.846 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.847+0000 7f6e61000640 1 -- 172.21.15.163:0/2317116311 >> v2:172.21.15.189:3300/0 conn(0x7f6e5c151970 msgr2=0x7f6e5c0c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:21.846 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.847+0000 7f6e61000640 1 --2- 172.21.15.163:0/2317116311 >> v2:172.21.15.189:3300/0 conn(0x7f6e5c151970 0x7f6e5c0c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:21.846 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.847+0000 7f6e61000640 1 -- 172.21.15.163:0/2317116311 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c06f4d0 con 0x7f6e5c0c1f30 2024-04-01T16:34:21.848 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.849+0000 7f6e61000640 1 --2- 172.21.15.163:0/2317116311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e5c0c1f30 0x7f6e5c157580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c071a50 tx=0x7f6e4802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba14d2be7213415 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:21.852 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.853+0000 7f6e5be00640 1 -- 172.21.15.163:0/2317116311 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e48034070 con 0x7f6e5c0c1f30 2024-04-01T16:34:21.852 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.853+0000 7f6e5be00640 1 -- 172.21.15.163:0/2317116311 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e48030860 con 0x7f6e5c0c1f30 2024-04-01T16:34:21.853 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.853+0000 7f6e5be00640 1 -- 172.21.15.163:0/2317116311 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e48030c30 con 0x7f6e5c0c1f30 2024-04-01T16:34:21.853 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.854+0000 7f6e64400640 1 -- 172.21.15.163:0/2317116311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e5c0c1f30 msgr2=0x7f6e5c157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:21.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.854+0000 7f6e64400640 1 --2- 172.21.15.163:0/2317116311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e5c0c1f30 0x7f6e5c157580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c071a50 tx=0x7f6e4802b9a0 comp rx=0 tx=0).stop 2024-04-01T16:34:21.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.854+0000 7f6e64400640 1 -- 172.21.15.163:0/2317116311 shutdown_connections 2024-04-01T16:34:21.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.854+0000 7f6e64400640 1 --2- 172.21.15.163:0/2317116311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e5c0c1f30 0x7f6e5c157580 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:21.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.854+0000 7f6e64400640 1 --2- 172.21.15.163:0/2317116311 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e5c157ac0 0x7f6e5c157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:21.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.854+0000 7f6e64400640 1 --2- 172.21.15.163:0/2317116311 >> v2:172.21.15.189:3300/0 conn(0x7f6e5c151970 0x7f6e5c0c39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:21.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.854+0000 7f6e64400640 1 -- 172.21.15.163:0/2317116311 >> 172.21.15.163:0/2317116311 conn(0x7f6e5c06c650 msgr2=0x7f6e5c06ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:21.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.854+0000 7f6e64400640 1 -- 172.21.15.163:0/2317116311 shutdown_connections 2024-04-01T16:34:21.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.854+0000 7f6e64400640 1 -- 172.21.15.163:0/2317116311 wait complete. 2024-04-01T16:34:21.855 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.856+0000 7f6e64400640 1 Processor -- start 2024-04-01T16:34:21.855 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.856+0000 7f6e64400640 1 -- start start 2024-04-01T16:34:21.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.857+0000 7f6e64400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c0c1f30 0x7f6e5c0c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:21.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.857+0000 7f6e64400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e5c151970 0x7f6e5c0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:21.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.857+0000 7f6e64400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e5c157ac0 0x7f6e5c143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:21.857 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.857+0000 7f6e64400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c06ef10 con 0x7f6e5c157ac0 2024-04-01T16:34:21.857 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.857+0000 7f6e64400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c0c7b30 con 0x7f6e5c0c1f30 2024-04-01T16:34:21.857 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.857+0000 7f6e64400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5c06f1f0 con 0x7f6e5c151970 2024-04-01T16:34:21.857 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.858+0000 7f6e62400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e5c157ac0 0x7f6e5c143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:21.857 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.858+0000 7f6e62400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e5c157ac0 0x7f6e5c143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:41434/0 (socket says 172.21.15.163:41434) 2024-04-01T16:34:21.857 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.858+0000 7f6e62400640 1 -- 172.21.15.163:0/483852059 learned_addr learned my addr 172.21.15.163:0/483852059 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:21.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.862+0000 7f6e62400640 1 -- 172.21.15.163:0/483852059 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e5c151970 msgr2=0x7f6e5c0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:21.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.862+0000 7f6e62400640 1 --2- 172.21.15.163:0/483852059 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e5c151970 0x7f6e5c0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:21.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.862+0000 7f6e62400640 1 -- 172.21.15.163:0/483852059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c0c1f30 msgr2=0x7f6e5c0c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:21.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.862+0000 7f6e62400640 1 --2- 172.21.15.163:0/483852059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c0c1f30 0x7f6e5c0c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:21.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.862+0000 7f6e62400640 1 -- 172.21.15.163:0/483852059 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c157330 con 0x7f6e5c157ac0 2024-04-01T16:34:21.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.864+0000 7f6e62400640 1 --2- 172.21.15.163:0/483852059 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e5c157ac0 0x7f6e5c143260 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400b970 tx=0x7f6e5400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:21.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.869+0000 7f6e59600640 1 -- 172.21.15.163:0/483852059 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54019070 con 0x7f6e5c157ac0 2024-04-01T16:34:21.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.869+0000 7f6e59600640 1 -- 172.21.15.163:0/483852059 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5400cb60 con 0x7f6e5c157ac0 2024-04-01T16:34:21.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.869+0000 7f6e59600640 1 -- 172.21.15.163:0/483852059 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54014440 con 0x7f6e5c157ac0 2024-04-01T16:34:21.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.869+0000 7f6e64400640 1 -- 172.21.15.163:0/483852059 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5c1575f0 con 0x7f6e5c157ac0 2024-04-01T16:34:21.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.869+0000 7f6e64400640 1 -- 172.21.15.163:0/483852059 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e5c0c3cb0 con 0x7f6e5c157ac0 2024-04-01T16:34:21.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.870+0000 7f6e64400640 1 -- 172.21.15.163:0/483852059 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e5c0756d0 con 0x7f6e5c157ac0 2024-04-01T16:34:21.893 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.893+0000 7f6e59600640 1 -- 172.21.15.163:0/483852059 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e5401c070 con 0x7f6e5c157ac0 2024-04-01T16:34:21.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.894+0000 7f6e59600640 1 --2- 172.21.15.163:0/483852059 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6e3c06c940 0x7f6e3c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:21.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.895+0000 7f6e61a00640 1 --2- 172.21.15.163:0/483852059 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6e3c06c940 0x7f6e3c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:21.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:21.896+0000 7f6e61a00640 1 --2- 172.21.15.163:0/483852059 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6e3c06c940 0x7f6e3c06ee00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009710 tx=0x7f6e50006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:22.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.165+0000 7f6e59600640 1 -- 172.21.15.163:0/483852059 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f6e540602e0 con 0x7f6e5c157ac0 2024-04-01T16:34:22.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.167+0000 7f6e59600640 1 -- 172.21.15.163:0/483852059 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6e54023020 con 0x7f6e5c157ac0 2024-04-01T16:34:22.409 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.410+0000 7f6e64400640 1 -- 172.21.15.163:0/483852059 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e5c06faa0 con 0x7f6e5c157ac0 2024-04-01T16:34:22.427 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.427+0000 7f6e59600640 1 -- 172.21.15.163:0/483852059 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f6e5405a140 con 0x7f6e5c157ac0 2024-04-01T16:34:22.427 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:22.427 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/220229466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":220229466},{"type":"v1","addr":"172.21.15.189:6834","nonce":220229466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-01T16:34:22.428 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 2 2024-04-01T16:34:22.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.430+0000 7f6e64400640 1 -- 172.21.15.163:0/483852059 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6e3c06c940 msgr2=0x7f6e3c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:22.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.430+0000 7f6e64400640 1 --2- 172.21.15.163:0/483852059 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6e3c06c940 0x7f6e3c06ee00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009710 tx=0x7f6e50006c90 comp rx=0 tx=0).stop 2024-04-01T16:34:22.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.430+0000 7f6e64400640 1 -- 172.21.15.163:0/483852059 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e5c157ac0 msgr2=0x7f6e5c143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:22.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.430+0000 7f6e64400640 1 --2- 172.21.15.163:0/483852059 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e5c157ac0 0x7f6e5c143260 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400b970 tx=0x7f6e5400be30 comp rx=0 tx=0).stop 2024-04-01T16:34:22.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.430+0000 7f6e64400640 1 -- 172.21.15.163:0/483852059 shutdown_connections 2024-04-01T16:34:22.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.430+0000 7f6e64400640 1 --2- 172.21.15.163:0/483852059 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6e3c06c940 0x7f6e3c06ee00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:22.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.430+0000 7f6e64400640 1 --2- 172.21.15.163:0/483852059 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e5c157ac0 0x7f6e5c143260 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:22.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.430+0000 7f6e64400640 1 --2- 172.21.15.163:0/483852059 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e5c151970 0x7f6e5c0c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:22.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.430+0000 7f6e64400640 1 --2- 172.21.15.163:0/483852059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c0c1f30 0x7f6e5c0c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:22.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.430+0000 7f6e64400640 1 -- 172.21.15.163:0/483852059 >> 172.21.15.163:0/483852059 conn(0x7f6e5c06c650 msgr2=0x7f6e5c14c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:22.431 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.430+0000 7f6e64400640 1 -- 172.21.15.163:0/483852059 shutdown_connections 2024-04-01T16:34:22.431 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:22.431+0000 7f6e64400640 1 -- 172.21.15.163:0/483852059 wait complete. 2024-04-01T16:34:24.449 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T16:34:24.669 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.669+0000 7f2332200640 1 Processor -- start 2024-04-01T16:34:24.669 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.669+0000 7f2332200640 1 -- start start 2024-04-01T16:34:24.670 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.671+0000 7f2332200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f232c152830 0x7f232c072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:24.670 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.671+0000 7f2332200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f232c15c160 0x7f232c072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:24.670 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.671+0000 7f2332200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f232c0737f0 con 0x7f232c0c6b30 2024-04-01T16:34:24.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.671+0000 7f2332200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f232c152c10 con 0x7f232c152830 2024-04-01T16:34:24.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.671+0000 7f2332200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f232c0c72d0 con 0x7f232c15c160 2024-04-01T16:34:24.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.672+0000 7f232b400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f232c152830 0x7f232c072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:24.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.672+0000 7f232b400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f232c152830 0x7f232c072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:41446/0 (socket says 172.21.15.163:41446) 2024-04-01T16:34:24.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.672+0000 7f232b400640 1 -- 172.21.15.163:0/690886058 learned_addr learned my addr 172.21.15.163:0/690886058 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:24.672 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.673+0000 7f232be00640 1 --2- 172.21.15.163:0/690886058 >> v2:172.21.15.189:3300/0 conn(0x7f232c15c160 0x7f232c072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:24.675 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.676+0000 7f232b400640 1 -- 172.21.15.163:0/690886058 >> v2:172.21.15.189:3300/0 conn(0x7f232c15c160 msgr2=0x7f232c072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:24.675 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.676+0000 7f232b400640 1 --2- 172.21.15.163:0/690886058 >> v2:172.21.15.189:3300/0 conn(0x7f232c15c160 0x7f232c072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:24.675 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.676+0000 7f232b400640 1 -- 172.21.15.163:0/690886058 >> v1:172.21.15.163:6789/0 conn(0x7f232c0c6b30 legacy=0x7f232c15ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:24.675 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.676+0000 7f232b400640 1 -- 172.21.15.163:0/690886058 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232c0c75b0 con 0x7f232c152830 2024-04-01T16:34:24.682 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.682+0000 7f232b400640 1 --2- 172.21.15.163:0/690886058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f232c152830 0x7f232c072900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f232c072680 tx=0x7f231c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2291b7ba8f24322b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:24.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.690+0000 7f232aa00640 1 -- 172.21.15.163:0/690886058 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c034070 con 0x7f232c152830 2024-04-01T16:34:24.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.690+0000 7f232aa00640 1 -- 172.21.15.163:0/690886058 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f231c030860 con 0x7f232c152830 2024-04-01T16:34:24.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.690+0000 7f232aa00640 1 -- 172.21.15.163:0/690886058 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c030c30 con 0x7f232c152830 2024-04-01T16:34:24.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.691+0000 7f2332200640 1 -- 172.21.15.163:0/690886058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f232c152830 msgr2=0x7f232c072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:24.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.691+0000 7f2332200640 1 --2- 172.21.15.163:0/690886058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f232c152830 0x7f232c072900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f232c072680 tx=0x7f231c02b9a0 comp rx=0 tx=0).stop 2024-04-01T16:34:24.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.691+0000 7f2332200640 1 -- 172.21.15.163:0/690886058 shutdown_connections 2024-04-01T16:34:24.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.691+0000 7f2332200640 1 --2- 172.21.15.163:0/690886058 >> v2:172.21.15.189:3300/0 conn(0x7f232c15c160 0x7f232c072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:24.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.691+0000 7f2332200640 1 --2- 172.21.15.163:0/690886058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f232c152830 0x7f232c072900 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:24.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.691+0000 7f2332200640 1 -- 172.21.15.163:0/690886058 >> 172.21.15.163:0/690886058 conn(0x7f232c0cbe20 msgr2=0x7f232c0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:24.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.691+0000 7f2332200640 1 -- 172.21.15.163:0/690886058 shutdown_connections 2024-04-01T16:34:24.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.691+0000 7f2332200640 1 -- 172.21.15.163:0/690886058 wait complete. 2024-04-01T16:34:24.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.694+0000 7f2332200640 1 Processor -- start 2024-04-01T16:34:24.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.694+0000 7f2332200640 1 -- start start 2024-04-01T16:34:24.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.695+0000 7f2332200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f232c0c6b30 0x7f232c1f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:24.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.695+0000 7f2332200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f232c152830 0x7f232c1e1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:24.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.695+0000 7f2332200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f232c155c90 0x7f232c15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:24.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.695+0000 7f2332200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f232c073a90 con 0x7f232c152830 2024-04-01T16:34:24.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.695+0000 7f2332200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f232c0c7b70 con 0x7f232c0c6b30 2024-04-01T16:34:24.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.695+0000 7f2332200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f232c0707f0 con 0x7f232c155c90 2024-04-01T16:34:24.696 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.697+0000 7f232b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f232c0c6b30 0x7f232c1f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:24.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.698+0000 7f232be00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f232c155c90 0x7f232c15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:24.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.698+0000 7f232b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f232c0c6b30 0x7f232c1f0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:43364/0 (socket says 172.21.15.163:43364) 2024-04-01T16:34:24.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.698+0000 7f232b400640 1 -- 172.21.15.163:0/1502253068 learned_addr learned my addr 172.21.15.163:0/1502253068 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:24.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.698+0000 7f2322a00640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f232c152830 0x7f232c1e1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:24.702 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.703+0000 7f2322a00640 1 -- 172.21.15.163:0/1502253068 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f232c155c90 msgr2=0x7f232c15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:24.702 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.703+0000 7f2322a00640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f232c155c90 0x7f232c15ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:24.702 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.703+0000 7f2322a00640 1 -- 172.21.15.163:0/1502253068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f232c0c6b30 msgr2=0x7f232c1f0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:24.702 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.703+0000 7f2322a00640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f232c0c6b30 0x7f232c1f0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:24.702 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.703+0000 7f2322a00640 1 -- 172.21.15.163:0/1502253068 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232c15bba0 con 0x7f232c152830 2024-04-01T16:34:24.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.705+0000 7f2322a00640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f232c152830 0x7f232c1e1b70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f231400c760 tx=0x7f231400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:24.707 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.708+0000 7f2323e00640 1 -- 172.21.15.163:0/1502253068 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314016020 con 0x7f232c152830 2024-04-01T16:34:24.707 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.708+0000 7f2332200640 1 -- 172.21.15.163:0/1502253068 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232c15be80 con 0x7f232c152830 2024-04-01T16:34:24.707 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.708+0000 7f2332200640 1 -- 172.21.15.163:0/1502253068 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f232c1e3b70 con 0x7f232c152830 2024-04-01T16:34:24.708 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.709+0000 7f2332200640 1 -- 172.21.15.163:0/1502253068 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f232c0756d0 con 0x7f232c152830 2024-04-01T16:34:24.709 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.710+0000 7f2323e00640 1 -- 172.21.15.163:0/1502253068 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2314006d50 con 0x7f232c152830 2024-04-01T16:34:24.709 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:24.710+0000 7f2323e00640 1 -- 172.21.15.163:0/1502253068 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314001790 con 0x7f232c152830 2024-04-01T16:34:25.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.014+0000 7f2323e00640 1 -- 172.21.15.163:0/1502253068 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2314003b90 con 0x7f232c152830 2024-04-01T16:34:25.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.016+0000 7f2323e00640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f230806c920 0x7f230806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:25.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.016+0000 7f232b400640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f230806c920 0x7f230806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:25.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.018+0000 7f232b400640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f230806c920 0x7f230806ede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f231c009630 tx=0x7f231c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:25.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.050+0000 7f2323e00640 1 -- 172.21.15.163:0/1502253068 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f2314060a50 con 0x7f232c152830 2024-04-01T16:34:25.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.051+0000 7f2323e00640 1 -- 172.21.15.163:0/1502253068 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2314020020 con 0x7f232c152830 2024-04-01T16:34:25.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.300+0000 7f2332200640 1 -- 172.21.15.163:0/1502253068 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f232c072ea0 con 0x7f232c152830 2024-04-01T16:34:25.428 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.428+0000 7f2323e00640 1 -- 172.21.15.163:0/1502253068 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5527 (secure 0 0 0) 0x7f231405a260 con 0x7f232c152830 2024-04-01T16:34:25.428 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:25.429 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/220229466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":220229466},{"type":"v1","addr":"172.21.15.189:6834","nonce":220229466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/1149566111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1149566111},{"type":"v1","addr":"172.21.15.163:6839","nonce":1149566111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2556471418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2556471418},{"type":"v1","addr":"172.21.15.163:6835","nonce":2556471418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1010688449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1010688449},{"type":"v1","addr":"172.21.15.163:6837","nonce":1010688449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1685366427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1685366427},{"type":"v1","addr":"172.21.15.189:6837","nonce":1685366427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/2672478403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2672478403},{"type":"v1","addr":"172.21.15.189:6835","nonce":2672478403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-01T16:34:25.429 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 3 2024-04-01T16:34:25.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.432+0000 7f2332200640 1 -- 172.21.15.163:0/1502253068 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f230806c920 msgr2=0x7f230806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:25.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.432+0000 7f2332200640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f230806c920 0x7f230806ede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f231c009630 tx=0x7f231c008030 comp rx=0 tx=0).stop 2024-04-01T16:34:25.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.432+0000 7f2332200640 1 -- 172.21.15.163:0/1502253068 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f232c152830 msgr2=0x7f232c1e1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:25.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.432+0000 7f2332200640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f232c152830 0x7f232c1e1b70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f231400c760 tx=0x7f231400cc20 comp rx=0 tx=0).stop 2024-04-01T16:34:25.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.432+0000 7f2332200640 1 -- 172.21.15.163:0/1502253068 shutdown_connections 2024-04-01T16:34:25.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.432+0000 7f2332200640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f230806c920 0x7f230806ede0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:25.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.432+0000 7f2332200640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f232c155c90 0x7f232c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:25.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.432+0000 7f2332200640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f232c152830 0x7f232c1e1b70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:25.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.432+0000 7f2332200640 1 --2- 172.21.15.163:0/1502253068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f232c0c6b30 0x7f232c1f0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:25.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.432+0000 7f2332200640 1 -- 172.21.15.163:0/1502253068 >> 172.21.15.163:0/1502253068 conn(0x7f232c0cbe20 msgr2=0x7f232c151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:25.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.432+0000 7f2332200640 1 -- 172.21.15.163:0/1502253068 shutdown_connections 2024-04-01T16:34:25.433 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.433+0000 7f2332200640 1 -- 172.21.15.163:0/1502253068 wait complete. 2024-04-01T16:34:25.455 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T16:34:25.662 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.663+0000 7fa53a000640 1 Processor -- start 2024-04-01T16:34:25.662 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.663+0000 7fa53a000640 1 -- start start 2024-04-01T16:34:25.664 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.664+0000 7fa53a000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa53406e950 0x7fa534072400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:25.664 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.664+0000 7fa53a000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa534156f50 con 0x7fa534151090 2024-04-01T16:34:25.664 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.664+0000 7fa53a000640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa534157230 con 0x7fa5340732a0 2024-04-01T16:34:25.664 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.664+0000 7fa53a000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa53406ff70 con 0x7fa53406e950 2024-04-01T16:34:25.664 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.665+0000 7fa52aa00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fa534151090 0x7fa5340c25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:59696/0 (socket says 172.21.15.163:59696) 2024-04-01T16:34:25.665 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.665+0000 7fa52aa00640 1 -- 172.21.15.163:0/2620200853 learned_addr learned my addr 172.21.15.163:0/2620200853 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:25.665 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.666+0000 7fa533e00640 1 --2- 172.21.15.163:0/2620200853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa53406e950 0x7fa534072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:25.668 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.668+0000 7fa532a00640 1 -- 172.21.15.163:0/2620200853 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333917255 0 0) 0x7fa534156f50 con 0x7fa534151090 2024-04-01T16:34:25.668 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.668+0000 7fa532a00640 1 -- 172.21.15.163:0/2620200853 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa518005730 con 0x7fa534151090 2024-04-01T16:34:25.672 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.673+0000 7fa533e00640 1 -- 172.21.15.163:0/2620200853 >> v1:172.21.15.189:6789/0 conn(0x7fa5340732a0 legacy=0x7fa53406f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:25.672 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.673+0000 7fa533e00640 1 -- 172.21.15.163:0/2620200853 >> v1:172.21.15.163:6789/0 conn(0x7fa534151090 legacy=0x7fa5340c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:25.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.673+0000 7fa533e00640 1 -- 172.21.15.163:0/2620200853 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa534157510 con 0x7fa53406e950 2024-04-01T16:34:25.678 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.678+0000 7fa533e00640 1 --2- 172.21.15.163:0/2620200853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa53406e950 0x7fa534072400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009dc0 tx=0x7fa52c02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4220e7e874300b7d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:25.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.689+0000 7fa532a00640 1 -- 172.21.15.163:0/2620200853 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c039070 con 0x7fa53406e950 2024-04-01T16:34:25.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.689+0000 7fa532a00640 1 -- 172.21.15.163:0/2620200853 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52c02ccd0 con 0x7fa53406e950 2024-04-01T16:34:25.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.689+0000 7fa532a00640 1 -- 172.21.15.163:0/2620200853 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c034660 con 0x7fa53406e950 2024-04-01T16:34:25.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.690+0000 7fa53a000640 1 -- 172.21.15.163:0/2620200853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa53406e950 msgr2=0x7fa534072400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:25.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.690+0000 7fa53a000640 1 --2- 172.21.15.163:0/2620200853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa53406e950 0x7fa534072400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009dc0 tx=0x7fa52c02bf20 comp rx=0 tx=0).stop 2024-04-01T16:34:25.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.690+0000 7fa53a000640 1 -- 172.21.15.163:0/2620200853 shutdown_connections 2024-04-01T16:34:25.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.690+0000 7fa53a000640 1 --2- 172.21.15.163:0/2620200853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa53406e950 0x7fa534072400 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:25.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.690+0000 7fa53a000640 1 -- 172.21.15.163:0/2620200853 >> 172.21.15.163:0/2620200853 conn(0x7fa5340cbe20 msgr2=0x7fa5340cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:25.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.691+0000 7fa53a000640 1 -- 172.21.15.163:0/2620200853 shutdown_connections 2024-04-01T16:34:25.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.691+0000 7fa53a000640 1 -- 172.21.15.163:0/2620200853 wait complete. 2024-04-01T16:34:25.692 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.693+0000 7fa53a000640 1 Processor -- start 2024-04-01T16:34:25.692 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.693+0000 7fa53a000640 1 -- start start 2024-04-01T16:34:25.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.694+0000 7fa53a000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa53406e950 0x7fa5341f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:25.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.694+0000 7fa53a000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa5340732a0 0x7fa5340cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:25.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.694+0000 7fa53a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534151090 0x7fa5341561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:25.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.694+0000 7fa53a000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa534071ee0 con 0x7fa53406e950 2024-04-01T16:34:25.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.694+0000 7fa53a000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa534157ad0 con 0x7fa534151090 2024-04-01T16:34:25.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.694+0000 7fa53a000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa534156c40 con 0x7fa5340732a0 2024-04-01T16:34:25.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.695+0000 7fa533400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa53406e950 0x7fa5341f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:25.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.695+0000 7fa533400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa53406e950 0x7fa5341f4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:41466/0 (socket says 172.21.15.163:41466) 2024-04-01T16:34:25.694 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.695+0000 7fa533400640 1 -- 172.21.15.163:0/361403004 learned_addr learned my addr 172.21.15.163:0/361403004 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:25.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.696+0000 7fa533e00640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534151090 0x7fa5341561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:25.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.696+0000 7fa52aa00640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa5340732a0 0x7fa5340cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:25.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.699+0000 7fa533400640 1 -- 172.21.15.163:0/361403004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa5340732a0 msgr2=0x7fa5340cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:25.699 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.699+0000 7fa533400640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa5340732a0 0x7fa5340cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:25.699 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.699+0000 7fa533400640 1 -- 172.21.15.163:0/361403004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534151090 msgr2=0x7fa5341561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:25.699 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.699+0000 7fa533400640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534151090 0x7fa5341561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:25.699 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.699+0000 7fa533400640 1 -- 172.21.15.163:0/361403004 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5340c80c0 con 0x7fa53406e950 2024-04-01T16:34:25.701 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.702+0000 7fa533400640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa53406e950 0x7fa5341f4280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa52400c450 tx=0x7fa52400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:25.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.704+0000 7fa52be00640 1 -- 172.21.15.163:0/361403004 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240052d0 con 0x7fa53406e950 2024-04-01T16:34:25.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.704+0000 7fa53a000640 1 -- 172.21.15.163:0/361403004 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa534144b60 con 0x7fa53406e950 2024-04-01T16:34:25.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.704+0000 7fa53a000640 1 -- 172.21.15.163:0/361403004 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa534145120 con 0x7fa53406e950 2024-04-01T16:34:25.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.705+0000 7fa53a000640 1 -- 172.21.15.163:0/361403004 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5340756d0 con 0x7fa53406e950 2024-04-01T16:34:25.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.706+0000 7fa52be00640 1 -- 172.21.15.163:0/361403004 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa524005470 con 0x7fa53406e950 2024-04-01T16:34:25.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:25.706+0000 7fa52be00640 1 -- 172.21.15.163:0/361403004 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524007250 con 0x7fa53406e950 2024-04-01T16:34:26.012 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.012+0000 7fa52be00640 1 -- 172.21.15.163:0/361403004 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5240073f0 con 0x7fa53406e950 2024-04-01T16:34:26.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.015+0000 7fa52be00640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa51006c8f0 0x7fa51006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:26.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.015+0000 7fa52aa00640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa51006c8f0 0x7fa51006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:26.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.016+0000 7fa52aa00640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa51006c8f0 0x7fa51006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa5341406e0 tx=0x7fa51c007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:26.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.055+0000 7fa52be00640 1 -- 172.21.15.163:0/361403004 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fa524057fa0 con 0x7fa53406e950 2024-04-01T16:34:26.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.056+0000 7fa52be00640 1 -- 172.21.15.163:0/361403004 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa5340c80c0 con 0x7fa53406e950 2024-04-01T16:34:26.267 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.267+0000 7fa53a000640 1 -- 172.21.15.163:0/361403004 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa534156a20 con 0x7fa53406e950 2024-04-01T16:34:26.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.322+0000 7fa52be00640 1 -- 172.21.15.163:0/361403004 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12932 (secure 0 0 0) 0x7fa524059f00 con 0x7fa53406e950 2024-04-01T16:34:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:26.323 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":18,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:08.789893+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:34:26.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.326+0000 7fa53a000640 1 -- 172.21.15.163:0/361403004 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa51006c8f0 msgr2=0x7fa51006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:26.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.326+0000 7fa53a000640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa51006c8f0 0x7fa51006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa5341406e0 tx=0x7fa51c007d30 comp rx=0 tx=0).stop 2024-04-01T16:34:26.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.326+0000 7fa53a000640 1 -- 172.21.15.163:0/361403004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa53406e950 msgr2=0x7fa5341f4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:26.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.326+0000 7fa53a000640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa53406e950 0x7fa5341f4280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa52400c450 tx=0x7fa52400c910 comp rx=0 tx=0).stop 2024-04-01T16:34:26.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.326+0000 7fa53a000640 1 -- 172.21.15.163:0/361403004 shutdown_connections 2024-04-01T16:34:26.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.326+0000 7fa53a000640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa51006c8f0 0x7fa51006edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:26.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.326+0000 7fa53a000640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534151090 0x7fa5341561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:26.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.326+0000 7fa53a000640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa5340732a0 0x7fa5340cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:26.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.326+0000 7fa53a000640 1 --2- 172.21.15.163:0/361403004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa53406e950 0x7fa5341f4280 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:26.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.326+0000 7fa53a000640 1 -- 172.21.15.163:0/361403004 >> 172.21.15.163:0/361403004 conn(0x7fa5340cbe20 msgr2=0x7fa5340c24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:26.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.327+0000 7fa53a000640 1 -- 172.21.15.163:0/361403004 shutdown_connections 2024-04-01T16:34:26.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.327+0000 7fa53a000640 1 -- 172.21.15.163:0/361403004 wait complete. 2024-04-01T16:34:26.346 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T16:34:05.291874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T16:34:26.347 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T16:34:26.546 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.547+0000 7f3d73200640 1 Processor -- start 2024-04-01T16:34:26.546 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.547+0000 7f3d73200640 1 -- start start 2024-04-01T16:34:26.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.548+0000 7f3d73200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3d741548f0 0x7f3d740cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:26.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.549+0000 7f3d73200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d740cb7b0 0x7f3d740ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:26.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.549+0000 7f3d73200640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7406e230 con 0x7f3d740c5220 2024-04-01T16:34:26.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.549+0000 7f3d73200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f3d740caba0 con 0x7f3d740cb7b0 2024-04-01T16:34:26.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.549+0000 7f3d73200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3d740cb090 con 0x7f3d741548f0 2024-04-01T16:34:26.549 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.550+0000 7f3d71400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d740cb7b0 0x7f3d740ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:26.549 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.550+0000 7f3d71400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3d740cb7b0 0x7f3d740ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:41474/0 (socket says 172.21.15.163:41474) 2024-04-01T16:34:26.550 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.550+0000 7f3d71400640 1 -- 172.21.15.163:0/2803022962 learned_addr learned my addr 172.21.15.163:0/2803022962 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:26.554 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.555+0000 7f3d71400640 1 -- 172.21.15.163:0/2803022962 >> v2:172.21.15.189:3300/0 conn(0x7f3d741548f0 msgr2=0x7f3d740cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:26.554 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.555+0000 7f3d71400640 1 --2- 172.21.15.163:0/2803022962 >> v2:172.21.15.189:3300/0 conn(0x7f3d741548f0 0x7f3d740cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:26.554 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.555+0000 7f3d71400640 1 -- 172.21.15.163:0/2803022962 >> v1:172.21.15.189:6789/0 conn(0x7f3d740c5220 legacy=0x7f3d7415dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:26.554 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.555+0000 7f3d71400640 1 -- 172.21.15.163:0/2803022962 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d740cb370 con 0x7f3d740cb7b0 2024-04-01T16:34:26.612 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.613+0000 7f3d71400640 1 --2- 172.21.15.163:0/2803022962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d740cb7b0 0x7f3d740ccdf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d740cc880 tx=0x7f3d5c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a85ec28b2ba2d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:26.621 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.622+0000 7f3d70a00640 1 -- 172.21.15.163:0/2803022962 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c034070 con 0x7f3d740cb7b0 2024-04-01T16:34:26.621 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.622+0000 7f3d70a00640 1 -- 172.21.15.163:0/2803022962 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c030860 con 0x7f3d740cb7b0 2024-04-01T16:34:26.622 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.622+0000 7f3d70a00640 1 -- 172.21.15.163:0/2803022962 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c030c30 con 0x7f3d740cb7b0 2024-04-01T16:34:26.622 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.623+0000 7f3d73200640 1 -- 172.21.15.163:0/2803022962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d740cb7b0 msgr2=0x7f3d740ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:26.622 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.623+0000 7f3d73200640 1 --2- 172.21.15.163:0/2803022962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d740cb7b0 0x7f3d740ccdf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d740cc880 tx=0x7f3d5c02b9a0 comp rx=0 tx=0).stop 2024-04-01T16:34:26.623 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.623+0000 7f3d73200640 1 -- 172.21.15.163:0/2803022962 shutdown_connections 2024-04-01T16:34:26.623 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.623+0000 7f3d73200640 1 --2- 172.21.15.163:0/2803022962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d740cb7b0 0x7f3d740ccdf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:26.623 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.623+0000 7f3d73200640 1 --2- 172.21.15.163:0/2803022962 >> v2:172.21.15.189:3300/0 conn(0x7f3d741548f0 0x7f3d740cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:26.623 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.623+0000 7f3d73200640 1 -- 172.21.15.163:0/2803022962 >> 172.21.15.163:0/2803022962 conn(0x7f3d7408c600 msgr2=0x7f3d74067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:26.623 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.623+0000 7f3d73200640 1 -- 172.21.15.163:0/2803022962 shutdown_connections 2024-04-01T16:34:26.623 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.623+0000 7f3d73200640 1 -- 172.21.15.163:0/2803022962 wait complete. 2024-04-01T16:34:26.625 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.626+0000 7f3d73200640 1 Processor -- start 2024-04-01T16:34:26.625 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.626+0000 7f3d73200640 1 -- start start 2024-04-01T16:34:26.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.627+0000 7f3d73200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d740c5220 0x7f3d7415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:26.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.627+0000 7f3d73200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d740cb7b0 0x7f3d74149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:26.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.627+0000 7f3d73200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d741548f0 0x7f3d74149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:26.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.627+0000 7f3d73200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3d740cc330 con 0x7f3d740c5220 2024-04-01T16:34:26.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.627+0000 7f3d73200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3d740cc050 con 0x7f3d740cb7b0 2024-04-01T16:34:26.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.627+0000 7f3d73200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3d740ca820 con 0x7f3d741548f0 2024-04-01T16:34:26.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.628+0000 7f3d71e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d740c5220 0x7f3d7415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:26.628 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.629+0000 7f3d71e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d740c5220 0x7f3d7415ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:41480/0 (socket says 172.21.15.163:41480) 2024-04-01T16:34:26.628 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.629+0000 7f3d71e00640 1 -- 172.21.15.163:0/3840676689 learned_addr learned my addr 172.21.15.163:0/3840676689 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:26.632 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.633+0000 7f3d71e00640 1 -- 172.21.15.163:0/3840676689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d741548f0 msgr2=0x7f3d74149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:26.632 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.633+0000 7f3d71e00640 1 --2- 172.21.15.163:0/3840676689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d741548f0 0x7f3d74149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:26.632 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.633+0000 7f3d71e00640 1 -- 172.21.15.163:0/3840676689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d740cb7b0 msgr2=0x7f3d74149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:26.632 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.633+0000 7f3d71e00640 1 --2- 172.21.15.163:0/3840676689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d740cb7b0 0x7f3d74149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:26.633 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.633+0000 7f3d71e00640 1 -- 172.21.15.163:0/3840676689 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d741f12b0 con 0x7f3d740c5220 2024-04-01T16:34:26.636 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.636+0000 7f3d71e00640 1 --2- 172.21.15.163:0/3840676689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d740c5220 0x7f3d7415ba90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400ba80 tx=0x7f3d6400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:26.638 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.639+0000 7f3d6a000640 1 -- 172.21.15.163:0/3840676689 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d64019070 con 0x7f3d740c5220 2024-04-01T16:34:26.638 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.639+0000 7f3d73200640 1 -- 172.21.15.163:0/3840676689 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7415c700 con 0x7f3d740c5220 2024-04-01T16:34:26.638 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.639+0000 7f3d73200640 1 -- 172.21.15.163:0/3840676689 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7415ccc0 con 0x7f3d740c5220 2024-04-01T16:34:26.639 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.640+0000 7f3d73200640 1 -- 172.21.15.163:0/3840676689 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d740756d0 con 0x7f3d740c5220 2024-04-01T16:34:26.641 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.642+0000 7f3d6a000640 1 -- 172.21.15.163:0/3840676689 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6400cc00 con 0x7f3d740c5220 2024-04-01T16:34:26.641 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.642+0000 7f3d6a000640 1 -- 172.21.15.163:0/3840676689 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d64023060 con 0x7f3d740c5220 2024-04-01T16:34:26.951 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.951+0000 7f3d6a000640 1 -- 172.21.15.163:0/3840676689 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d6401c070 con 0x7f3d740c5220 2024-04-01T16:34:26.953 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.954+0000 7f3d6a000640 1 --2- 172.21.15.163:0/3840676689 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3d5006c8f0 0x7f3d5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:26.953 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.954+0000 7f3d71400640 1 --2- 172.21.15.163:0/3840676689 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3d5006c8f0 0x7f3d5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:26.955 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.955+0000 7f3d71400640 1 --2- 172.21.15.163:0/3840676689 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3d5006c8f0 0x7f3d5006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c036000 tx=0x7f3d5c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:26.995 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.995+0000 7f3d6a000640 1 -- 172.21.15.163:0/3840676689 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f3d64057f20 con 0x7f3d740c5220 2024-04-01T16:34:26.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:26.996+0000 7f3d6a000640 1 -- 172.21.15.163:0/3840676689 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3d64059e80 con 0x7f3d740c5220 2024-04-01T16:34:27.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.220+0000 7f3d73200640 1 -- 172.21.15.163:0/3840676689 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3d7415c4e0 con 0x7f3d740c5220 2024-04-01T16:34:27.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.251+0000 7f3d6a000640 1 -- 172.21.15.163:0/3840676689 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f3d6405e180 con 0x7f3d740c5220 2024-04-01T16:34:27.251 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2024-04-01T16:34:27.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.255+0000 7f3d73200640 1 -- 172.21.15.163:0/3840676689 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3d5006c8f0 msgr2=0x7f3d5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:27.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.255+0000 7f3d73200640 1 --2- 172.21.15.163:0/3840676689 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3d5006c8f0 0x7f3d5006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c036000 tx=0x7f3d5c03b040 comp rx=0 tx=0).stop 2024-04-01T16:34:27.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.255+0000 7f3d73200640 1 -- 172.21.15.163:0/3840676689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d740c5220 msgr2=0x7f3d7415ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:27.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.255+0000 7f3d73200640 1 --2- 172.21.15.163:0/3840676689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d740c5220 0x7f3d7415ba90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400ba80 tx=0x7f3d6400bf40 comp rx=0 tx=0).stop 2024-04-01T16:34:27.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.255+0000 7f3d73200640 1 -- 172.21.15.163:0/3840676689 shutdown_connections 2024-04-01T16:34:27.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.255+0000 7f3d73200640 1 --2- 172.21.15.163:0/3840676689 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3d5006c8f0 0x7f3d5006edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:27.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.255+0000 7f3d73200640 1 --2- 172.21.15.163:0/3840676689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3d741548f0 0x7f3d74149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:27.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.255+0000 7f3d73200640 1 --2- 172.21.15.163:0/3840676689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d740cb7b0 0x7f3d74149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:27.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.255+0000 7f3d73200640 1 --2- 172.21.15.163:0/3840676689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d740c5220 0x7f3d7415ba90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:27.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.255+0000 7f3d73200640 1 -- 172.21.15.163:0/3840676689 >> 172.21.15.163:0/3840676689 conn(0x7f3d7408c600 msgr2=0x7f3d740cc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:27.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.255+0000 7f3d73200640 1 -- 172.21.15.163:0/3840676689 shutdown_connections 2024-04-01T16:34:27.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.255+0000 7f3d73200640 1 -- 172.21.15.163:0/3840676689 wait complete. 2024-04-01T16:34:27.275 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-01T16:34:27.486 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.486+0000 7f475be00640 1 Processor -- start 2024-04-01T16:34:27.486 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.486+0000 7f475be00640 1 -- start start 2024-04-01T16:34:27.487 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.487+0000 7f475be00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f475c154c70 0x7f475c0cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:27.487 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.487+0000 7f475be00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f475c0cedb0 0x7f475c0cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:27.487 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.487+0000 7f475be00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f475c0b1ef0 con 0x7f475c0ce3e0 2024-04-01T16:34:27.487 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.487+0000 7f475be00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f475c0ca790 con 0x7f475c0cedb0 2024-04-01T16:34:27.487 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.488+0000 7f475be00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f475c155050 con 0x7f475c154c70 2024-04-01T16:34:27.488 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.488+0000 7f475b400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f475c0cedb0 0x7f475c0cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:27.488 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.489+0000 7f475b400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f475c0cedb0 0x7f475c0cf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:41490/0 (socket says 172.21.15.163:41490) 2024-04-01T16:34:27.488 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.489+0000 7f475b400640 1 -- 172.21.15.163:0/3532090265 learned_addr learned my addr 172.21.15.163:0/3532090265 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:27.489 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.490+0000 7f475aa00640 1 --2- 172.21.15.163:0/3532090265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f475c154c70 0x7f475c0cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:27.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.492+0000 7f475b400640 1 -- 172.21.15.163:0/3532090265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f475c154c70 msgr2=0x7f475c0cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:27.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.492+0000 7f475b400640 1 --2- 172.21.15.163:0/3532090265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f475c154c70 0x7f475c0cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:27.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.492+0000 7f475b400640 1 -- 172.21.15.163:0/3532090265 >> v1:172.21.15.189:6789/0 conn(0x7f475c0ce3e0 legacy=0x7f475c0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:27.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.492+0000 7f475b400640 1 -- 172.21.15.163:0/3532090265 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c0b1c10 con 0x7f475c0cedb0 2024-04-01T16:34:27.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.496+0000 7f475b400640 1 --2- 172.21.15.163:0/3532090265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f475c0cedb0 0x7f475c0cf410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f475c1551d0 tx=0x7f475402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac4bb6088c44e58 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:27.500 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.501+0000 7f475a000640 1 -- 172.21.15.163:0/3532090265 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475402cb70 con 0x7f475c0cedb0 2024-04-01T16:34:27.501 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.501+0000 7f475a000640 1 -- 172.21.15.163:0/3532090265 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f475402cd10 con 0x7f475c0cedb0 2024-04-01T16:34:27.501 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.501+0000 7f475a000640 1 -- 172.21.15.163:0/3532090265 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754034610 con 0x7f475c0cedb0 2024-04-01T16:34:27.501 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.502+0000 7f475be00640 1 -- 172.21.15.163:0/3532090265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f475c0cedb0 msgr2=0x7f475c0cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:27.502 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.502+0000 7f475be00640 1 --2- 172.21.15.163:0/3532090265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f475c0cedb0 0x7f475c0cf410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f475c1551d0 tx=0x7f475402bfd0 comp rx=0 tx=0).stop 2024-04-01T16:34:27.502 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.502+0000 7f475be00640 1 -- 172.21.15.163:0/3532090265 shutdown_connections 2024-04-01T16:34:27.502 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.502+0000 7f475be00640 1 --2- 172.21.15.163:0/3532090265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f475c0cedb0 0x7f475c0cf410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:27.502 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.502+0000 7f475be00640 1 --2- 172.21.15.163:0/3532090265 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f475c154c70 0x7f475c0cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:27.502 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.502+0000 7f475be00640 1 -- 172.21.15.163:0/3532090265 >> 172.21.15.163:0/3532090265 conn(0x7f475c067280 msgr2=0x7f475c067690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:27.502 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.502+0000 7f475be00640 1 -- 172.21.15.163:0/3532090265 shutdown_connections 2024-04-01T16:34:27.502 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.502+0000 7f475be00640 1 -- 172.21.15.163:0/3532090265 wait complete. 2024-04-01T16:34:27.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.505+0000 7f475be00640 1 Processor -- start 2024-04-01T16:34:27.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.505+0000 7f475be00640 1 -- start start 2024-04-01T16:34:27.505 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.506+0000 7f475be00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f475c0ce3e0 0x7f475c0c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:27.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.506+0000 7f475be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f475c0cedb0 0x7f475c1f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:27.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.506+0000 7f475be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f475c154c70 0x7f475c0b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:27.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.506+0000 7f475be00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f475c0b2190 con 0x7f475c154c70 2024-04-01T16:34:27.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.506+0000 7f475be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f475c15eb90 con 0x7f475c0cedb0 2024-04-01T16:34:27.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.506+0000 7f475be00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f475c0c9850 con 0x7f475c0ce3e0 2024-04-01T16:34:27.506 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.507+0000 7f475b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f475c154c70 0x7f475c0b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:27.507 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.507+0000 7f475b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f475c154c70 0x7f475c0b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:41494/0 (socket says 172.21.15.163:41494) 2024-04-01T16:34:27.507 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.507+0000 7f475b400640 1 -- 172.21.15.163:0/3618174963 learned_addr learned my addr 172.21.15.163:0/3618174963 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:27.507 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.508+0000 7f475aa00640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f475c0ce3e0 0x7f475c0c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:27.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.511+0000 7f475b400640 1 -- 172.21.15.163:0/3618174963 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f475c0ce3e0 msgr2=0x7f475c0c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:27.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.511+0000 7f475b400640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f475c0ce3e0 0x7f475c0c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:27.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.511+0000 7f475b400640 1 -- 172.21.15.163:0/3618174963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f475c0cedb0 msgr2=0x7f475c1f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:27.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.511+0000 7f475b400640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f475c0cedb0 0x7f475c1f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:27.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.511+0000 7f475b400640 1 -- 172.21.15.163:0/3618174963 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c151ce0 con 0x7f475c154c70 2024-04-01T16:34:27.513 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.514+0000 7f475b400640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f475c154c70 0x7f475c0b11f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f475402c5e0 tx=0x7f4754004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:27.518 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.518+0000 7f4752a00640 1 -- 172.21.15.163:0/3618174963 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754043020 con 0x7f475c154c70 2024-04-01T16:34:27.518 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.518+0000 7f4752a00640 1 -- 172.21.15.163:0/3618174963 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f475403e450 con 0x7f475c154c70 2024-04-01T16:34:27.518 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.518+0000 7f4752a00640 1 -- 172.21.15.163:0/3618174963 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475403e840 con 0x7f475c154c70 2024-04-01T16:34:27.518 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.519+0000 7f475be00640 1 -- 172.21.15.163:0/3618174963 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475c1f4980 con 0x7f475c154c70 2024-04-01T16:34:27.518 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.519+0000 7f475be00640 1 -- 172.21.15.163:0/3618174963 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f475c0c9570 con 0x7f475c154c70 2024-04-01T16:34:27.519 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.520+0000 7f475be00640 1 -- 172.21.15.163:0/3618174963 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475c0756d0 con 0x7f475c154c70 2024-04-01T16:34:27.549 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.550+0000 7f4752a00640 1 -- 172.21.15.163:0/3618174963 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4754046020 con 0x7f475c154c70 2024-04-01T16:34:27.550 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.551+0000 7f4752a00640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f473806c970 0x7f473806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:27.551 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.552+0000 7f475aa00640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f473806c970 0x7f473806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:27.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.553+0000 7f475aa00640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f473806c970 0x7f473806ee30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f474c009aa0 tx=0x7f474c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:27.558 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.559+0000 7f4752a00640 1 -- 172.21.15.163:0/3618174963 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f4754082e20 con 0x7f475c154c70 2024-04-01T16:34:27.883 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:27.884+0000 7f4752a00640 1 -- 172.21.15.163:0/3618174963 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f475404d030 con 0x7f475c154c70 2024-04-01T16:34:28.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.103+0000 7f475be00640 1 -- 172.21.15.163:0/3618174963 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f475c0b5d90 con 0x7f475c154c70 2024-04-01T16:34:28.124 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.125+0000 7f4752a00640 1 -- 172.21.15.163:0/3618174963 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f475407cc80 con 0x7f475c154c70 2024-04-01T16:34:28.124 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:28.125 INFO:teuthology.orchestra.run.smithi163.stdout:[ 2024-04-01T16:34:28.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-04-01T16:34:28.125 INFO:teuthology.orchestra.run.smithi163.stdout: "poolnum": 1, 2024-04-01T16:34:28.125 INFO:teuthology.orchestra.run.smithi163.stdout: "poolname": ".mgr" 2024-04-01T16:34:28.125 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-01T16:34:28.125 INFO:teuthology.orchestra.run.smithi163.stdout:] 2024-04-01T16:34:28.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.127+0000 7f475be00640 1 -- 172.21.15.163:0/3618174963 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f473806c970 msgr2=0x7f473806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:28.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.127+0000 7f475be00640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f473806c970 0x7f473806ee30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f474c009aa0 tx=0x7f474c009190 comp rx=0 tx=0).stop 2024-04-01T16:34:28.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.127+0000 7f475be00640 1 -- 172.21.15.163:0/3618174963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f475c154c70 msgr2=0x7f475c0b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:28.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.127+0000 7f475be00640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f475c154c70 0x7f475c0b11f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f475402c5e0 tx=0x7f4754004a40 comp rx=0 tx=0).stop 2024-04-01T16:34:28.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.127+0000 7f475be00640 1 -- 172.21.15.163:0/3618174963 shutdown_connections 2024-04-01T16:34:28.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.127+0000 7f475be00640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f473806c970 0x7f473806ee30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:28.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.127+0000 7f475be00640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f475c154c70 0x7f475c0b11f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:28.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.127+0000 7f475be00640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f475c0cedb0 0x7f475c1f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:28.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.127+0000 7f475be00640 1 --2- 172.21.15.163:0/3618174963 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f475c0ce3e0 0x7f475c0c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:28.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.128+0000 7f475be00640 1 -- 172.21.15.163:0/3618174963 >> 172.21.15.163:0/3618174963 conn(0x7f475c067280 msgr2=0x7f475c153f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:28.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.128+0000 7f475be00640 1 -- 172.21.15.163:0/3618174963 shutdown_connections 2024-04-01T16:34:28.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.128+0000 7f475be00640 1 -- 172.21.15.163:0/3618174963 wait complete. 2024-04-01T16:34:28.146 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-01T16:34:28.146 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-01T16:34:28.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.354+0000 7ff98e200640 1 Processor -- start 2024-04-01T16:34:28.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.354+0000 7ff98e200640 1 -- start start 2024-04-01T16:34:28.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.356+0000 7ff98e200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff98806eec0 0x7ff988158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:28.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.356+0000 7ff98e200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9880c7620 con 0x7ff988158bb0 2024-04-01T16:34:28.356 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.356+0000 7ff98e200640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff988152df0 con 0x7ff988152a10 2024-04-01T16:34:28.356 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.356+0000 7ff98e200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff98806f350 con 0x7ff98806eec0 2024-04-01T16:34:28.356 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.357+0000 7ff987e00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7ff988158bb0 0x7ff988162f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:59702/0 (socket says 172.21.15.163:59702) 2024-04-01T16:34:28.356 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.357+0000 7ff987e00640 1 -- 172.21.15.163:0/1982527153 learned_addr learned my addr 172.21.15.163:0/1982527153 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:28.358 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.359+0000 7ff97fe00640 1 --2- 172.21.15.163:0/1982527153 >> v2:172.21.15.189:3300/0 conn(0x7ff98806eec0 0x7ff988158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:28.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.360+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1308998221 0 0) 0x7ff9880c7620 con 0x7ff988158bb0 2024-04-01T16:34:28.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.360+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff96c003520 con 0x7ff988158bb0 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2177692810 0 0) 0x7ff96c003520 con 0x7ff988158bb0 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 >> v2:172.21.15.189:3300/0 conn(0x7ff98806eec0 msgr2=0x7ff988158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 --2- 172.21.15.163:0/1982527153 >> v2:172.21.15.189:3300/0 conn(0x7ff98806eec0 0x7ff988158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 >> v1:172.21.15.189:6789/0 conn(0x7ff988152a10 legacy=0x7ff9880c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98806ead0 con 0x7ff988158bb0 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7ff9800019f0 con 0x7ff988158bb0 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 >> v1:172.21.15.163:6789/0 conn(0x7ff988158bb0 legacy=0x7ff988162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 --2- 172.21.15.163:0/1982527153 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff96c003a00 0x7ff96c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 --2- 172.21.15.163:0/1982527153 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff96c004800 0x7ff96c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 --2- 172.21.15.163:0/1982527153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff96c0051c0 0x7ff96c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff98806f350 con 0x7ff96c004800 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c00c090 con 0x7ff96c0051c0 2024-04-01T16:34:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.365+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff96c00c290 con 0x7ff96c003a00 2024-04-01T16:34:28.366 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.367+0000 7ff987400640 1 --2- 172.21.15.163:0/1982527153 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff96c003a00 0x7ff96c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:28.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.369+0000 7ff97fe00640 1 --2- 172.21.15.163:0/1982527153 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff96c004800 0x7ff96c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:28.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.375+0000 7ff987400640 1 -- 172.21.15.163:0/1982527153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff96c0051c0 msgr2=0x7ff96c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:28.375 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.375+0000 7ff987400640 1 --2- 172.21.15.163:0/1982527153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff96c0051c0 0x7ff96c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:28.375 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.375+0000 7ff987400640 1 -- 172.21.15.163:0/1982527153 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff96c004800 msgr2=0x7ff96c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:28.375 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.375+0000 7ff987400640 1 --2- 172.21.15.163:0/1982527153 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff96c004800 0x7ff96c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:28.375 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.375+0000 7ff987400640 1 -- 172.21.15.163:0/1982527153 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c003520 con 0x7ff96c003a00 2024-04-01T16:34:28.375 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.375+0000 7ff987e00640 1 -- 172.21.15.163:0/1982527153 reap_dead start 2024-04-01T16:34:28.381 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.382+0000 7ff987400640 1 --2- 172.21.15.163:0/1982527153 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff96c003a00 0x7ff96c003e00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff978003db0 tx=0x7ff96c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2529b683169d7c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:28.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.393+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978037070 con 0x7ff96c003a00 2024-04-01T16:34:28.393 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.393+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97802be50 con 0x7ff96c003a00 2024-04-01T16:34:28.393 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.393+0000 7ff986a00640 1 -- 172.21.15.163:0/1982527153 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978003980 con 0x7ff96c003a00 2024-04-01T16:34:28.394 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.394+0000 7ff98e200640 1 -- 172.21.15.163:0/1982527153 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff96c003a00 msgr2=0x7ff96c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:28.394 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.394+0000 7ff98e200640 1 --2- 172.21.15.163:0/1982527153 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff96c003a00 0x7ff96c003e00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff978003db0 tx=0x7ff96c005830 comp rx=0 tx=0).stop 2024-04-01T16:34:28.394 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.394+0000 7ff98e200640 1 -- 172.21.15.163:0/1982527153 shutdown_connections 2024-04-01T16:34:28.394 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.394+0000 7ff98e200640 1 --2- 172.21.15.163:0/1982527153 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff96c003a00 0x7ff96c003e00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:28.394 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.394+0000 7ff98e200640 1 -- 172.21.15.163:0/1982527153 >> 172.21.15.163:0/1982527153 conn(0x7ff9880c8a00 msgr2=0x7ff9880c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:28.394 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.395+0000 7ff98e200640 1 -- 172.21.15.163:0/1982527153 shutdown_connections 2024-04-01T16:34:28.394 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.395+0000 7ff98e200640 1 -- 172.21.15.163:0/1982527153 wait complete. 2024-04-01T16:34:28.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.398+0000 7ff98e200640 1 Processor -- start 2024-04-01T16:34:28.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.398+0000 7ff98e200640 1 -- start start 2024-04-01T16:34:28.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.399+0000 7ff98e200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff96c003a00 0x7ff988157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:28.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.399+0000 7ff98e200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff988156eb0 0x7ff9881efd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:28.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.399+0000 7ff98e200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff988158280 0x7ff9881f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:28.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.400+0000 7ff98e200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff9880c7e50 con 0x7ff96c003a00 2024-04-01T16:34:28.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.400+0000 7ff98e200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff9880c7b70 con 0x7ff988158280 2024-04-01T16:34:28.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.400+0000 7ff98e200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff9880c8130 con 0x7ff988156eb0 2024-04-01T16:34:28.400 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.401+0000 7ff987400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff96c003a00 0x7ff988157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:28.400 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.401+0000 7ff987e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff988158280 0x7ff9881f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:28.400 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.401+0000 7ff987400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff96c003a00 0x7ff988157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:41524/0 (socket says 172.21.15.163:41524) 2024-04-01T16:34:28.400 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.401+0000 7ff987400640 1 -- 172.21.15.163:0/3633018974 learned_addr learned my addr 172.21.15.163:0/3633018974 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:28.401 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.402+0000 7ff97fe00640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff988156eb0 0x7ff9881efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:28.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.406+0000 7ff987400640 1 -- 172.21.15.163:0/3633018974 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff988156eb0 msgr2=0x7ff9881efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:28.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.406+0000 7ff987400640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff988156eb0 0x7ff9881efd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:28.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.406+0000 7ff987400640 1 -- 172.21.15.163:0/3633018974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff988158280 msgr2=0x7ff9881f02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:28.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.406+0000 7ff987400640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff988158280 0x7ff9881f02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:28.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.406+0000 7ff987400640 1 -- 172.21.15.163:0/3633018974 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff988155e20 con 0x7ff96c003a00 2024-04-01T16:34:28.408 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.409+0000 7ff987400640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff96c003a00 0x7ff988157730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff978003db0 tx=0x7ff9780036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:28.414 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.414+0000 7ff97f400640 1 -- 172.21.15.163:0/3633018974 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978042070 con 0x7ff96c003a00 2024-04-01T16:34:28.414 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.415+0000 7ff97f400640 1 -- 172.21.15.163:0/3633018974 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff978038040 con 0x7ff96c003a00 2024-04-01T16:34:28.414 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.415+0000 7ff98e200640 1 -- 172.21.15.163:0/3633018974 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff988153920 con 0x7ff96c003a00 2024-04-01T16:34:28.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.415+0000 7ff97f400640 1 -- 172.21.15.163:0/3633018974 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978037070 con 0x7ff96c003a00 2024-04-01T16:34:28.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.415+0000 7ff98e200640 1 -- 172.21.15.163:0/3633018974 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff988153ee0 con 0x7ff96c003a00 2024-04-01T16:34:28.416 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.416+0000 7ff98e200640 1 -- 172.21.15.163:0/3633018974 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9880756d0 con 0x7ff96c003a00 2024-04-01T16:34:28.455 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.456+0000 7ff97f400640 1 -- 172.21.15.163:0/3633018974 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff97803e6a0 con 0x7ff96c003a00 2024-04-01T16:34:28.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.457+0000 7ff97f400640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff96406c940 0x7ff96406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:28.457 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.458+0000 7ff97fe00640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff96406c940 0x7ff96406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:28.459 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.459+0000 7ff97fe00640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff96406c940 0x7ff96406ee00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff9880b0ae0 tx=0x7ff970009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:28.459 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.459+0000 7ff97f400640 1 -- 172.21.15.163:0/3633018974 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff9780823e0 con 0x7ff96c003a00 2024-04-01T16:34:28.764 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.764+0000 7ff97f400640 1 -- 172.21.15.163:0/3633018974 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff97807bbf0 con 0x7ff96c003a00 2024-04-01T16:34:28.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:28.981+0000 7ff98e200640 1 -- 172.21.15.163:0/3633018974 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff9880c63d0 con 0x7ff96c003a00 2024-04-01T16:34:30.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.113+0000 7ff97f400640 1 -- 172.21.15.163:0/3633018974 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7ff97807fef0 con 0x7ff96c003a00 2024-04-01T16:34:30.112 INFO:teuthology.orchestra.run.smithi163.stderr:pool 'cephfs_metadata' created 2024-04-01T16:34:30.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.116+0000 7ff98e200640 1 -- 172.21.15.163:0/3633018974 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff96406c940 msgr2=0x7ff96406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:30.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.116+0000 7ff98e200640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff96406c940 0x7ff96406ee00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff9880b0ae0 tx=0x7ff970009190 comp rx=0 tx=0).stop 2024-04-01T16:34:30.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.116+0000 7ff98e200640 1 -- 172.21.15.163:0/3633018974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff96c003a00 msgr2=0x7ff988157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:30.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.116+0000 7ff98e200640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff96c003a00 0x7ff988157730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff978003db0 tx=0x7ff9780036f0 comp rx=0 tx=0).stop 2024-04-01T16:34:30.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.116+0000 7ff98e200640 1 -- 172.21.15.163:0/3633018974 shutdown_connections 2024-04-01T16:34:30.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.116+0000 7ff98e200640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff96406c940 0x7ff96406ee00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:30.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.116+0000 7ff98e200640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff988158280 0x7ff9881f02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:30.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.116+0000 7ff98e200640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff988156eb0 0x7ff9881efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:30.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.116+0000 7ff98e200640 1 --2- 172.21.15.163:0/3633018974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff96c003a00 0x7ff988157730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:30.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.116+0000 7ff98e200640 1 -- 172.21.15.163:0/3633018974 >> 172.21.15.163:0/3633018974 conn(0x7ff9880c8a00 msgr2=0x7ff98806dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:30.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.116+0000 7ff98e200640 1 -- 172.21.15.163:0/3633018974 shutdown_connections 2024-04-01T16:34:30.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.116+0000 7ff98e200640 1 -- 172.21.15.163:0/3633018974 wait complete. 2024-04-01T16:34:30.141 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-01T16:34:30.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.354+0000 7fc063200640 1 Processor -- start 2024-04-01T16:34:30.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.354+0000 7fc063200640 1 -- start start 2024-04-01T16:34:30.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.356+0000 7fc063200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc05c152a10 0x7fc05c06eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:30.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.356+0000 7fc063200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc05c0c4800 0x7fc05c158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:30.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.356+0000 7fc063200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc05c0c7620 con 0x7fc05c158bb0 2024-04-01T16:34:30.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.356+0000 7fc063200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fc05c152df0 con 0x7fc05c152a10 2024-04-01T16:34:30.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.356+0000 7fc063200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc05c06ead0 con 0x7fc05c0c4800 2024-04-01T16:34:30.356 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.357+0000 7fc05be00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc05c152a10 0x7fc05c06eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:30.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.358+0000 7fc05be00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc05c152a10 0x7fc05c06eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:41532/0 (socket says 172.21.15.163:41532) 2024-04-01T16:34:30.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.358+0000 7fc05be00640 1 -- 172.21.15.163:0/2000625463 learned_addr learned my addr 172.21.15.163:0/2000625463 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:30.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.361+0000 7fc05be00640 1 -- 172.21.15.163:0/2000625463 >> v2:172.21.15.189:3300/0 conn(0x7fc05c0c4800 msgr2=0x7fc05c158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:30.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.361+0000 7fc05be00640 1 --2- 172.21.15.163:0/2000625463 >> v2:172.21.15.189:3300/0 conn(0x7fc05c0c4800 0x7fc05c158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:30.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.361+0000 7fc05be00640 1 -- 172.21.15.163:0/2000625463 >> v1:172.21.15.163:6789/0 conn(0x7fc05c158bb0 legacy=0x7fc05c15bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:30.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.361+0000 7fc05be00640 1 -- 172.21.15.163:0/2000625463 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05c0c7890 con 0x7fc05c152a10 2024-04-01T16:34:30.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.372+0000 7fc05be00640 1 --2- 172.21.15.163:0/2000625463 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc05c152a10 0x7fc05c06eec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc05c06f910 tx=0x7fc04c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd8bc54a90766d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:30.383 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.384+0000 7fc05b400640 1 -- 172.21.15.163:0/2000625463 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c034070 con 0x7fc05c152a10 2024-04-01T16:34:30.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.384+0000 7fc05b400640 1 -- 172.21.15.163:0/2000625463 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc04c030860 con 0x7fc05c152a10 2024-04-01T16:34:30.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.384+0000 7fc05b400640 1 -- 172.21.15.163:0/2000625463 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c030c30 con 0x7fc05c152a10 2024-04-01T16:34:30.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.385+0000 7fc063200640 1 -- 172.21.15.163:0/2000625463 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc05c152a10 msgr2=0x7fc05c06eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:30.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.385+0000 7fc063200640 1 --2- 172.21.15.163:0/2000625463 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc05c152a10 0x7fc05c06eec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc05c06f910 tx=0x7fc04c02b9a0 comp rx=0 tx=0).stop 2024-04-01T16:34:30.385 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.385+0000 7fc063200640 1 -- 172.21.15.163:0/2000625463 shutdown_connections 2024-04-01T16:34:30.385 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.385+0000 7fc063200640 1 --2- 172.21.15.163:0/2000625463 >> v2:172.21.15.189:3300/0 conn(0x7fc05c0c4800 0x7fc05c158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:30.385 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.385+0000 7fc063200640 1 --2- 172.21.15.163:0/2000625463 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc05c152a10 0x7fc05c06eec0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:30.385 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.385+0000 7fc063200640 1 -- 172.21.15.163:0/2000625463 >> 172.21.15.163:0/2000625463 conn(0x7fc05c0c8a00 msgr2=0x7fc05c0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:30.385 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.385+0000 7fc063200640 1 -- 172.21.15.163:0/2000625463 shutdown_connections 2024-04-01T16:34:30.385 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.385+0000 7fc063200640 1 -- 172.21.15.163:0/2000625463 wait complete. 2024-04-01T16:34:30.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.388+0000 7fc063200640 1 Processor -- start 2024-04-01T16:34:30.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.388+0000 7fc063200640 1 -- start start 2024-04-01T16:34:30.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.389+0000 7fc063200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc05c0c4800 0x7fc05c1ee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:30.389 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.389+0000 7fc063200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc05c152a10 0x7fc05c1ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:30.389 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.389+0000 7fc063200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc05c158bb0 0x7fc05c157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:30.389 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.389+0000 7fc063200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c0c8130 con 0x7fc05c152a10 2024-04-01T16:34:30.389 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.389+0000 7fc063200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c0c7e50 con 0x7fc05c0c4800 2024-04-01T16:34:30.389 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.389+0000 7fc063200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc05c06e6b0 con 0x7fc05c158bb0 2024-04-01T16:34:30.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.391+0000 7fc061200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc05c158bb0 0x7fc05c157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:30.391 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.392+0000 7fc061200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc05c158bb0 0x7fc05c157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:52240/0 (socket says 172.21.15.163:52240) 2024-04-01T16:34:30.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.392+0000 7fc061200640 1 -- 172.21.15.163:0/60281149 learned_addr learned my addr 172.21.15.163:0/60281149 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:30.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.393+0000 7fc05be00640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc05c0c4800 0x7fc05c1ee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:30.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.396+0000 7fc053400640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc05c152a10 0x7fc05c1ee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:30.408 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.409+0000 7fc061200640 1 -- 172.21.15.163:0/60281149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc05c0c4800 msgr2=0x7fc05c1ee2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:30.409 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.409+0000 7fc061200640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc05c0c4800 0x7fc05c1ee2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:30.409 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.409+0000 7fc061200640 1 -- 172.21.15.163:0/60281149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc05c152a10 msgr2=0x7fc05c1ee7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:30.409 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.409+0000 7fc061200640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc05c152a10 0x7fc05c1ee7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:30.409 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.409+0000 7fc061200640 1 -- 172.21.15.163:0/60281149 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05c1f19c0 con 0x7fc05c158bb0 2024-04-01T16:34:30.428 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.429+0000 7fc061200640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc05c158bb0 0x7fc05c157590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c760 tx=0x7fc05400cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:30.523 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.523+0000 7fc058c00640 1 -- 172.21.15.163:0/60281149 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054016020 con 0x7fc05c158bb0 2024-04-01T16:34:30.523 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.523+0000 7fc058c00640 1 -- 172.21.15.163:0/60281149 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc054006d50 con 0x7fc05c158bb0 2024-04-01T16:34:30.523 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.523+0000 7fc058c00640 1 -- 172.21.15.163:0/60281149 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054003bb0 con 0x7fc05c158bb0 2024-04-01T16:34:30.523 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.523+0000 7fc063200640 1 -- 172.21.15.163:0/60281149 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc05c155fd0 con 0x7fc05c158bb0 2024-04-01T16:34:30.523 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.524+0000 7fc063200640 1 -- 172.21.15.163:0/60281149 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc05c1f1c60 con 0x7fc05c158bb0 2024-04-01T16:34:30.525 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.525+0000 7fc063200640 1 -- 172.21.15.163:0/60281149 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc05c0c3130 con 0x7fc05c158bb0 2024-04-01T16:34:30.862 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.862+0000 7fc058c00640 1 -- 172.21.15.163:0/60281149 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc0540050d0 con 0x7fc05c158bb0 2024-04-01T16:34:30.864 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.864+0000 7fc058c00640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc03806c940 0x7fc03806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:30.865 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.865+0000 7fc05be00640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc03806c940 0x7fc03806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:30.866 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.867+0000 7fc05be00640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc03806c940 0x7fc03806ee00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc04c036000 tx=0x7fc04c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:30.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.870+0000 7fc058c00640 1 -- 172.21.15.163:0/60281149 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7fc054058210 con 0x7fc05c158bb0 2024-04-01T16:34:30.902 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:30.903+0000 7fc058c00640 1 -- 172.21.15.163:0/60281149 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc05c0c3130 con 0x7fc05c158bb0 2024-04-01T16:34:31.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:31.136+0000 7fc063200640 1 -- 172.21.15.163:0/60281149 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc05c0756d0 con 0x7fc05c158bb0 2024-04-01T16:34:32.871 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.870+0000 7fc058c00640 1 -- 172.21.15.163:0/60281149 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7fc054020020 con 0x7fc05c158bb0 2024-04-01T16:34:32.871 INFO:teuthology.orchestra.run.smithi163.stderr:pool 'cephfs_data' created 2024-04-01T16:34:32.877 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.875+0000 7fc063200640 1 -- 172.21.15.163:0/60281149 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc03806c940 msgr2=0x7fc03806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:32.877 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.875+0000 7fc063200640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc03806c940 0x7fc03806ee00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc04c036000 tx=0x7fc04c008030 comp rx=0 tx=0).stop 2024-04-01T16:34:32.877 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.875+0000 7fc063200640 1 -- 172.21.15.163:0/60281149 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc05c158bb0 msgr2=0x7fc05c157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:32.877 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.875+0000 7fc063200640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc05c158bb0 0x7fc05c157590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c760 tx=0x7fc05400cb60 comp rx=0 tx=0).stop 2024-04-01T16:34:32.880 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.880+0000 7fc063200640 1 -- 172.21.15.163:0/60281149 shutdown_connections 2024-04-01T16:34:32.880 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.880+0000 7fc063200640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc03806c940 0x7fc03806ee00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:32.880 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.880+0000 7fc063200640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc05c158bb0 0x7fc05c157590 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:32.880 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.880+0000 7fc063200640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc05c152a10 0x7fc05c1ee7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:32.880 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.880+0000 7fc063200640 1 --2- 172.21.15.163:0/60281149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc05c0c4800 0x7fc05c1ee2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:32.880 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.880+0000 7fc063200640 1 -- 172.21.15.163:0/60281149 >> 172.21.15.163:0/60281149 conn(0x7fc05c0c8a00 msgr2=0x7fc05c06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:32.880 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.881+0000 7fc063200640 1 -- 172.21.15.163:0/60281149 shutdown_connections 2024-04-01T16:34:32.881 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:32.881+0000 7fc063200640 1 -- 172.21.15.163:0/60281149 wait complete. 2024-04-01T16:34:32.903 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-01T16:34:33.092 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.092+0000 7f4ee3c00640 1 Processor -- start 2024-04-01T16:34:33.092 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.093+0000 7f4ee3c00640 1 -- start start 2024-04-01T16:34:33.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.094+0000 7f4ee3c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4edc15b480 0x7f4edc0cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:33.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.094+0000 7f4ee3c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4edc0cc8c0 con 0x7f4edc06c480 2024-04-01T16:34:33.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.094+0000 7f4ee3c00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4edc15b970 con 0x7f4edc0cc470 2024-04-01T16:34:33.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.094+0000 7f4ee3c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f4edc0ca9d0 con 0x7f4edc15b480 2024-04-01T16:34:33.097 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.098+0000 7f4ee1c00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f4edc0cc470 0x7f4edc165380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:57042/0 (socket says 172.21.15.163:57042) 2024-04-01T16:34:33.097 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.098+0000 7f4ee1c00640 1 -- 172.21.15.163:0/4007932902 learned_addr learned my addr 172.21.15.163:0/4007932902 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:33.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.108+0000 7f4edbe00640 1 --2- 172.21.15.163:0/4007932902 >> v2:172.21.15.163:3300/0 conn(0x7f4edc15b480 0x7f4edc0cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:33.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.121+0000 7f4edbe00640 1 -- 172.21.15.163:0/4007932902 >> v1:172.21.15.189:6789/0 conn(0x7f4edc0cc470 legacy=0x7f4edc165380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:33.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.122+0000 7f4edbe00640 1 -- 172.21.15.163:0/4007932902 >> v1:172.21.15.163:6789/0 conn(0x7f4edc06c480 legacy=0x7f4edc0cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:33.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.122+0000 7f4edbe00640 1 -- 172.21.15.163:0/4007932902 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4edc0d0800 con 0x7f4edc15b480 2024-04-01T16:34:33.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.129+0000 7f4edbe00640 1 --2- 172.21.15.163:0/4007932902 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4edc15b480 0x7f4edc0cbce0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40097a0 tx=0x7f4ec402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8517292dd2c683b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:33.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.240+0000 7f4edb400640 1 -- 172.21.15.163:0/4007932902 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec402f810 con 0x7f4edc15b480 2024-04-01T16:34:33.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.240+0000 7f4edb400640 1 -- 172.21.15.163:0/4007932902 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ec402f9b0 con 0x7f4edc15b480 2024-04-01T16:34:33.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.240+0000 7f4edb400640 1 -- 172.21.15.163:0/4007932902 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec402fd80 con 0x7f4edc15b480 2024-04-01T16:34:33.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.241+0000 7f4ee3c00640 1 -- 172.21.15.163:0/4007932902 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4edc15b480 msgr2=0x7f4edc0cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:33.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.241+0000 7f4ee3c00640 1 --2- 172.21.15.163:0/4007932902 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4edc15b480 0x7f4edc0cbce0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40097a0 tx=0x7f4ec402b9f0 comp rx=0 tx=0).stop 2024-04-01T16:34:33.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.242+0000 7f4ee3c00640 1 -- 172.21.15.163:0/4007932902 shutdown_connections 2024-04-01T16:34:33.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.242+0000 7f4ee3c00640 1 --2- 172.21.15.163:0/4007932902 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4edc15b480 0x7f4edc0cbce0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:33.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.242+0000 7f4ee3c00640 1 -- 172.21.15.163:0/4007932902 >> 172.21.15.163:0/4007932902 conn(0x7f4edc0678b0 msgr2=0x7f4edc0d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:33.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.242+0000 7f4ee3c00640 1 -- 172.21.15.163:0/4007932902 shutdown_connections 2024-04-01T16:34:33.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.242+0000 7f4ee3c00640 1 -- 172.21.15.163:0/4007932902 wait complete. 2024-04-01T16:34:33.246 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.246+0000 7f4ee3c00640 1 Processor -- start 2024-04-01T16:34:33.246 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.247+0000 7f4ee3c00640 1 -- start start 2024-04-01T16:34:33.249 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.249+0000 7f4ee3c00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4edc06c480 0x7f4edc1f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:33.249 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.249+0000 7f4ee3c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4edc0cc470 0x7f4edc151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:33.249 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.249+0000 7f4ee3c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4edc15b480 0x7f4edc15c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:33.249 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.249+0000 7f4ee3c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4edc0caf00 con 0x7f4edc15b480 2024-04-01T16:34:33.249 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.249+0000 7f4ee3c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4edc0cac20 con 0x7f4edc0cc470 2024-04-01T16:34:33.249 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.249+0000 7f4ee3c00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4edc0c5580 con 0x7f4edc06c480 2024-04-01T16:34:33.250 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.251+0000 7f4ee1200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4edc06c480 0x7f4edc1f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:33.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.252+0000 7f4ee1200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4edc06c480 0x7f4edc1f06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:35244/0 (socket says 172.21.15.163:35244) 2024-04-01T16:34:33.252 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.252+0000 7f4ee1200640 1 -- 172.21.15.163:0/897014017 learned_addr learned my addr 172.21.15.163:0/897014017 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:33.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.258+0000 7f4edbe00640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4edc0cc470 0x7f4edc151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:33.262 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.262+0000 7f4ee1200640 1 -- 172.21.15.163:0/897014017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4edc0cc470 msgr2=0x7f4edc151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:33.262 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.262+0000 7f4ee1200640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4edc0cc470 0x7f4edc151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:33.262 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.262+0000 7f4ee1200640 1 -- 172.21.15.163:0/897014017 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4edc15b480 msgr2=0x7f4edc15c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:33.262 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.262+0000 7f4ee1200640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4edc15b480 0x7f4edc15c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:33.262 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.262+0000 7f4ee1200640 1 -- 172.21.15.163:0/897014017 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4edc1f15f0 con 0x7f4edc06c480 2024-04-01T16:34:33.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.269+0000 7f4ee1200640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4edc06c480 0x7f4edc1f06c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00c730 tx=0x7f4ecc00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:33.278 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.278+0000 7f4ed8c00640 1 -- 172.21.15.163:0/897014017 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc016020 con 0x7f4edc06c480 2024-04-01T16:34:33.278 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.278+0000 7f4ed8c00640 1 -- 172.21.15.163:0/897014017 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ecc006d50 con 0x7f4edc06c480 2024-04-01T16:34:33.278 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.278+0000 7f4ed8c00640 1 -- 172.21.15.163:0/897014017 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc003bb0 con 0x7f4edc06c480 2024-04-01T16:34:33.278 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.278+0000 7f4ee3c00640 1 -- 172.21.15.163:0/897014017 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4edc1f0d50 con 0x7f4edc06c480 2024-04-01T16:34:33.278 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.279+0000 7f4ee3c00640 1 -- 172.21.15.163:0/897014017 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4edc1f1310 con 0x7f4edc06c480 2024-04-01T16:34:33.279 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.280+0000 7f4ee3c00640 1 -- 172.21.15.163:0/897014017 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4edc0756d0 con 0x7f4edc06c480 2024-04-01T16:34:33.340 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.340+0000 7f4ed8c00640 1 -- 172.21.15.163:0/897014017 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ecc00a850 con 0x7f4edc06c480 2024-04-01T16:34:33.341 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.342+0000 7f4ed8c00640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f4eb806c940 0x7f4eb806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:33.342 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.342+0000 7f4edbe00640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f4eb806c940 0x7f4eb806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:33.343 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.344+0000 7f4edbe00640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f4eb806c940 0x7f4eb806ee00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4036000 tx=0x7f4ec4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:33.346 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.347+0000 7f4ed8c00640 1 -- 172.21.15.163:0/897014017 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f4ecc058380 con 0x7f4edc06c480 2024-04-01T16:34:33.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.696+0000 7f4ed8c00640 1 -- 172.21.15.163:0/897014017 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4ecc020020 con 0x7f4edc06c480 2024-04-01T16:34:33.993 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:33.993+0000 7f4ee3c00640 1 -- 172.21.15.163:0/897014017 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4edc0d0eb0 con 0x7f4edc06c480 2024-04-01T16:34:35.318 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.318+0000 7f4ed8c00640 1 -- 172.21.15.163:0/897014017 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f4edc0cc8c0 con 0x7f4edc06c480 2024-04-01T16:34:35.318 INFO:teuthology.orchestra.run.smithi163.stderr:new fs with metadata pool 2 and data pool 3 2024-04-01T16:34:35.321 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.321+0000 7f4ee3c00640 1 -- 172.21.15.163:0/897014017 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f4eb806c940 msgr2=0x7f4eb806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:35.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.321+0000 7f4ee3c00640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f4eb806c940 0x7f4eb806ee00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4036000 tx=0x7f4ec4008030 comp rx=0 tx=0).stop 2024-04-01T16:34:35.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.322+0000 7f4ee3c00640 1 -- 172.21.15.163:0/897014017 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4edc06c480 msgr2=0x7f4edc1f06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:35.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.322+0000 7f4ee3c00640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4edc06c480 0x7f4edc1f06c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00c730 tx=0x7f4ecc00cbf0 comp rx=0 tx=0).stop 2024-04-01T16:34:35.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.322+0000 7f4ee3c00640 1 -- 172.21.15.163:0/897014017 shutdown_connections 2024-04-01T16:34:35.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.322+0000 7f4ee3c00640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f4eb806c940 0x7f4eb806ee00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:35.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.322+0000 7f4ee3c00640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4edc15b480 0x7f4edc15c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:35.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.322+0000 7f4ee3c00640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4edc0cc470 0x7f4edc151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:35.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.322+0000 7f4ee3c00640 1 --2- 172.21.15.163:0/897014017 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4edc06c480 0x7f4edc1f06c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:35.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.322+0000 7f4ee3c00640 1 -- 172.21.15.163:0/897014017 >> 172.21.15.163:0/897014017 conn(0x7f4edc0678b0 msgr2=0x7f4edc0ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:35.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.322+0000 7f4ee3c00640 1 -- 172.21.15.163:0/897014017 shutdown_connections 2024-04-01T16:34:35.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.322+0000 7f4ee3c00640 1 -- 172.21.15.163:0/897014017 wait complete. 2024-04-01T16:34:35.344 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T16:34:35.540 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.541+0000 7f86c5a00640 1 Processor -- start 2024-04-01T16:34:35.540 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.541+0000 7f86c5a00640 1 -- start start 2024-04-01T16:34:35.542 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.542+0000 7f86c5a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86c0159010 0x7f86c00c5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:35.542 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.543+0000 7f86c5a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c0072090 con 0x7f86c00c8fe0 2024-04-01T16:34:35.542 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.543+0000 7f86c5a00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c015bb90 con 0x7f86c00c57a0 2024-04-01T16:34:35.542 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.543+0000 7f86c5a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f86c015b960 con 0x7f86c0159010 2024-04-01T16:34:35.544 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.544+0000 7f86bf400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86c0159010 0x7f86c00c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:35.544 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.545+0000 7f86c5000640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f86c00c57a0 0x7f86c0072540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:57048/0 (socket says 172.21.15.163:57048) 2024-04-01T16:34:35.544 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.545+0000 7f86c5000640 1 -- 172.21.15.163:0/572939021 learned_addr learned my addr 172.21.15.163:0/572939021 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:35.550 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.550+0000 7f86bf400640 1 -- 172.21.15.163:0/572939021 >> v1:172.21.15.189:6789/0 conn(0x7f86c00c57a0 legacy=0x7f86c0072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:35.550 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.550+0000 7f86bf400640 1 -- 172.21.15.163:0/572939021 >> v1:172.21.15.163:6789/0 conn(0x7f86c00c8fe0 legacy=0x7f86c006be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:35.550 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.550+0000 7f86bf400640 1 -- 172.21.15.163:0/572939021 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c006c560 con 0x7f86c0159010 2024-04-01T16:34:35.558 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.559+0000 7f86bf400640 1 --2- 172.21.15.163:0/572939021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86c0159010 0x7f86c00c5260 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86a80097d0 tx=0x7f86a802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eecd2f7006bbe8c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:35.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.568+0000 7f86bea00640 1 -- 172.21.15.163:0/572939021 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8035020 con 0x7f86c0159010 2024-04-01T16:34:35.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.568+0000 7f86bea00640 1 -- 172.21.15.163:0/572939021 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a8031890 con 0x7f86c0159010 2024-04-01T16:34:35.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.568+0000 7f86bea00640 1 -- 172.21.15.163:0/572939021 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8031c60 con 0x7f86c0159010 2024-04-01T16:34:35.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.569+0000 7f86c5a00640 1 -- 172.21.15.163:0/572939021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86c0159010 msgr2=0x7f86c00c5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:35.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.569+0000 7f86c5a00640 1 --2- 172.21.15.163:0/572939021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86c0159010 0x7f86c00c5260 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86a80097d0 tx=0x7f86a802b930 comp rx=0 tx=0).stop 2024-04-01T16:34:35.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.569+0000 7f86c5a00640 1 -- 172.21.15.163:0/572939021 shutdown_connections 2024-04-01T16:34:35.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.569+0000 7f86c5a00640 1 --2- 172.21.15.163:0/572939021 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86c0159010 0x7f86c00c5260 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:35.569 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.569+0000 7f86c5a00640 1 -- 172.21.15.163:0/572939021 >> 172.21.15.163:0/572939021 conn(0x7f86c006f7d0 msgr2=0x7f86c006fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:35.569 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.569+0000 7f86c5a00640 1 -- 172.21.15.163:0/572939021 shutdown_connections 2024-04-01T16:34:35.569 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.569+0000 7f86c5a00640 1 -- 172.21.15.163:0/572939021 wait complete. 2024-04-01T16:34:35.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.571+0000 7f86c5a00640 1 Processor -- start 2024-04-01T16:34:35.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.572+0000 7f86c5a00640 1 -- start start 2024-04-01T16:34:35.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.573+0000 7f86c5a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86c00c57a0 0x7f86c00c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:35.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.573+0000 7f86c5a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86c00c8fe0 0x7f86c0154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:35.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.573+0000 7f86c5a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86c0159010 0x7f86c0155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:35.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.573+0000 7f86c5a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f86c015c410 con 0x7f86c00c8fe0 2024-04-01T16:34:35.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.573+0000 7f86c5a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f86c015c130 con 0x7f86c00c57a0 2024-04-01T16:34:35.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.573+0000 7f86c5a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f86c015c6f0 con 0x7f86c0159010 2024-04-01T16:34:35.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.574+0000 7f86bf400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86c00c8fe0 0x7f86c0154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:35.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.575+0000 7f86bf400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86c00c8fe0 0x7f86c0154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:42396/0 (socket says 172.21.15.163:42396) 2024-04-01T16:34:35.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.575+0000 7f86bf400640 1 -- 172.21.15.163:0/2157702855 learned_addr learned my addr 172.21.15.163:0/2157702855 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:35.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.575+0000 7f86bfe00640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86c00c57a0 0x7f86c00c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:35.575 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.576+0000 7f86c5000640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86c0159010 0x7f86c0155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:35.580 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.581+0000 7f86bf400640 1 -- 172.21.15.163:0/2157702855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86c0159010 msgr2=0x7f86c0155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:35.580 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.581+0000 7f86bf400640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86c0159010 0x7f86c0155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:35.580 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.581+0000 7f86bf400640 1 -- 172.21.15.163:0/2157702855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86c00c57a0 msgr2=0x7f86c00c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:35.580 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.581+0000 7f86bf400640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86c00c57a0 0x7f86c00c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:35.580 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.581+0000 7f86bf400640 1 -- 172.21.15.163:0/2157702855 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c00aec70 con 0x7f86c00c8fe0 2024-04-01T16:34:35.584 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.585+0000 7f86bf400640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86c00c8fe0 0x7f86c0154af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f86a8000c00 tx=0x7f86a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:35.590 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.590+0000 7f86b7e00640 1 -- 172.21.15.163:0/2157702855 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8040070 con 0x7f86c00c8fe0 2024-04-01T16:34:35.590 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.590+0000 7f86b7e00640 1 -- 172.21.15.163:0/2157702855 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a803a420 con 0x7f86c00c8fe0 2024-04-01T16:34:35.590 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.590+0000 7f86b7e00640 1 -- 172.21.15.163:0/2157702855 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8035040 con 0x7f86c00c8fe0 2024-04-01T16:34:35.590 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.590+0000 7f86c5a00640 1 -- 172.21.15.163:0/2157702855 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c0152de0 con 0x7f86c00c8fe0 2024-04-01T16:34:35.590 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.591+0000 7f86c5a00640 1 -- 172.21.15.163:0/2157702855 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c01f4480 con 0x7f86c00c8fe0 2024-04-01T16:34:35.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.592+0000 7f86c5a00640 1 -- 172.21.15.163:0/2157702855 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c00756d0 con 0x7f86c00c8fe0 2024-04-01T16:34:35.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.616+0000 7f86b7e00640 1 -- 172.21.15.163:0/2157702855 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86a804b060 con 0x7f86c00c8fe0 2024-04-01T16:34:35.616 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.617+0000 7f86b7e00640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f869c06c940 0x7f869c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:35.616 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.617+0000 7f86bfe00640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f869c06c940 0x7f869c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:35.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.618+0000 7f86bfe00640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f869c06c940 0x7f869c06ee00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86b0001780 tx=0x7f86b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:35.993 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.993+0000 7f86b7e00640 1 -- 172.21.15.163:0/2157702855 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f86a8031830 con 0x7f86c00c8fe0 2024-04-01T16:34:35.994 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:35.994+0000 7f86b7e00640 1 -- 172.21.15.163:0/2157702855 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f86c00aec70 con 0x7f86c00c8fe0 2024-04-01T16:34:36.208 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.208+0000 7f86c5a00640 1 -- 172.21.15.163:0/2157702855 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86c00cb530 con 0x7f86c00c8fe0 2024-04-01T16:34:36.265 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.265+0000 7f86b7e00640 1 -- 172.21.15.163:0/2157702855 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16666 (secure 0 0 0) 0x7f86a802d040 con 0x7f86c00c8fe0 2024-04-01T16:34:36.266 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:36.266 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":23,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:34.143948+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T16:34:29.028272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T16:34:31.534879+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:34:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.269+0000 7f86c5a00640 1 -- 172.21.15.163:0/2157702855 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f869c06c940 msgr2=0x7f869c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.269+0000 7f86c5a00640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f869c06c940 0x7f869c06ee00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86b0001780 tx=0x7f86b0009040 comp rx=0 tx=0).stop 2024-04-01T16:34:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.269+0000 7f86c5a00640 1 -- 172.21.15.163:0/2157702855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86c00c8fe0 msgr2=0x7f86c0154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.269+0000 7f86c5a00640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86c00c8fe0 0x7f86c0154af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f86a8000c00 tx=0x7f86a80046c0 comp rx=0 tx=0).stop 2024-04-01T16:34:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.269+0000 7f86c5a00640 1 -- 172.21.15.163:0/2157702855 shutdown_connections 2024-04-01T16:34:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.269+0000 7f86c5a00640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f869c06c940 0x7f869c06ee00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.269+0000 7f86c5a00640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f86c0159010 0x7f86c0155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.269+0000 7f86c5a00640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86c00c8fe0 0x7f86c0154af0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.269+0000 7f86c5a00640 1 --2- 172.21.15.163:0/2157702855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f86c00c57a0 0x7f86c00c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.269+0000 7f86c5a00640 1 -- 172.21.15.163:0/2157702855 >> 172.21.15.163:0/2157702855 conn(0x7f86c006f7d0 msgr2=0x7f86c00c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:36.270 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.269+0000 7f86c5a00640 1 -- 172.21.15.163:0/2157702855 shutdown_connections 2024-04-01T16:34:36.270 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.269+0000 7f86c5a00640 1 -- 172.21.15.163:0/2157702855 wait complete. 2024-04-01T16:34:36.289 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T16:34:36.494 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.494+0000 7f48b5800640 1 Processor -- start 2024-04-01T16:34:36.494 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.494+0000 7f48b5800640 1 -- start start 2024-04-01T16:34:36.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.496+0000 7f48b5800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f48b0158e80 0x7f48b00c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:36.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.496+0000 7f48b5800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f48b0073330 0x7f48b00726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:36.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.496+0000 7f48b5800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f48b00c4a40 0x7f48b0072c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:36.496 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.496+0000 7f48b5800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f48b015efd0 con 0x7f48b0158e80 2024-04-01T16:34:36.496 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.496+0000 7f48b5800640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f48b00c7a60 con 0x7f48b00c4a40 2024-04-01T16:34:36.496 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.496+0000 7f48b5800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f48b006b670 con 0x7f48b0073330 2024-04-01T16:34:36.500 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.501+0000 7f48af400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f48b00c4a40 0x7f48b0072c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:36.505 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.505+0000 7f48af400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f48b00c4a40 0x7f48b0072c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:59592/0 (socket says 172.21.15.163:59592) 2024-04-01T16:34:36.505 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.505+0000 7f48af400640 1 -- 172.21.15.163:0/2577806348 learned_addr learned my addr 172.21.15.163:0/2577806348 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:36.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.511+0000 7f48aea00640 1 --2- 172.21.15.163:0/2577806348 >> v2:172.21.15.163:3300/0 conn(0x7f48b0158e80 0x7f48b00c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:36.515 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.515+0000 7f48aea00640 1 -- 172.21.15.163:0/2577806348 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f48b0073330 msgr2=0x7f48b00726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:36.515 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.515+0000 7f48aea00640 1 --2- 172.21.15.163:0/2577806348 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f48b0073330 0x7f48b00726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:36.515 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.515+0000 7f48aea00640 1 -- 172.21.15.163:0/2577806348 >> v2:172.21.15.189:3300/0 conn(0x7f48b00c4a40 msgr2=0x7f48b0072c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:36.515 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.515+0000 7f48aea00640 1 --2- 172.21.15.163:0/2577806348 >> v2:172.21.15.189:3300/0 conn(0x7f48b00c4a40 0x7f48b0072c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:36.515 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.515+0000 7f48aea00640 1 -- 172.21.15.163:0/2577806348 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b006b910 con 0x7f48b0158e80 2024-04-01T16:34:36.517 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.518+0000 7f48aea00640 1 --2- 172.21.15.163:0/2577806348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b0158e80 0x7f48b00c7520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f48b0073980 tx=0x7f48a802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e134e9812ce28ae server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:36.527 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.527+0000 7f48ad600640 1 -- 172.21.15.163:0/2577806348 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8039070 con 0x7f48b0158e80 2024-04-01T16:34:36.527 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.527+0000 7f48ad600640 1 -- 172.21.15.163:0/2577806348 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a802cbd0 con 0x7f48b0158e80 2024-04-01T16:34:36.527 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.527+0000 7f48ad600640 1 -- 172.21.15.163:0/2577806348 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8034440 con 0x7f48b0158e80 2024-04-01T16:34:36.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.529+0000 7f48b5800640 1 -- 172.21.15.163:0/2577806348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b0158e80 msgr2=0x7f48b00c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:36.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.529+0000 7f48b5800640 1 --2- 172.21.15.163:0/2577806348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b0158e80 0x7f48b00c7520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f48b0073980 tx=0x7f48a802be20 comp rx=0 tx=0).stop 2024-04-01T16:34:36.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.529+0000 7f48b5800640 1 -- 172.21.15.163:0/2577806348 shutdown_connections 2024-04-01T16:34:36.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.529+0000 7f48b5800640 1 --2- 172.21.15.163:0/2577806348 >> v2:172.21.15.189:3300/0 conn(0x7f48b00c4a40 0x7f48b0072c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:36.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.529+0000 7f48b5800640 1 --2- 172.21.15.163:0/2577806348 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f48b0073330 0x7f48b00726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:36.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.529+0000 7f48b5800640 1 --2- 172.21.15.163:0/2577806348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b0158e80 0x7f48b00c7520 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:36.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.529+0000 7f48b5800640 1 -- 172.21.15.163:0/2577806348 >> 172.21.15.163:0/2577806348 conn(0x7f48b00c8f80 msgr2=0x7f48b00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:36.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.529+0000 7f48b5800640 1 -- 172.21.15.163:0/2577806348 shutdown_connections 2024-04-01T16:34:36.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.529+0000 7f48b5800640 1 -- 172.21.15.163:0/2577806348 wait complete. 2024-04-01T16:34:36.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.531+0000 7f48b5800640 1 Processor -- start 2024-04-01T16:34:36.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.532+0000 7f48b5800640 1 -- start start 2024-04-01T16:34:36.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.533+0000 7f48b5800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48b0073330 0x7f48b01e5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:36.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.533+0000 7f48b5800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f48b00c4a40 0x7f48b01e4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:36.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.533+0000 7f48b5800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b01eb9e0 0x7f48b01e5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:36.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.533+0000 7f48b5800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f48b006c1b0 con 0x7f48b01eb9e0 2024-04-01T16:34:36.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.533+0000 7f48b5800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48b006bed0 con 0x7f48b0073330 2024-04-01T16:34:36.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.533+0000 7f48b5800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f48b00c3980 con 0x7f48b00c4a40 2024-04-01T16:34:36.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.534+0000 7f48af400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b01eb9e0 0x7f48b01e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:36.534 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.534+0000 7f48af400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b01eb9e0 0x7f48b01e5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:42416/0 (socket says 172.21.15.163:42416) 2024-04-01T16:34:36.534 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.534+0000 7f48af400640 1 -- 172.21.15.163:0/3491231394 learned_addr learned my addr 172.21.15.163:0/3491231394 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:36.537 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.538+0000 7f48af400640 1 -- 172.21.15.163:0/3491231394 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f48b00c4a40 msgr2=0x7f48b01e4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:36.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.538+0000 7f48af400640 1 --2- 172.21.15.163:0/3491231394 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f48b00c4a40 0x7f48b01e4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:36.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.538+0000 7f48af400640 1 -- 172.21.15.163:0/3491231394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48b0073330 msgr2=0x7f48b01e5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:36.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.538+0000 7f48af400640 1 --2- 172.21.15.163:0/3491231394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48b0073330 0x7f48b01e5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:36.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.538+0000 7f48af400640 1 -- 172.21.15.163:0/3491231394 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b015b7a0 con 0x7f48b01eb9e0 2024-04-01T16:34:36.540 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.541+0000 7f48af400640 1 --2- 172.21.15.163:0/3491231394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b01eb9e0 0x7f48b01e5910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f48a000d5d0 tx=0x7f48a000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:36.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.543+0000 7f48a6a00640 1 -- 172.21.15.163:0/3491231394 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0018030 con 0x7f48b01eb9e0 2024-04-01T16:34:36.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.544+0000 7f48b5800640 1 -- 172.21.15.163:0/3491231394 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b01f4d30 con 0x7f48b01eb9e0 2024-04-01T16:34:36.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.544+0000 7f48b5800640 1 -- 172.21.15.163:0/3491231394 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b01f4ff0 con 0x7f48b01eb9e0 2024-04-01T16:34:36.544 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.545+0000 7f48b5800640 1 -- 172.21.15.163:0/3491231394 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b00756d0 con 0x7f48b01eb9e0 2024-04-01T16:34:36.545 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.546+0000 7f48a6a00640 1 -- 172.21.15.163:0/3491231394 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a0004020 con 0x7f48b01eb9e0 2024-04-01T16:34:36.545 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.546+0000 7f48a6a00640 1 -- 172.21.15.163:0/3491231394 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a00041d0 con 0x7f48b01eb9e0 2024-04-01T16:34:36.850 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.850+0000 7f48a6a00640 1 -- 172.21.15.163:0/3491231394 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f48a0004370 con 0x7f48b01eb9e0 2024-04-01T16:34:36.852 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.852+0000 7f48a6a00640 1 --2- 172.21.15.163:0/3491231394 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f488c06c8f0 0x7f488c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:36.852 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.853+0000 7f48aea00640 1 --2- 172.21.15.163:0/3491231394 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f488c06c8f0 0x7f488c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:36.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.855+0000 7f48aea00640 1 --2- 172.21.15.163:0/3491231394 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f488c06c8f0 0x7f488c06edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f48a8036000 tx=0x7f48a802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:36.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.896+0000 7f48a6a00640 1 -- 172.21.15.163:0/3491231394 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5709+0+0 (secure 0 0 0) 0x7f48a0058420 con 0x7f48b01eb9e0 2024-04-01T16:34:36.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:36.896+0000 7f48a6a00640 1 -- 172.21.15.163:0/3491231394 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f48a005aa80 con 0x7f48b01eb9e0 2024-04-01T16:34:37.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.129+0000 7f48b5800640 1 -- 172.21.15.163:0/3491231394 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48b00c8d60 con 0x7f48b01eb9e0 2024-04-01T16:34:37.275 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.275+0000 7f48a6a00640 1 -- 172.21.15.163:0/3491231394 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16653 (secure 0 0 0) 0x7f48a005a380 con 0x7f48b01eb9e0 2024-04-01T16:34:37.275 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:37.276 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":24,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:35.880604+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T16:34:29.028272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T16:34:31.534879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:34:37.279 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.279+0000 7f48b5800640 1 -- 172.21.15.163:0/3491231394 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f488c06c8f0 msgr2=0x7f488c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:37.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.280+0000 7f48b5800640 1 --2- 172.21.15.163:0/3491231394 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f488c06c8f0 0x7f488c06edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f48a8036000 tx=0x7f48a802e000 comp rx=0 tx=0).stop 2024-04-01T16:34:37.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.280+0000 7f48b5800640 1 -- 172.21.15.163:0/3491231394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b01eb9e0 msgr2=0x7f48b01e5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:37.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.280+0000 7f48b5800640 1 --2- 172.21.15.163:0/3491231394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b01eb9e0 0x7f48b01e5910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f48a000d5d0 tx=0x7f48a000da90 comp rx=0 tx=0).stop 2024-04-01T16:34:37.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.280+0000 7f48b5800640 1 -- 172.21.15.163:0/3491231394 shutdown_connections 2024-04-01T16:34:37.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.280+0000 7f48b5800640 1 --2- 172.21.15.163:0/3491231394 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f488c06c8f0 0x7f488c06edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:37.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.280+0000 7f48b5800640 1 --2- 172.21.15.163:0/3491231394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48b01eb9e0 0x7f48b01e5910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:37.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.280+0000 7f48b5800640 1 --2- 172.21.15.163:0/3491231394 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f48b00c4a40 0x7f48b01e4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:37.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.280+0000 7f48b5800640 1 --2- 172.21.15.163:0/3491231394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48b0073330 0x7f48b01e5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:37.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.280+0000 7f48b5800640 1 -- 172.21.15.163:0/3491231394 >> 172.21.15.163:0/3491231394 conn(0x7f48b00c8f80 msgr2=0x7f48b00c6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:37.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.280+0000 7f48b5800640 1 -- 172.21.15.163:0/3491231394 shutdown_connections 2024-04-01T16:34:37.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.280+0000 7f48b5800640 1 -- 172.21.15.163:0/3491231394 wait complete. 2024-04-01T16:34:37.307 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-01T16:34:37.530 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.530+0000 7f3e39600640 1 Processor -- start 2024-04-01T16:34:37.530 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.530+0000 7f3e39600640 1 -- start start 2024-04-01T16:34:37.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.532+0000 7f3e39600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e340c9080 0x7f3e3415a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:37.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.532+0000 7f3e39600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3e3415aed0 0x7f3e341544b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:37.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.532+0000 7f3e39600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e340cb860 con 0x7f3e340c9460 2024-04-01T16:34:37.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.532+0000 7f3e39600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f3e3415ede0 con 0x7f3e3415aed0 2024-04-01T16:34:37.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.532+0000 7f3e39600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3e340cb580 con 0x7f3e340c9080 2024-04-01T16:34:37.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.534+0000 7f3e32a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e340c9080 0x7f3e3415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:37.534 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.535+0000 7f3e32a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e340c9080 0x7f3e3415a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:35296/0 (socket says 172.21.15.163:35296) 2024-04-01T16:34:37.534 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.535+0000 7f3e32a00640 1 -- 172.21.15.163:0/991693390 learned_addr learned my addr 172.21.15.163:0/991693390 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:37.541 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.541+0000 7f3e32a00640 1 -- 172.21.15.163:0/991693390 >> v2:172.21.15.163:3300/0 conn(0x7f3e3415aed0 msgr2=0x7f3e341544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:37.542 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.541+0000 7f3e32a00640 1 --2- 172.21.15.163:0/991693390 >> v2:172.21.15.163:3300/0 conn(0x7f3e3415aed0 0x7f3e341544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:37.542 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.541+0000 7f3e32a00640 1 -- 172.21.15.163:0/991693390 >> v1:172.21.15.163:6789/0 conn(0x7f3e340c9460 legacy=0x7f3e340caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:37.542 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.541+0000 7f3e32a00640 1 -- 172.21.15.163:0/991693390 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3415e020 con 0x7f3e340c9080 2024-04-01T16:34:37.553 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.553+0000 7f3e32a00640 1 --2- 172.21.15.163:0/991693390 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e340c9080 0x7f3e3415a990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009870 tx=0x7f3e2402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1521f2c47b49209 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:37.685 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.686+0000 7f3e31600640 1 -- 172.21.15.163:0/991693390 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24035020 con 0x7f3e340c9080 2024-04-01T16:34:37.685 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.686+0000 7f3e31600640 1 -- 172.21.15.163:0/991693390 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e24031640 con 0x7f3e340c9080 2024-04-01T16:34:37.685 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.686+0000 7f3e31600640 1 -- 172.21.15.163:0/991693390 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2402d040 con 0x7f3e340c9080 2024-04-01T16:34:37.687 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.687+0000 7f3e39600640 1 -- 172.21.15.163:0/991693390 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e340c9080 msgr2=0x7f3e3415a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:37.687 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.687+0000 7f3e39600640 1 --2- 172.21.15.163:0/991693390 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e340c9080 0x7f3e3415a990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009870 tx=0x7f3e2402b8f0 comp rx=0 tx=0).stop 2024-04-01T16:34:37.687 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.687+0000 7f3e39600640 1 -- 172.21.15.163:0/991693390 shutdown_connections 2024-04-01T16:34:37.687 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.687+0000 7f3e39600640 1 --2- 172.21.15.163:0/991693390 >> v2:172.21.15.163:3300/0 conn(0x7f3e3415aed0 0x7f3e341544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:37.687 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.687+0000 7f3e39600640 1 --2- 172.21.15.163:0/991693390 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e340c9080 0x7f3e3415a990 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:37.687 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.687+0000 7f3e39600640 1 -- 172.21.15.163:0/991693390 >> 172.21.15.163:0/991693390 conn(0x7f3e34067280 msgr2=0x7f3e34067690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:37.687 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.688+0000 7f3e39600640 1 -- 172.21.15.163:0/991693390 shutdown_connections 2024-04-01T16:34:37.687 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.688+0000 7f3e39600640 1 -- 172.21.15.163:0/991693390 wait complete. 2024-04-01T16:34:37.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.690+0000 7f3e39600640 1 Processor -- start 2024-04-01T16:34:37.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.690+0000 7f3e39600640 1 -- start start 2024-04-01T16:34:37.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.691+0000 7f3e39600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e340c9080 0x7f3e3415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:37.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.691+0000 7f3e39600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e340c9460 0x7f3e341e4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:37.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.691+0000 7f3e39600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e3415aed0 0x7f3e341f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:37.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.692+0000 7f3e39600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3415e8c0 con 0x7f3e340c9080 2024-04-01T16:34:37.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.692+0000 7f3e39600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3415e5e0 con 0x7f3e340c9460 2024-04-01T16:34:37.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.692+0000 7f3e39600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3e340cb120 con 0x7f3e3415aed0 2024-04-01T16:34:37.692 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.693+0000 7f3e32a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e340c9080 0x7f3e3415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:37.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.693+0000 7f3e32a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e340c9080 0x7f3e3415a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:42432/0 (socket says 172.21.15.163:42432) 2024-04-01T16:34:37.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.693+0000 7f3e32a00640 1 -- 172.21.15.163:0/4157534384 learned_addr learned my addr 172.21.15.163:0/4157534384 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:37.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.698+0000 7f3e32a00640 1 -- 172.21.15.163:0/4157534384 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e3415aed0 msgr2=0x7f3e341f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:37.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.698+0000 7f3e32a00640 1 --2- 172.21.15.163:0/4157534384 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e3415aed0 0x7f3e341f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:37.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.699+0000 7f3e32a00640 1 -- 172.21.15.163:0/4157534384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e340c9460 msgr2=0x7f3e341e4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:37.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.699+0000 7f3e32a00640 1 --2- 172.21.15.163:0/4157534384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e340c9460 0x7f3e341e4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:37.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.699+0000 7f3e32a00640 1 -- 172.21.15.163:0/4157534384 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e34158a10 con 0x7f3e340c9080 2024-04-01T16:34:37.701 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.702+0000 7f3e32a00640 1 --2- 172.21.15.163:0/4157534384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e340c9080 0x7f3e3415a7c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e24000c00 tx=0x7f3e240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:37.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.705+0000 7f3e2aa00640 1 -- 172.21.15.163:0/4157534384 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2403ac60 con 0x7f3e340c9080 2024-04-01T16:34:37.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.705+0000 7f3e39600640 1 -- 172.21.15.163:0/4157534384 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e34158cf0 con 0x7f3e340c9080 2024-04-01T16:34:37.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.706+0000 7f3e39600640 1 -- 172.21.15.163:0/4157534384 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e341592b0 con 0x7f3e340c9080 2024-04-01T16:34:37.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.707+0000 7f3e39600640 1 -- 172.21.15.163:0/4157534384 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3406c480 con 0x7f3e340c9080 2024-04-01T16:34:37.707 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.708+0000 7f3e2aa00640 1 -- 172.21.15.163:0/4157534384 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e2403ae00 con 0x7f3e340c9080 2024-04-01T16:34:37.707 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:37.708+0000 7f3e2aa00640 1 -- 172.21.15.163:0/4157534384 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24052060 con 0x7f3e340c9080 2024-04-01T16:34:38.042 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:38.042+0000 7f3e2aa00640 1 -- 172.21.15.163:0/4157534384 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e24038020 con 0x7f3e340c9080 2024-04-01T16:34:38.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:38.044+0000 7f3e2aa00640 1 --2- 172.21.15.163:0/4157534384 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3e1406c920 0x7f3e1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:38.045 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:38.045+0000 7f3e32000640 1 --2- 172.21.15.163:0/4157534384 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3e1406c920 0x7f3e1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:38.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:38.048+0000 7f3e32000640 1 --2- 172.21.15.163:0/4157534384 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3e1406c920 0x7f3e1406ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3e3406d520 tx=0x7f3e20007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:38.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:38.097+0000 7f3e2aa00640 1 -- 172.21.15.163:0/4157534384 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f3e24079f50 con 0x7f3e340c9080 2024-04-01T16:34:38.097 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:38.098+0000 7f3e2aa00640 1 -- 172.21.15.163:0/4157534384 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3e2403f070 con 0x7f3e340c9080 2024-04-01T16:34:38.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:38.362+0000 7f3e39600640 1 -- 172.21.15.163:0/4157534384 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3e340ca7d0 con 0x7f3e340c9080 2024-04-01T16:34:39.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.308+0000 7f3e2aa00640 1 -- 172.21.15.163:0/4157534384 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f3e2407c5b0 con 0x7f3e340c9080 2024-04-01T16:34:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.312+0000 7f3e39600640 1 -- 172.21.15.163:0/4157534384 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3e1406c920 msgr2=0x7f3e1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.312+0000 7f3e39600640 1 --2- 172.21.15.163:0/4157534384 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3e1406c920 0x7f3e1406ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3e3406d520 tx=0x7f3e20007990 comp rx=0 tx=0).stop 2024-04-01T16:34:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.312+0000 7f3e39600640 1 -- 172.21.15.163:0/4157534384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e340c9080 msgr2=0x7f3e3415a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.312+0000 7f3e39600640 1 --2- 172.21.15.163:0/4157534384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e340c9080 0x7f3e3415a7c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e24000c00 tx=0x7f3e240046c0 comp rx=0 tx=0).stop 2024-04-01T16:34:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.312+0000 7f3e39600640 1 -- 172.21.15.163:0/4157534384 shutdown_connections 2024-04-01T16:34:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.312+0000 7f3e39600640 1 --2- 172.21.15.163:0/4157534384 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3e1406c920 0x7f3e1406ede0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.312+0000 7f3e39600640 1 --2- 172.21.15.163:0/4157534384 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3e3415aed0 0x7f3e341f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.312+0000 7f3e39600640 1 --2- 172.21.15.163:0/4157534384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e340c9460 0x7f3e341e4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.312+0000 7f3e39600640 1 --2- 172.21.15.163:0/4157534384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e340c9080 0x7f3e3415a7c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:39.313 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.312+0000 7f3e39600640 1 -- 172.21.15.163:0/4157534384 >> 172.21.15.163:0/4157534384 conn(0x7f3e34067280 msgr2=0x7f3e340ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:39.313 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.312+0000 7f3e39600640 1 -- 172.21.15.163:0/4157534384 shutdown_connections 2024-04-01T16:34:39.313 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.312+0000 7f3e39600640 1 -- 172.21.15.163:0/4157534384 wait complete. 2024-04-01T16:34:39.333 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-01T16:34:39.333 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-01T16:34:39.539 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.539+0000 7efd12200640 1 Processor -- start 2024-04-01T16:34:39.539 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.539+0000 7efd12200640 1 -- start start 2024-04-01T16:34:39.540 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.541+0000 7efd12200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efd0c0cd4c0 0x7efd0c15a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:39.540 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.541+0000 7efd12200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efd0c154c60 0x7efd0c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:39.541 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.541+0000 7efd12200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd0c06c590 con 0x7efd0c0cd0e0 2024-04-01T16:34:39.541 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.541+0000 7efd12200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7efd0c06c850 con 0x7efd0c0cd4c0 2024-04-01T16:34:39.541 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.541+0000 7efd12200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7efd0c06cb30 con 0x7efd0c154c60 2024-04-01T16:34:39.545 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.546+0000 7efd0be00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efd0c154c60 0x7efd0c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:39.546 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.547+0000 7efd0be00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efd0c154c60 0x7efd0c0cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:59632/0 (socket says 172.21.15.163:59632) 2024-04-01T16:34:39.546 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.547+0000 7efd0be00640 1 -- 172.21.15.163:0/1167658055 learned_addr learned my addr 172.21.15.163:0/1167658055 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:39.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.618+0000 7efd0be00640 1 -- 172.21.15.163:0/1167658055 >> v2:172.21.15.163:3300/0 conn(0x7efd0c0cd4c0 msgr2=0x7efd0c15a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:39.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.618+0000 7efd0be00640 1 --2- 172.21.15.163:0/1167658055 >> v2:172.21.15.163:3300/0 conn(0x7efd0c0cd4c0 0x7efd0c15a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:39.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.618+0000 7efd0be00640 1 -- 172.21.15.163:0/1167658055 >> v1:172.21.15.163:6789/0 conn(0x7efd0c0cd0e0 legacy=0x7efd0c154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:39.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.618+0000 7efd0be00640 1 -- 172.21.15.163:0/1167658055 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0c06ce10 con 0x7efd0c154c60 2024-04-01T16:34:39.623 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.623+0000 7efd0be00640 1 --2- 172.21.15.163:0/1167658055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd0c154c60 0x7efd0c0cbae0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efd04009e50 tx=0x7efd0402be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a132fa9baefcf7b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:39.641 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.642+0000 7efd0aa00640 1 -- 172.21.15.163:0/1167658055 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0402c9f0 con 0x7efd0c154c60 2024-04-01T16:34:39.641 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.642+0000 7efd0aa00640 1 -- 172.21.15.163:0/1167658055 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0402cb90 con 0x7efd0c154c60 2024-04-01T16:34:39.642 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.642+0000 7efd0aa00640 1 -- 172.21.15.163:0/1167658055 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd040343f0 con 0x7efd0c154c60 2024-04-01T16:34:39.642 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.643+0000 7efd12200640 1 -- 172.21.15.163:0/1167658055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd0c154c60 msgr2=0x7efd0c0cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:39.642 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.643+0000 7efd12200640 1 --2- 172.21.15.163:0/1167658055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd0c154c60 0x7efd0c0cbae0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efd04009e50 tx=0x7efd0402be50 comp rx=0 tx=0).stop 2024-04-01T16:34:39.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.643+0000 7efd12200640 1 -- 172.21.15.163:0/1167658055 shutdown_connections 2024-04-01T16:34:39.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.643+0000 7efd12200640 1 --2- 172.21.15.163:0/1167658055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd0c154c60 0x7efd0c0cbae0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:39.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.643+0000 7efd12200640 1 --2- 172.21.15.163:0/1167658055 >> v2:172.21.15.163:3300/0 conn(0x7efd0c0cd4c0 0x7efd0c15a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:39.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.643+0000 7efd12200640 1 -- 172.21.15.163:0/1167658055 >> 172.21.15.163:0/1167658055 conn(0x7efd0c067460 msgr2=0x7efd0c067870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:39.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.644+0000 7efd12200640 1 -- 172.21.15.163:0/1167658055 shutdown_connections 2024-04-01T16:34:39.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.644+0000 7efd12200640 1 -- 172.21.15.163:0/1167658055 wait complete. 2024-04-01T16:34:39.645 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.646+0000 7efd12200640 1 Processor -- start 2024-04-01T16:34:39.646 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.646+0000 7efd12200640 1 -- start start 2024-04-01T16:34:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.648+0000 7efd12200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd0c0cd0e0 0x7efd0c1585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.648+0000 7efd12200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd0c0cd4c0 0x7efd0c1577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.648+0000 7efd12200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd0c154c60 0x7efd0c1f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.648+0000 7efd12200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c0cadd0 con 0x7efd0c0cd4c0 2024-04-01T16:34:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.648+0000 7efd12200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c06d3d0 con 0x7efd0c0cd0e0 2024-04-01T16:34:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.648+0000 7efd12200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efd0c0caf50 con 0x7efd0c154c60 2024-04-01T16:34:39.648 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.649+0000 7efd0b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd0c0cd0e0 0x7efd0c1585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:39.648 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.649+0000 7efd0b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd0c0cd0e0 0x7efd0c1585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:59636/0 (socket says 172.21.15.163:59636) 2024-04-01T16:34:39.648 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.649+0000 7efd0b400640 1 -- 172.21.15.163:0/3377269310 learned_addr learned my addr 172.21.15.163:0/3377269310 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:39.650 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.651+0000 7efd02a00640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd0c0cd4c0 0x7efd0c1577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:39.651 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.652+0000 7efd0be00640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd0c154c60 0x7efd0c1f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:39.654 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.655+0000 7efd0b400640 1 -- 172.21.15.163:0/3377269310 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd0c154c60 msgr2=0x7efd0c1f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:39.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.655+0000 7efd0b400640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd0c154c60 0x7efd0c1f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:39.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.655+0000 7efd0b400640 1 -- 172.21.15.163:0/3377269310 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd0c0cd4c0 msgr2=0x7efd0c1577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:39.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.655+0000 7efd0b400640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd0c0cd4c0 0x7efd0c1577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:39.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.655+0000 7efd0b400640 1 -- 172.21.15.163:0/3377269310 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0c1572d0 con 0x7efd0c0cd0e0 2024-04-01T16:34:39.659 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.660+0000 7efd0b400640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd0c0cd0e0 0x7efd0c1585b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c440 tx=0x7efcfc00c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:39.667 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.667+0000 7efd03e00640 1 -- 172.21.15.163:0/3377269310 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc017070 con 0x7efd0c0cd0e0 2024-04-01T16:34:39.667 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.667+0000 7efd03e00640 1 -- 172.21.15.163:0/3377269310 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcfc0035f0 con 0x7efd0c0cd0e0 2024-04-01T16:34:39.667 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.667+0000 7efd03e00640 1 -- 172.21.15.163:0/3377269310 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0039e0 con 0x7efd0c0cd0e0 2024-04-01T16:34:39.667 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.667+0000 7efd12200640 1 -- 172.21.15.163:0/3377269310 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0c1f4320 con 0x7efd0c0cd0e0 2024-04-01T16:34:39.667 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.668+0000 7efd12200640 1 -- 172.21.15.163:0/3377269310 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0c15c2d0 con 0x7efd0c0cd0e0 2024-04-01T16:34:39.668 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.669+0000 7efd12200640 1 -- 172.21.15.163:0/3377269310 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd0c073bb0 con 0x7efd0c0cd0e0 2024-04-01T16:34:39.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.990+0000 7efd03e00640 1 -- 172.21.15.163:0/3377269310 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efcfc01a070 con 0x7efd0c0cd0e0 2024-04-01T16:34:39.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.992+0000 7efd03e00640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efce806c940 0x7efce806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:39.992 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.992+0000 7efd02a00640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efce806c940 0x7efce806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:39.993 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.994+0000 7efd02a00640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efce806c940 0x7efce806ee00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0cd8d0 tx=0x7efcf4009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:39.994 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:39.995+0000 7efd03e00640 1 -- 172.21.15.163:0/3377269310 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7efcfc057190 con 0x7efd0c0cd0e0 2024-04-01T16:34:40.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.015+0000 7efd03e00640 1 -- 172.21.15.163:0/3377269310 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efcfc021020 con 0x7efd0c0cd0e0 2024-04-01T16:34:40.264 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.265+0000 7efd12200640 1 -- 172.21.15.163:0/3377269310 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7efd0c15bde0 con 0x7efd0c0cd0e0 2024-04-01T16:34:40.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.926+0000 7efd03e00640 1 -- 172.21.15.163:0/3377269310 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7efcfc0010c0 con 0x7efd0c0cd0e0 2024-04-01T16:34:40.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.929+0000 7efd12200640 1 -- 172.21.15.163:0/3377269310 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efce806c940 msgr2=0x7efce806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:40.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.929+0000 7efd12200640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efce806c940 0x7efce806ee00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0cd8d0 tx=0x7efcf4009110 comp rx=0 tx=0).stop 2024-04-01T16:34:40.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.929+0000 7efd12200640 1 -- 172.21.15.163:0/3377269310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd0c0cd0e0 msgr2=0x7efd0c1585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:40.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.929+0000 7efd12200640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd0c0cd0e0 0x7efd0c1585b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c440 tx=0x7efcfc00c840 comp rx=0 tx=0).stop 2024-04-01T16:34:40.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.930+0000 7efd12200640 1 -- 172.21.15.163:0/3377269310 shutdown_connections 2024-04-01T16:34:40.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.930+0000 7efd12200640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efce806c940 0x7efce806ee00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:40.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.930+0000 7efd12200640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd0c154c60 0x7efd0c1f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:40.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.930+0000 7efd12200640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd0c0cd4c0 0x7efd0c1577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:40.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.930+0000 7efd12200640 1 --2- 172.21.15.163:0/3377269310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd0c0cd0e0 0x7efd0c1585b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:40.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.930+0000 7efd12200640 1 -- 172.21.15.163:0/3377269310 >> 172.21.15.163:0/3377269310 conn(0x7efd0c067460 msgr2=0x7efd0c153ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:40.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.930+0000 7efd12200640 1 -- 172.21.15.163:0/3377269310 shutdown_connections 2024-04-01T16:34:40.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:40.930+0000 7efd12200640 1 -- 172.21.15.163:0/3377269310 wait complete. 2024-04-01T16:34:40.953 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-01T16:34:41.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.169+0000 7f91ae200640 1 Processor -- start 2024-04-01T16:34:41.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.169+0000 7f91ae200640 1 -- start start 2024-04-01T16:34:41.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.171+0000 7f91ae200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f91a80c7cf0 0x7f91a8162df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:41.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.171+0000 7f91ae200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91a80c73a0 con 0x7f91a8151880 2024-04-01T16:34:41.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.171+0000 7f91ae200640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91a8157460 con 0x7f91a8073450 2024-04-01T16:34:41.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.171+0000 7f91ae200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f91a80739b0 con 0x7f91a80c7cf0 2024-04-01T16:34:41.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.171+0000 7f91ace00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f91a8151880 0x7f91a8071c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50110/0 (socket says 172.21.15.163:50110) 2024-04-01T16:34:41.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.171+0000 7f91ace00640 1 -- 172.21.15.163:0/2815832972 learned_addr learned my addr 172.21.15.163:0/2815832972 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:41.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.172+0000 7f91ad800640 1 --2- 172.21.15.163:0/2815832972 >> v2:172.21.15.189:3300/0 conn(0x7f91a80c7cf0 0x7f91a8162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:41.174 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.174+0000 7f91a7400640 1 -- 172.21.15.163:0/2815832972 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459235455 0 0) 0x7f91a80c73a0 con 0x7f91a8151880 2024-04-01T16:34:41.174 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.174+0000 7f91a7400640 1 -- 172.21.15.163:0/2815832972 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9190003520 con 0x7f91a8151880 2024-04-01T16:34:41.177 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.177+0000 7f91ad800640 1 -- 172.21.15.163:0/2815832972 >> v1:172.21.15.189:6789/0 conn(0x7f91a8073450 legacy=0x7f91a80c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:41.177 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.177+0000 7f91ad800640 1 -- 172.21.15.163:0/2815832972 >> v1:172.21.15.163:6789/0 conn(0x7f91a8151880 legacy=0x7f91a8071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:41.177 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.177+0000 7f91ad800640 1 -- 172.21.15.163:0/2815832972 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a8157720 con 0x7f91a80c7cf0 2024-04-01T16:34:41.181 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.182+0000 7f91ad800640 1 --2- 172.21.15.163:0/2815832972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91a80c7cf0 0x7f91a8162df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009d90 tx=0x7f91a002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e79fefebcc19a38 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:41.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.191+0000 7f91a7400640 1 -- 172.21.15.163:0/2815832972 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0039070 con 0x7f91a80c7cf0 2024-04-01T16:34:41.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.196+0000 7f91a7400640 1 -- 172.21.15.163:0/2815832972 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a002cd00 con 0x7f91a80c7cf0 2024-04-01T16:34:41.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.196+0000 7f91a7400640 1 -- 172.21.15.163:0/2815832972 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0034640 con 0x7f91a80c7cf0 2024-04-01T16:34:41.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.197+0000 7f91ae200640 1 -- 172.21.15.163:0/2815832972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91a80c7cf0 msgr2=0x7f91a8162df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:41.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.197+0000 7f91ae200640 1 --2- 172.21.15.163:0/2815832972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91a80c7cf0 0x7f91a8162df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009d90 tx=0x7f91a002bf50 comp rx=0 tx=0).stop 2024-04-01T16:34:41.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.197+0000 7f91ae200640 1 -- 172.21.15.163:0/2815832972 shutdown_connections 2024-04-01T16:34:41.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.197+0000 7f91ae200640 1 --2- 172.21.15.163:0/2815832972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91a80c7cf0 0x7f91a8162df0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:41.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.197+0000 7f91ae200640 1 -- 172.21.15.163:0/2815832972 >> 172.21.15.163:0/2815832972 conn(0x7f91a806b540 msgr2=0x7f91a806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:41.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.197+0000 7f91ae200640 1 -- 172.21.15.163:0/2815832972 shutdown_connections 2024-04-01T16:34:41.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.197+0000 7f91ae200640 1 -- 172.21.15.163:0/2815832972 wait complete. 2024-04-01T16:34:41.199 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.200+0000 7f91ae200640 1 Processor -- start 2024-04-01T16:34:41.199 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.200+0000 7f91ae200640 1 -- start start 2024-04-01T16:34:41.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.201+0000 7f91ae200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91a8073450 0x7f91a80c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:41.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.201+0000 7f91ae200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91a80c7cf0 0x7f91a80c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:41.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.201+0000 7f91ae200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91a8151880 0x7f91a814fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:41.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.201+0000 7f91ae200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f91a8157fc0 con 0x7f91a8073450 2024-04-01T16:34:41.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.201+0000 7f91ae200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91a8157ce0 con 0x7f91a8151880 2024-04-01T16:34:41.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.201+0000 7f91ae200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f91a8072350 con 0x7f91a80c7cf0 2024-04-01T16:34:41.202 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.203+0000 7f91ad800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91a8151880 0x7f91a814fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:41.203 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.204+0000 7f91a7e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91a80c7cf0 0x7f91a80c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:41.203 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.204+0000 7f91ad800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91a8151880 0x7f91a814fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:38112/0 (socket says 172.21.15.163:38112) 2024-04-01T16:34:41.203 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.204+0000 7f91ad800640 1 -- 172.21.15.163:0/1024314205 learned_addr learned my addr 172.21.15.163:0/1024314205 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:41.209 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.209+0000 7f91ace00640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91a8073450 0x7f91a80c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:41.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.216+0000 7f91ace00640 1 -- 172.21.15.163:0/1024314205 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91a80c7cf0 msgr2=0x7f91a80c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:41.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.216+0000 7f91ace00640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91a80c7cf0 0x7f91a80c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:41.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.216+0000 7f91ace00640 1 -- 172.21.15.163:0/1024314205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91a8151880 msgr2=0x7f91a814fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:41.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.216+0000 7f91ace00640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91a8151880 0x7f91a814fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:41.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.217+0000 7f91ace00640 1 -- 172.21.15.163:0/1024314205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a81f05e0 con 0x7f91a8073450 2024-04-01T16:34:41.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.221+0000 7f91ace00640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91a8073450 0x7f91a80c4f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f919c00c430 tx=0x7f919c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:41.226 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.227+0000 7f91a4c00640 1 -- 172.21.15.163:0/1024314205 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c017070 con 0x7f91a8073450 2024-04-01T16:34:41.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.227+0000 7f91a4c00640 1 -- 172.21.15.163:0/1024314205 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f919c005ce0 con 0x7f91a8073450 2024-04-01T16:34:41.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.227+0000 7f91a4c00640 1 -- 172.21.15.163:0/1024314205 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c007310 con 0x7f91a8073450 2024-04-01T16:34:41.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.227+0000 7f91ae200640 1 -- 172.21.15.163:0/1024314205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a80c4160 con 0x7f91a8073450 2024-04-01T16:34:41.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.227+0000 7f91ae200640 1 -- 172.21.15.163:0/1024314205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a80c4720 con 0x7f91a8073450 2024-04-01T16:34:41.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.229+0000 7f91ae200640 1 -- 172.21.15.163:0/1024314205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a80756d0 con 0x7f91a8073450 2024-04-01T16:34:41.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.255+0000 7f91a4c00640 1 -- 172.21.15.163:0/1024314205 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f919c01a070 con 0x7f91a8073450 2024-04-01T16:34:41.256 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.256+0000 7f91a4c00640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f918806c940 0x7f918806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:41.256 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.257+0000 7f91a7e00640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f918806c940 0x7f918806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:41.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.258+0000 7f91a4c00640 1 -- 172.21.15.163:0/1024314205 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f919c057220 con 0x7f91a8073450 2024-04-01T16:34:41.258 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.258+0000 7f91a7e00640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f918806c940 0x7f918806ee00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f91a814e6d0 tx=0x7f9194009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:41.554 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.554+0000 7f91a4c00640 1 -- 172.21.15.163:0/1024314205 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f919c021020 con 0x7f91a8073450 2024-04-01T16:34:41.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:41.827+0000 7f91ae200640 1 -- 172.21.15.163:0/1024314205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f91a8073230 con 0x7f91a8073450 2024-04-01T16:34:43.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.105+0000 7f91a4c00640 1 -- 172.21.15.163:0/1024314205 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) ==== 115+0+0 (secure 0 0 0) 0x7f919c059180 con 0x7f91a8073450 2024-04-01T16:34:43.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.108+0000 7f91ae200640 1 -- 172.21.15.163:0/1024314205 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f918806c940 msgr2=0x7f918806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:43.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.108+0000 7f91ae200640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f918806c940 0x7f918806ee00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f91a814e6d0 tx=0x7f9194009040 comp rx=0 tx=0).stop 2024-04-01T16:34:43.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.108+0000 7f91ae200640 1 -- 172.21.15.163:0/1024314205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91a8073450 msgr2=0x7f91a80c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:43.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.108+0000 7f91ae200640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91a8073450 0x7f91a80c4f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f919c00c430 tx=0x7f919c00c8f0 comp rx=0 tx=0).stop 2024-04-01T16:34:43.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.109+0000 7f91ae200640 1 -- 172.21.15.163:0/1024314205 shutdown_connections 2024-04-01T16:34:43.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.109+0000 7f91ae200640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f918806c940 0x7f918806ee00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:43.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.109+0000 7f91ae200640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91a8151880 0x7f91a814fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:43.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.109+0000 7f91ae200640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f91a80c7cf0 0x7f91a80c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:43.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.109+0000 7f91ae200640 1 --2- 172.21.15.163:0/1024314205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91a8073450 0x7f91a80c4f20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:43.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.109+0000 7f91ae200640 1 -- 172.21.15.163:0/1024314205 >> 172.21.15.163:0/1024314205 conn(0x7f91a806b540 msgr2=0x7f91a8155a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:43.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.109+0000 7f91ae200640 1 -- 172.21.15.163:0/1024314205 shutdown_connections 2024-04-01T16:34:43.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.109+0000 7f91ae200640 1 -- 172.21.15.163:0/1024314205 wait complete. 2024-04-01T16:34:43.130 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-01T16:34:43.131 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T16:34:43.343 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.344+0000 7fc4ab200640 1 Processor -- start 2024-04-01T16:34:43.343 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.344+0000 7fc4ab200640 1 -- start start 2024-04-01T16:34:43.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.345+0000 7fc4ab200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4ac0c8510 0x7fc4ac0c8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:43.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.345+0000 7fc4ab200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4ac0722d0 con 0x7fc4ac151530 2024-04-01T16:34:43.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.345+0000 7fc4ab200640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4ac0725b0 con 0x7fc4ac071c20 2024-04-01T16:34:43.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.345+0000 7fc4ab200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ac0c8ec0 con 0x7fc4ac0c8510 2024-04-01T16:34:43.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.346+0000 7fc4a9e00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fc4ac151530 0x7fc4ac15b250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50118/0 (socket says 172.21.15.163:50118) 2024-04-01T16:34:43.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.346+0000 7fc4a9e00640 1 -- 172.21.15.163:0/3839386228 learned_addr learned my addr 172.21.15.163:0/3839386228 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:43.347 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.347+0000 7fc4aa800640 1 --2- 172.21.15.163:0/3839386228 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4ac0c8510 0x7fc4ac0c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:43.349 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.350+0000 7fc4a9400640 1 -- 172.21.15.163:0/3839386228 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880895505 0 0) 0x7fc4ac0722d0 con 0x7fc4ac151530 2024-04-01T16:34:43.349 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.350+0000 7fc4a9400640 1 -- 172.21.15.163:0/3839386228 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc490005730 con 0x7fc4ac151530 2024-04-01T16:34:43.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.354+0000 7fc4aa800640 1 -- 172.21.15.163:0/3839386228 >> v1:172.21.15.189:6789/0 conn(0x7fc4ac071c20 legacy=0x7fc4ac0c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:43.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.354+0000 7fc4aa800640 1 -- 172.21.15.163:0/3839386228 >> v1:172.21.15.163:6789/0 conn(0x7fc4ac151530 legacy=0x7fc4ac15b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:43.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.354+0000 7fc4aa800640 1 -- 172.21.15.163:0/3839386228 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac072890 con 0x7fc4ac0c8510 2024-04-01T16:34:43.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.361+0000 7fc4aa800640 1 --2- 172.21.15.163:0/3839386228 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4ac0c8510 0x7fc4ac0c8980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009dc0 tx=0x7fc4a402bfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d209b30fad94b78 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:43.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.372+0000 7fc4a9400640 1 -- 172.21.15.163:0/3839386228 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4039070 con 0x7fc4ac0c8510 2024-04-01T16:34:43.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.372+0000 7fc4a9400640 1 -- 172.21.15.163:0/3839386228 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a402cd60 con 0x7fc4ac0c8510 2024-04-01T16:34:43.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.372+0000 7fc4a9400640 1 -- 172.21.15.163:0/3839386228 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4034660 con 0x7fc4ac0c8510 2024-04-01T16:34:43.372 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.373+0000 7fc4ab200640 1 -- 172.21.15.163:0/3839386228 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4ac0c8510 msgr2=0x7fc4ac0c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:43.372 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.373+0000 7fc4ab200640 1 --2- 172.21.15.163:0/3839386228 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4ac0c8510 0x7fc4ac0c8980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009dc0 tx=0x7fc4a402bfb0 comp rx=0 tx=0).stop 2024-04-01T16:34:43.372 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.373+0000 7fc4ab200640 1 -- 172.21.15.163:0/3839386228 shutdown_connections 2024-04-01T16:34:43.372 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.373+0000 7fc4ab200640 1 --2- 172.21.15.163:0/3839386228 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4ac0c8510 0x7fc4ac0c8980 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:43.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.373+0000 7fc4ab200640 1 -- 172.21.15.163:0/3839386228 >> 172.21.15.163:0/3839386228 conn(0x7fc4ac06f7d0 msgr2=0x7fc4ac06fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:43.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.373+0000 7fc4ab200640 1 -- 172.21.15.163:0/3839386228 shutdown_connections 2024-04-01T16:34:43.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.373+0000 7fc4ab200640 1 -- 172.21.15.163:0/3839386228 wait complete. 2024-04-01T16:34:43.375 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.375+0000 7fc4ab200640 1 Processor -- start 2024-04-01T16:34:43.375 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.376+0000 7fc4ab200640 1 -- start start 2024-04-01T16:34:43.376 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.377+0000 7fc4ab200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4ac071c20 0x7fc4ac13c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:43.376 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.377+0000 7fc4ab200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4ac0c8510 0x7fc4ac0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:43.377 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.377+0000 7fc4ab200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4ac151530 0x7fc4ac0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:43.377 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.377+0000 7fc4ab200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac072030 con 0x7fc4ac071c20 2024-04-01T16:34:43.377 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.377+0000 7fc4ab200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac0c7500 con 0x7fc4ac0c8510 2024-04-01T16:34:43.377 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.377+0000 7fc4ab200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ac0c80b0 con 0x7fc4ac151530 2024-04-01T16:34:43.377 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.378+0000 7fc4a9e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4ac071c20 0x7fc4ac13c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:43.378 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.378+0000 7fc4a9e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4ac071c20 0x7fc4ac13c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48010/0 (socket says 172.21.15.163:48010) 2024-04-01T16:34:43.378 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.378+0000 7fc4a9e00640 1 -- 172.21.15.163:0/3557697549 learned_addr learned my addr 172.21.15.163:0/3557697549 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:43.378 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.379+0000 7fc4a1400640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4ac0c8510 0x7fc4ac0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:43.378 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.379+0000 7fc4aa800640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4ac151530 0x7fc4ac0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:43.382 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.382+0000 7fc4a9e00640 1 -- 172.21.15.163:0/3557697549 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4ac151530 msgr2=0x7fc4ac0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:43.382 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.382+0000 7fc4a9e00640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4ac151530 0x7fc4ac0cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:43.382 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.382+0000 7fc4a9e00640 1 -- 172.21.15.163:0/3557697549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4ac0c8510 msgr2=0x7fc4ac0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:43.382 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.382+0000 7fc4a9e00640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4ac0c8510 0x7fc4ac0cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:43.382 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.383+0000 7fc4a9e00640 1 -- 172.21.15.163:0/3557697549 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac148de0 con 0x7fc4ac071c20 2024-04-01T16:34:43.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.385+0000 7fc4a9e00640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4ac071c20 0x7fc4ac13c250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00c430 tx=0x7fc49c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:43.389 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.390+0000 7fc4a2a00640 1 -- 172.21.15.163:0/3557697549 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c017070 con 0x7fc4ac071c20 2024-04-01T16:34:43.389 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.390+0000 7fc4a2a00640 1 -- 172.21.15.163:0/3557697549 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c005ce0 con 0x7fc4ac071c20 2024-04-01T16:34:43.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.390+0000 7fc4ab200640 1 -- 172.21.15.163:0/3557697549 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ac14a840 con 0x7fc4ac071c20 2024-04-01T16:34:43.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.390+0000 7fc4a2a00640 1 -- 172.21.15.163:0/3557697549 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0072d0 con 0x7fc4ac071c20 2024-04-01T16:34:43.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.390+0000 7fc4ab200640 1 -- 172.21.15.163:0/3557697549 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ac14ae00 con 0x7fc4ac071c20 2024-04-01T16:34:43.391 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.392+0000 7fc4ab200640 1 -- 172.21.15.163:0/3557697549 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ac073490 con 0x7fc4ac071c20 2024-04-01T16:34:43.416 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.416+0000 7fc4a2a00640 1 -- 172.21.15.163:0/3557697549 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc49c01a070 con 0x7fc4ac071c20 2024-04-01T16:34:43.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.418+0000 7fc4a2a00640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc48806c940 0x7fc48806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:43.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.418+0000 7fc4a1400640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc48806c940 0x7fc48806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:43.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.419+0000 7fc4a1400640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc48806c940 0x7fc48806ee00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac162c00 tx=0x7fc494009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:43.419 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.420+0000 7fc4a2a00640 1 -- 172.21.15.163:0/3557697549 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7fc49c0571a0 con 0x7fc4ac071c20 2024-04-01T16:34:43.713 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.714+0000 7fc4a2a00640 1 -- 172.21.15.163:0/3557697549 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc4ac073490 con 0x7fc4ac071c20 2024-04-01T16:34:43.976 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:43.976+0000 7fc4ab200640 1 -- 172.21.15.163:0/3557697549 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4ac0756d0 con 0x7fc4ac071c20 2024-04-01T16:34:44.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.024+0000 7fc4a2a00640 1 -- 172.21.15.163:0/3557697549 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6839 (secure 0 0 0) 0x7fc49c059100 con 0x7fc4ac071c20 2024-04-01T16:34:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:44.025 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/220229466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":220229466},{"type":"v1","addr":"172.21.15.189:6834","nonce":220229466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/1149566111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1149566111},{"type":"v1","addr":"172.21.15.163:6839","nonce":1149566111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2556471418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2556471418},{"type":"v1","addr":"172.21.15.163:6835","nonce":2556471418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1010688449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1010688449},{"type":"v1","addr":"172.21.15.163:6837","nonce":1010688449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1685366427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1685366427},{"type":"v1","addr":"172.21.15.189:6837","nonce":1685366427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T16:34:34.157633+0000","modified":"2024-04-01T16:34:41.924119+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.189:6835/2672478403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2672478403},{"type":"v1","addr":"172.21.15.189:6835","nonce":2672478403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-04-01T16:34:44.025 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 8 2024-04-01T16:34:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.028+0000 7fc4ab200640 1 -- 172.21.15.163:0/3557697549 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc48806c940 msgr2=0x7fc48806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.028+0000 7fc4ab200640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc48806c940 0x7fc48806ee00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac162c00 tx=0x7fc494009040 comp rx=0 tx=0).stop 2024-04-01T16:34:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.028+0000 7fc4ab200640 1 -- 172.21.15.163:0/3557697549 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4ac071c20 msgr2=0x7fc4ac13c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.028+0000 7fc4ab200640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4ac071c20 0x7fc4ac13c250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00c430 tx=0x7fc49c00c8f0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.029+0000 7fc4ab200640 1 -- 172.21.15.163:0/3557697549 shutdown_connections 2024-04-01T16:34:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.029+0000 7fc4ab200640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc48806c940 0x7fc48806ee00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.029+0000 7fc4ab200640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc4ac151530 0x7fc4ac0cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.029+0000 7fc4ab200640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4ac0c8510 0x7fc4ac0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.029+0000 7fc4ab200640 1 --2- 172.21.15.163:0/3557697549 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4ac071c20 0x7fc4ac13c250 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.029+0000 7fc4ab200640 1 -- 172.21.15.163:0/3557697549 >> 172.21.15.163:0/3557697549 conn(0x7fc4ac06f7d0 msgr2=0x7fc4ac140120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.029+0000 7fc4ab200640 1 -- 172.21.15.163:0/3557697549 shutdown_connections 2024-04-01T16:34:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.029+0000 7fc4ab200640 1 -- 172.21.15.163:0/3557697549 wait complete. 2024-04-01T16:34:44.048 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T16:34:44.182 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:34:44.190 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:34:44.252 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.253+0000 7f7112c00640 1 Processor -- start 2024-04-01T16:34:44.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.253+0000 7f7112c00640 1 -- start start 2024-04-01T16:34:44.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.254+0000 7f7112c00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f710c06d050 0x7f710c15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:44.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.255+0000 7f7112c00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f710c0b4490 0x7f710c0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:44.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.255+0000 7f7112c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710c0b4e50 con 0x7f710c154af0 2024-04-01T16:34:44.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.255+0000 7f7112c00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f710c15b8f0 con 0x7f710c0b4490 2024-04-01T16:34:44.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.255+0000 7f7112c00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f710c0cacf0 con 0x7f710c06d050 2024-04-01T16:34:44.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.256+0000 7f7110c00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f710c0b4490 0x7f710c0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:44.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.256+0000 7f7110c00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f710c0b4490 0x7f710c0b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:38132/0 (socket says 172.21.15.163:38132) 2024-04-01T16:34:44.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.256+0000 7f7110c00640 1 -- 172.21.15.163:0/3157825689 learned_addr learned my addr 172.21.15.163:0/3157825689 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:44.256 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.256+0000 7f710b400640 1 --2- 172.21.15.163:0/3157825689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f710c06d050 0x7f710c15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:44.259 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.259+0000 7f7110c00640 1 -- 172.21.15.163:0/3157825689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f710c06d050 msgr2=0x7f710c15b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:44.259 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.259+0000 7f7110c00640 1 --2- 172.21.15.163:0/3157825689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f710c06d050 0x7f710c15b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.259 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.259+0000 7f7110c00640 1 -- 172.21.15.163:0/3157825689 >> v1:172.21.15.163:6789/0 conn(0x7f710c154af0 legacy=0x7f710c06c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:44.259 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.259+0000 7f7110c00640 1 -- 172.21.15.163:0/3157825689 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c0cafd0 con 0x7f710c0b4490 2024-04-01T16:34:44.262 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.263+0000 7f7110c00640 1 --2- 172.21.15.163:0/3157825689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f710c0b4490 0x7f710c0b4910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7104009e50 tx=0x7f710402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9944e2a68e21984 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:44.271 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.272+0000 7f710aa00640 1 -- 172.21.15.163:0/3157825689 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710402ca70 con 0x7f710c0b4490 2024-04-01T16:34:44.271 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.272+0000 7f710aa00640 1 -- 172.21.15.163:0/3157825689 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710402cc10 con 0x7f710c0b4490 2024-04-01T16:34:44.271 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.272+0000 7f710aa00640 1 -- 172.21.15.163:0/3157825689 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71040343f0 con 0x7f710c0b4490 2024-04-01T16:34:44.272 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.272+0000 7f7112c00640 1 -- 172.21.15.163:0/3157825689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f710c0b4490 msgr2=0x7f710c0b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:44.272 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.272+0000 7f7112c00640 1 --2- 172.21.15.163:0/3157825689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f710c0b4490 0x7f710c0b4910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7104009e50 tx=0x7f710402bed0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.272 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.273+0000 7f7112c00640 1 -- 172.21.15.163:0/3157825689 shutdown_connections 2024-04-01T16:34:44.272 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.273+0000 7f7112c00640 1 --2- 172.21.15.163:0/3157825689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f710c0b4490 0x7f710c0b4910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.272 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.273+0000 7f7112c00640 1 --2- 172.21.15.163:0/3157825689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f710c06d050 0x7f710c15b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.272 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.273+0000 7f7112c00640 1 -- 172.21.15.163:0/3157825689 >> 172.21.15.163:0/3157825689 conn(0x7f710c0cffa0 msgr2=0x7f710c0d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:44.273 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.273+0000 7f7112c00640 1 -- 172.21.15.163:0/3157825689 shutdown_connections 2024-04-01T16:34:44.273 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.273+0000 7f7112c00640 1 -- 172.21.15.163:0/3157825689 wait complete. 2024-04-01T16:34:44.274 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.275+0000 7f7112c00640 1 Processor -- start 2024-04-01T16:34:44.274 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.275+0000 7f7112c00640 1 -- start start 2024-04-01T16:34:44.275 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.276+0000 7f7112c00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f710c06d050 0x7f710c150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:44.275 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.276+0000 7f7112c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f710c0b4490 0x7f710c14d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:44.275 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.276+0000 7f7112c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c154af0 0x7f710c14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:44.275 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.276+0000 7f7112c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0cb870 con 0x7f710c154af0 2024-04-01T16:34:44.276 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.276+0000 7f7112c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0cb590 con 0x7f710c0b4490 2024-04-01T16:34:44.276 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.276+0000 7f7112c00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f710c0cbb50 con 0x7f710c06d050 2024-04-01T16:34:44.276 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.276+0000 7f7110c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c154af0 0x7f710c14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:44.276 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.277+0000 7f7110c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c154af0 0x7f710c14db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48016/0 (socket says 172.21.15.163:48016) 2024-04-01T16:34:44.276 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.277+0000 7f7110c00640 1 -- 172.21.15.163:0/3423353683 learned_addr learned my addr 172.21.15.163:0/3423353683 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:44.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.281+0000 7f7110c00640 1 -- 172.21.15.163:0/3423353683 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f710c06d050 msgr2=0x7f710c150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:44.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.281+0000 7f7110c00640 1 --2- 172.21.15.163:0/3423353683 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f710c06d050 0x7f710c150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.281+0000 7f7110c00640 1 -- 172.21.15.163:0/3423353683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f710c0b4490 msgr2=0x7f710c14d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:44.281 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.281+0000 7f7110c00640 1 --2- 172.21.15.163:0/3423353683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f710c0b4490 0x7f710c14d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.281 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.281+0000 7f7110c00640 1 -- 172.21.15.163:0/3423353683 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c0ccdb0 con 0x7f710c154af0 2024-04-01T16:34:44.283 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.284+0000 7f7110c00640 1 --2- 172.21.15.163:0/3423353683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c154af0 0x7f710c14db30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7104036040 tx=0x7f7104004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:44.287 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.287+0000 7f7103e00640 1 -- 172.21.15.163:0/3423353683 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7104043020 con 0x7f710c154af0 2024-04-01T16:34:44.287 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.287+0000 7f7103e00640 1 -- 172.21.15.163:0/3423353683 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710403e450 con 0x7f710c154af0 2024-04-01T16:34:44.287 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.287+0000 7f7112c00640 1 -- 172.21.15.163:0/3423353683 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c0cd090 con 0x7f710c154af0 2024-04-01T16:34:44.287 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.287+0000 7f7103e00640 1 -- 172.21.15.163:0/3423353683 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710403e820 con 0x7f710c154af0 2024-04-01T16:34:44.287 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.287+0000 7f7112c00640 1 -- 172.21.15.163:0/3423353683 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c1f1f00 con 0x7f710c154af0 2024-04-01T16:34:44.288 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.289+0000 7f7112c00640 1 -- 172.21.15.163:0/3423353683 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710c0cf360 con 0x7f710c154af0 2024-04-01T16:34:44.581 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.581+0000 7f7103e00640 1 -- 172.21.15.163:0/3423353683 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7104046020 con 0x7f710c154af0 2024-04-01T16:34:44.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.583+0000 7f7103e00640 1 --2- 172.21.15.163:0/3423353683 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f70ec06c940 0x7f70ec06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:44.583 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.584+0000 7f710be00640 1 --2- 172.21.15.163:0/3423353683 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f70ec06c940 0x7f70ec06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:44.584 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.585+0000 7f710be00640 1 --2- 172.21.15.163:0/3423353683 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f70ec06c940 0x7f70ec06ee00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009650 tx=0x7f70fc006ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:44.623 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.624+0000 7f7103e00640 1 -- 172.21.15.163:0/3423353683 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f710407a5d0 con 0x7f710c154af0 2024-04-01T16:34:44.624 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.625+0000 7f7103e00640 1 -- 172.21.15.163:0/3423353683 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f710c0cf360 con 0x7f710c154af0 2024-04-01T16:34:44.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.831+0000 7f7112c00640 1 -- 172.21.15.163:0/3423353683 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f710c0756d0 con 0x7f710c154af0 2024-04-01T16:34:44.922 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.922+0000 7f7103e00640 1 -- 172.21.15.163:0/3423353683 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16653 (secure 0 0 0) 0x7f710404d030 con 0x7f710c154af0 2024-04-01T16:34:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:44.923 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":25,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:37.282127+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T16:34:29.028272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T16:34:31.534879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:34:44.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.925+0000 7f7112c00640 1 -- 172.21.15.163:0/3423353683 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f70ec06c940 msgr2=0x7f70ec06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:44.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.925+0000 7f7112c00640 1 --2- 172.21.15.163:0/3423353683 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f70ec06c940 0x7f70ec06ee00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009650 tx=0x7f70fc006ba0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.925+0000 7f7112c00640 1 -- 172.21.15.163:0/3423353683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c154af0 msgr2=0x7f710c14db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:44.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.925+0000 7f7112c00640 1 --2- 172.21.15.163:0/3423353683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c154af0 0x7f710c14db30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7104036040 tx=0x7f7104004a40 comp rx=0 tx=0).stop 2024-04-01T16:34:44.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.925+0000 7f7112c00640 1 -- 172.21.15.163:0/3423353683 shutdown_connections 2024-04-01T16:34:44.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.925+0000 7f7112c00640 1 --2- 172.21.15.163:0/3423353683 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f70ec06c940 0x7f70ec06ee00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.925+0000 7f7112c00640 1 --2- 172.21.15.163:0/3423353683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f710c154af0 0x7f710c14db30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.925+0000 7f7112c00640 1 --2- 172.21.15.163:0/3423353683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f710c0b4490 0x7f710c14d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.925+0000 7f7112c00640 1 --2- 172.21.15.163:0/3423353683 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f710c06d050 0x7f710c150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:44.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.925+0000 7f7112c00640 1 -- 172.21.15.163:0/3423353683 >> 172.21.15.163:0/3423353683 conn(0x7f710c0cffa0 msgr2=0x7f710c158600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:44.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.926+0000 7f7112c00640 1 -- 172.21.15.163:0/3423353683 shutdown_connections 2024-04-01T16:34:44.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:44.926+0000 7f7112c00640 1 -- 172.21.15.163:0/3423353683 wait complete. 2024-04-01T16:34:44.945 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-01T16:34:44.945 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T16:34:45.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.143+0000 7f8c15000640 1 Processor -- start 2024-04-01T16:34:45.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.143+0000 7f8c15000640 1 -- start start 2024-04-01T16:34:45.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.144+0000 7f8c15000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8c10151700 0x7f8c1015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:45.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.144+0000 7f8c15000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c1015b040 con 0x7f8c10070100 2024-04-01T16:34:45.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.144+0000 7f8c15000640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c1015b320 con 0x7f8c100c8160 2024-04-01T16:34:45.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.144+0000 7f8c15000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f8c100c3060 con 0x7f8c10151700 2024-04-01T16:34:45.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.145+0000 7f8c0de00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8c10151700 0x7f8c1015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:45.145 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.146+0000 7f8c0e800640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f8c100c8160 0x7f8c100c0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:41326/0 (socket says 172.21.15.163:41326) 2024-04-01T16:34:45.145 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.146+0000 7f8c0e800640 1 -- 172.21.15.163:0/3434309384 learned_addr learned my addr 172.21.15.163:0/3434309384 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:45.148 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.149+0000 7f8c0de00640 1 -- 172.21.15.163:0/3434309384 >> v1:172.21.15.189:6789/0 conn(0x7f8c100c8160 legacy=0x7f8c100c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:45.148 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.149+0000 7f8c0de00640 1 -- 172.21.15.163:0/3434309384 >> v1:172.21.15.163:6789/0 conn(0x7f8c10070100 legacy=0x7f8c100c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:45.148 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.149+0000 7f8c0de00640 1 -- 172.21.15.163:0/3434309384 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1015b600 con 0x7f8c10151700 2024-04-01T16:34:45.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.155+0000 7f8c0de00640 1 --2- 172.21.15.163:0/3434309384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c10151700 0x7f8c1015aa00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009d90 tx=0x7f8c0002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bab3b8fdf26406 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:45.159 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.159+0000 7f8c0d400640 1 -- 172.21.15.163:0/3434309384 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00039070 con 0x7f8c10151700 2024-04-01T16:34:45.159 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.159+0000 7f8c0d400640 1 -- 172.21.15.163:0/3434309384 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0002cd00 con 0x7f8c10151700 2024-04-01T16:34:45.159 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.159+0000 7f8c0d400640 1 -- 172.21.15.163:0/3434309384 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00034660 con 0x7f8c10151700 2024-04-01T16:34:45.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.160+0000 7f8c15000640 1 -- 172.21.15.163:0/3434309384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c10151700 msgr2=0x7f8c1015aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:45.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.160+0000 7f8c15000640 1 --2- 172.21.15.163:0/3434309384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c10151700 0x7f8c1015aa00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009d90 tx=0x7f8c0002bf50 comp rx=0 tx=0).stop 2024-04-01T16:34:45.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.160+0000 7f8c15000640 1 -- 172.21.15.163:0/3434309384 shutdown_connections 2024-04-01T16:34:45.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.160+0000 7f8c15000640 1 --2- 172.21.15.163:0/3434309384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c10151700 0x7f8c1015aa00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:45.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.160+0000 7f8c15000640 1 -- 172.21.15.163:0/3434309384 >> 172.21.15.163:0/3434309384 conn(0x7f8c100cbe20 msgr2=0x7f8c100cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:45.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.160+0000 7f8c15000640 1 -- 172.21.15.163:0/3434309384 shutdown_connections 2024-04-01T16:34:45.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.160+0000 7f8c15000640 1 -- 172.21.15.163:0/3434309384 wait complete. 2024-04-01T16:34:45.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.162+0000 7f8c15000640 1 Processor -- start 2024-04-01T16:34:45.162 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.162+0000 7f8c15000640 1 -- start start 2024-04-01T16:34:45.162 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.163+0000 7f8c15000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c10070100 0x7f8c1015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:45.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.163+0000 7f8c15000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c100c8160 0x7f8c10159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:45.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.163+0000 7f8c15000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8c10142cd0 0x7f8c10143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:45.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.163+0000 7f8c15000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8c100c7390 con 0x7f8c100c8160 2024-04-01T16:34:45.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.163+0000 7f8c15000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1015b8e0 con 0x7f8c10070100 2024-04-01T16:34:45.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.163+0000 7f8c15000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f8c10151ae0 con 0x7f8c10142cd0 2024-04-01T16:34:45.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.164+0000 7f8c05400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c100c8160 0x7f8c10159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:45.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.164+0000 7f8c05400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c100c8160 0x7f8c10159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48024/0 (socket says 172.21.15.163:48024) 2024-04-01T16:34:45.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.164+0000 7f8c05400640 1 -- 172.21.15.163:0/699024909 learned_addr learned my addr 172.21.15.163:0/699024909 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:45.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.165+0000 7f8c0de00640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c10070100 0x7f8c1015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:45.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.165+0000 7f8c0e800640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8c10142cd0 0x7f8c10143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:45.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.168+0000 7f8c05400640 1 -- 172.21.15.163:0/699024909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8c10142cd0 msgr2=0x7f8c10143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:45.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.168+0000 7f8c05400640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8c10142cd0 0x7f8c10143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:45.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.168+0000 7f8c05400640 1 -- 172.21.15.163:0/699024909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c10070100 msgr2=0x7f8c1015a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:45.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.168+0000 7f8c05400640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c10070100 0x7f8c1015a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:45.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.168+0000 7f8c05400640 1 -- 172.21.15.163:0/699024909 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c10146040 con 0x7f8c100c8160 2024-04-01T16:34:45.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.170+0000 7f8c05400640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c100c8160 0x7f8c10159aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800c400 tx=0x7f8bf800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:45.174 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.175+0000 7f8c06a00640 1 -- 172.21.15.163:0/699024909 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf80052d0 con 0x7f8c100c8160 2024-04-01T16:34:45.174 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.175+0000 7f8c06a00640 1 -- 172.21.15.163:0/699024909 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf8005490 con 0x7f8c100c8160 2024-04-01T16:34:45.174 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.175+0000 7f8c06a00640 1 -- 172.21.15.163:0/699024909 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8007260 con 0x7f8c100c8160 2024-04-01T16:34:45.174 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.175+0000 7f8c15000640 1 -- 172.21.15.163:0/699024909 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c100c4030 con 0x7f8c100c8160 2024-04-01T16:34:45.174 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.175+0000 7f8c15000640 1 -- 172.21.15.163:0/699024909 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c10144210 con 0x7f8c100c8160 2024-04-01T16:34:45.175 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.176+0000 7f8c15000640 1 -- 172.21.15.163:0/699024909 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c100756d0 con 0x7f8c100c8160 2024-04-01T16:34:45.196 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.197+0000 7f8c06a00640 1 -- 172.21.15.163:0/699024909 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8bf8007400 con 0x7f8c100c8160 2024-04-01T16:34:45.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.198+0000 7f8c06a00640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f8bec06c970 0x7f8bec06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:45.198 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.199+0000 7f8c0de00640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f8bec06c970 0x7f8bec06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:45.199 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.200+0000 7f8c0de00640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f8bec06c970 0x7f8bec06ee30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c00036000 tx=0x7f8c00030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:45.489 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.489+0000 7f8c06a00640 1 -- 172.21.15.163:0/699024909 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f8bf80576f0 con 0x7f8c100c8160 2024-04-01T16:34:45.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.490+0000 7f8c06a00640 1 -- 172.21.15.163:0/699024909 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8c10146040 con 0x7f8c100c8160 2024-04-01T16:34:45.701 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.702+0000 7f8c15000640 1 -- 172.21.15.163:0/699024909 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8c100cc6f0 con 0x7f8bec06c970 2024-04-01T16:34:45.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.727+0000 7f8c06a00640 1 -- 172.21.15.163:0/699024909 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f8c100cc6f0 con 0x7f8bec06c970 2024-04-01T16:34:45.730 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:45.731 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T16:34:45.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.732+0000 7f8c15000640 1 -- 172.21.15.163:0/699024909 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f8bec06c970 msgr2=0x7f8bec06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:45.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.732+0000 7f8c15000640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f8bec06c970 0x7f8bec06ee30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c00036000 tx=0x7f8c00030000 comp rx=0 tx=0).stop 2024-04-01T16:34:45.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.732+0000 7f8c15000640 1 -- 172.21.15.163:0/699024909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c100c8160 msgr2=0x7f8c10159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:45.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.732+0000 7f8c15000640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c100c8160 0x7f8c10159aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800c400 tx=0x7f8bf800c8c0 comp rx=0 tx=0).stop 2024-04-01T16:34:45.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.732+0000 7f8c15000640 1 -- 172.21.15.163:0/699024909 shutdown_connections 2024-04-01T16:34:45.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.732+0000 7f8c15000640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f8bec06c970 0x7f8bec06ee30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:45.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.732+0000 7f8c15000640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8c10142cd0 0x7f8c10143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:45.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.732+0000 7f8c15000640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c100c8160 0x7f8c10159aa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:45.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.732+0000 7f8c15000640 1 --2- 172.21.15.163:0/699024909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c10070100 0x7f8c1015a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:45.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.732+0000 7f8c15000640 1 -- 172.21.15.163:0/699024909 >> 172.21.15.163:0/699024909 conn(0x7f8c100cbe20 msgr2=0x7f8c100c49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:45.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.732+0000 7f8c15000640 1 -- 172.21.15.163:0/699024909 shutdown_connections 2024-04-01T16:34:45.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.732+0000 7f8c15000640 1 -- 172.21.15.163:0/699024909 wait complete. 2024-04-01T16:34:45.751 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-04-01T16:34:43.787086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219428,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755292,"statfs":{"total":773094113280,"available":772869419008,"internally_reserved":0,"allocated":3317760,"data_stored":1943156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003204"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606518+0000","last_change":"2024-04-01T16:34:34.033508+0000","last_active":"2024-04-01T16:34:37.606518+0000","last_peered":"2024-04-01T16:34:37.606518+0000","last_clean":"2024-04-01T16:34:37.606518+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T16:34:37.606518+0000","last_undegraded":"2024-04-01T16:34:37.606518+0000","last_fullsized":"2024-04-01T16:34:37.606518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051847+0000","last_change":"2024-04-01T16:34:34.065375+0000","last_active":"2024-04-01T16:34:38.051847+0000","last_peered":"2024-04-01T16:34:38.051847+0000","last_clean":"2024-04-01T16:34:38.051847+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T16:34:38.051847+0000","last_undegraded":"2024-04-01T16:34:38.051847+0000","last_fullsized":"2024-04-01T16:34:38.051847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050257+0000","last_change":"2024-04-01T16:34:34.084618+0000","last_active":"2024-04-01T16:34:38.050257+0000","last_peered":"2024-04-01T16:34:38.050257+0000","last_clean":"2024-04-01T16:34:38.050257+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T16:34:38.050257+0000","last_undegraded":"2024-04-01T16:34:38.050257+0000","last_fullsized":"2024-04-01T16:34:38.050257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:43.530081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050850+0000","last_change":"2024-04-01T16:34:34.088694+0000","last_active":"2024-04-01T16:34:38.050850+0000","last_peered":"2024-04-01T16:34:38.050850+0000","last_clean":"2024-04-01T16:34:38.050850+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T16:34:38.050850+0000","last_undegraded":"2024-04-01T16:34:38.050850+0000","last_fullsized":"2024-04-01T16:34:38.050850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605580+0000","last_change":"2024-04-01T16:34:34.085765+0000","last_active":"2024-04-01T16:34:37.605580+0000","last_peered":"2024-04-01T16:34:37.605580+0000","last_clean":"2024-04-01T16:34:37.605580+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T16:34:37.605580+0000","last_undegraded":"2024-04-01T16:34:37.605580+0000","last_fullsized":"2024-04-01T16:34:37.605580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050667+0000","last_change":"2024-04-01T16:34:34.066150+0000","last_active":"2024-04-01T16:34:38.050667+0000","last_peered":"2024-04-01T16:34:38.050667+0000","last_clean":"2024-04-01T16:34:38.050667+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T16:34:38.050667+0000","last_undegraded":"2024-04-01T16:34:38.050667+0000","last_fullsized":"2024-04-01T16:34:38.050667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:08:56.651785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.604963+0000","last_change":"2024-04-01T16:34:34.072924+0000","last_active":"2024-04-01T16:34:37.604963+0000","last_peered":"2024-04-01T16:34:37.604963+0000","last_clean":"2024-04-01T16:34:37.604963+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T16:34:37.604963+0000","last_undegraded":"2024-04-01T16:34:37.604963+0000","last_fullsized":"2024-04-01T16:34:37.604963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049767+0000","last_change":"2024-04-01T16:34:34.088361+0000","last_active":"2024-04-01T16:34:38.049767+0000","last_peered":"2024-04-01T16:34:38.049767+0000","last_clean":"2024-04-01T16:34:38.049767+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T16:34:38.049767+0000","last_undegraded":"2024-04-01T16:34:38.049767+0000","last_fullsized":"2024-04-01T16:34:38.049767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606669+0000","last_change":"2024-04-01T16:34:34.038534+0000","last_active":"2024-04-01T16:34:37.606669+0000","last_peered":"2024-04-01T16:34:37.606669+0000","last_clean":"2024-04-01T16:34:37.606669+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T16:34:37.606669+0000","last_undegraded":"2024-04-01T16:34:37.606669+0000","last_fullsized":"2024-04-01T16:34:37.606669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:54.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.629691+0000","last_change":"2024-04-01T16:34:34.040513+0000","last_active":"2024-04-01T16:34:37.629691+0000","last_peered":"2024-04-01T16:34:37.629691+0000","last_clean":"2024-04-01T16:34:37.629691+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T16:34:37.629691+0000","last_undegraded":"2024-04-01T16:34:37.629691+0000","last_fullsized":"2024-04-01T16:34:37.629691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.629194+0000","last_change":"2024-04-01T16:34:34.038167+0000","last_active":"2024-04-01T16:34:37.629194+0000","last_peered":"2024-04-01T16:34:37.629194+0000","last_clean":"2024-04-01T16:34:37.629194+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T16:34:37.629194+0000","last_undegraded":"2024-04-01T16:34:37.629194+0000","last_fullsized":"2024-04-01T16:34:37.629194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049775+0000","last_change":"2024-04-01T16:34:34.035177+0000","last_active":"2024-04-01T16:34:38.049775+0000","last_peered":"2024-04-01T16:34:38.049775+0000","last_clean":"2024-04-01T16:34:38.049775+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T16:34:38.049775+0000","last_undegraded":"2024-04-01T16:34:38.049775+0000","last_fullsized":"2024-04-01T16:34:38.049775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:37.711846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051189+0000","last_change":"2024-04-01T16:34:34.086031+0000","last_active":"2024-04-01T16:34:38.051189+0000","last_peered":"2024-04-01T16:34:38.051189+0000","last_clean":"2024-04-01T16:34:38.051189+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T16:34:38.051189+0000","last_undegraded":"2024-04-01T16:34:38.051189+0000","last_fullsized":"2024-04-01T16:34:38.051189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049973+0000","last_change":"2024-04-01T16:34:34.071535+0000","last_active":"2024-04-01T16:34:38.049973+0000","last_peered":"2024-04-01T16:34:38.049973+0000","last_clean":"2024-04-01T16:34:38.049973+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T16:34:38.049973+0000","last_undegraded":"2024-04-01T16:34:38.049973+0000","last_fullsized":"2024-04-01T16:34:38.049973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:45.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050801+0000","last_change":"2024-04-01T16:34:33.904701+0000","last_active":"2024-04-01T16:34:38.050801+0000","last_peered":"2024-04-01T16:34:38.050801+0000","last_clean":"2024-04-01T16:34:38.050801+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T16:34:38.050801+0000","last_undegraded":"2024-04-01T16:34:38.050801+0000","last_fullsized":"2024-04-01T16:34:38.050801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050376+0000","last_change":"2024-04-01T16:34:34.064695+0000","last_active":"2024-04-01T16:34:38.050376+0000","last_peered":"2024-04-01T16:34:38.050376+0000","last_clean":"2024-04-01T16:34:38.050376+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T16:34:38.050376+0000","last_undegraded":"2024-04-01T16:34:38.050376+0000","last_fullsized":"2024-04-01T16:34:38.050376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.798148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051612+0000","last_change":"2024-04-01T16:34:34.032994+0000","last_active":"2024-04-01T16:34:38.051612+0000","last_peered":"2024-04-01T16:34:38.051612+0000","last_clean":"2024-04-01T16:34:38.051612+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T16:34:38.051612+0000","last_undegraded":"2024-04-01T16:34:38.051612+0000","last_fullsized":"2024-04-01T16:34:38.051612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591780+0000","last_change":"2024-04-01T16:34:34.082238+0000","last_active":"2024-04-01T16:34:37.591780+0000","last_peered":"2024-04-01T16:34:37.591780+0000","last_clean":"2024-04-01T16:34:37.591780+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T16:34:37.591780+0000","last_undegraded":"2024-04-01T16:34:37.591780+0000","last_fullsized":"2024-04-01T16:34:37.591780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606200+0000","last_change":"2024-04-01T16:34:34.083056+0000","last_active":"2024-04-01T16:34:37.606200+0000","last_peered":"2024-04-01T16:34:37.606200+0000","last_clean":"2024-04-01T16:34:37.606200+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T16:34:37.606200+0000","last_undegraded":"2024-04-01T16:34:37.606200+0000","last_fullsized":"2024-04-01T16:34:37.606200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628826+0000","last_change":"2024-04-01T16:34:34.034017+0000","last_active":"2024-04-01T16:34:37.628826+0000","last_peered":"2024-04-01T16:34:37.628826+0000","last_clean":"2024-04-01T16:34:37.628826+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T16:34:37.628826+0000","last_undegraded":"2024-04-01T16:34:37.628826+0000","last_fullsized":"2024-04-01T16:34:37.628826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:33.976417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049407+0000","last_change":"2024-04-01T16:34:34.068541+0000","last_active":"2024-04-01T16:34:38.049407+0000","last_peered":"2024-04-01T16:34:38.049407+0000","last_clean":"2024-04-01T16:34:38.049407+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T16:34:38.049407+0000","last_undegraded":"2024-04-01T16:34:38.049407+0000","last_fullsized":"2024-04-01T16:34:38.049407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:29.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050928+0000","last_change":"2024-04-01T16:34:34.031774+0000","last_active":"2024-04-01T16:34:38.050928+0000","last_peered":"2024-04-01T16:34:38.050928+0000","last_clean":"2024-04-01T16:34:38.050928+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T16:34:38.050928+0000","last_undegraded":"2024-04-01T16:34:38.050928+0000","last_fullsized":"2024-04-01T16:34:38.050928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:39.294525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050666+0000","last_change":"2024-04-01T16:34:34.090324+0000","last_active":"2024-04-01T16:34:38.050666+0000","last_peered":"2024-04-01T16:34:38.050666+0000","last_clean":"2024-04-01T16:34:38.050666+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T16:34:38.050666+0000","last_undegraded":"2024-04-01T16:34:38.050666+0000","last_fullsized":"2024-04-01T16:34:38.050666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:55:40.168021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050588+0000","last_change":"2024-04-01T16:34:34.083544+0000","last_active":"2024-04-01T16:34:38.050588+0000","last_peered":"2024-04-01T16:34:38.050588+0000","last_clean":"2024-04-01T16:34:38.050588+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T16:34:38.050588+0000","last_undegraded":"2024-04-01T16:34:38.050588+0000","last_fullsized":"2024-04-01T16:34:38.050588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.052042+0000","last_change":"2024-04-01T16:34:34.090721+0000","last_active":"2024-04-01T16:34:38.052042+0000","last_peered":"2024-04-01T16:34:38.052042+0000","last_clean":"2024-04-01T16:34:38.052042+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T16:34:38.052042+0000","last_undegraded":"2024-04-01T16:34:38.052042+0000","last_fullsized":"2024-04-01T16:34:38.052042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.629780+0000","last_change":"2024-04-01T16:34:34.032989+0000","last_active":"2024-04-01T16:34:37.629780+0000","last_peered":"2024-04-01T16:34:37.629780+0000","last_clean":"2024-04-01T16:34:37.629780+0000","last_became_active":"2024-04-01T16:34:34.032529+0000","last_became_peered":"2024-04-01T16:34:34.032529+0000","last_unstale":"2024-04-01T16:34:37.629780+0000","last_undegraded":"2024-04-01T16:34:37.629780+0000","last_fullsized":"2024-04-01T16:34:37.629780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051382+0000","last_change":"2024-04-01T16:34:34.091911+0000","last_active":"2024-04-01T16:34:38.051382+0000","last_peered":"2024-04-01T16:34:38.051382+0000","last_clean":"2024-04-01T16:34:38.051382+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T16:34:38.051382+0000","last_undegraded":"2024-04-01T16:34:38.051382+0000","last_fullsized":"2024-04-01T16:34:38.051382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049301+0000","last_change":"2024-04-01T16:34:34.091540+0000","last_active":"2024-04-01T16:34:38.049301+0000","last_peered":"2024-04-01T16:34:38.049301+0000","last_clean":"2024-04-01T16:34:38.049301+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T16:34:38.049301+0000","last_undegraded":"2024-04-01T16:34:38.049301+0000","last_fullsized":"2024-04-01T16:34:38.049301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049518+0000","last_change":"2024-04-01T16:34:34.087634+0000","last_active":"2024-04-01T16:34:38.049518+0000","last_peered":"2024-04-01T16:34:38.049518+0000","last_clean":"2024-04-01T16:34:38.049518+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T16:34:38.049518+0000","last_undegraded":"2024-04-01T16:34:38.049518+0000","last_fullsized":"2024-04-01T16:34:38.049518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:12.994756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050993+0000","last_change":"2024-04-01T16:34:34.084026+0000","last_active":"2024-04-01T16:34:38.050993+0000","last_peered":"2024-04-01T16:34:38.050993+0000","last_clean":"2024-04-01T16:34:38.050993+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T16:34:38.050993+0000","last_undegraded":"2024-04-01T16:34:38.050993+0000","last_fullsized":"2024-04-01T16:34:38.050993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591723+0000","last_change":"2024-04-01T16:34:34.088300+0000","last_active":"2024-04-01T16:34:37.591723+0000","last_peered":"2024-04-01T16:34:37.591723+0000","last_clean":"2024-04-01T16:34:37.591723+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T16:34:37.591723+0000","last_undegraded":"2024-04-01T16:34:37.591723+0000","last_fullsized":"2024-04-01T16:34:37.591723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628014+0000","last_change":"2024-04-01T16:34:34.068348+0000","last_active":"2024-04-01T16:34:37.628014+0000","last_peered":"2024-04-01T16:34:37.628014+0000","last_clean":"2024-04-01T16:34:37.628014+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T16:34:37.628014+0000","last_undegraded":"2024-04-01T16:34:37.628014+0000","last_fullsized":"2024-04-01T16:34:37.628014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.048983+0000","last_change":"2024-04-01T16:34:33.901019+0000","last_active":"2024-04-01T16:34:38.048983+0000","last_peered":"2024-04-01T16:34:38.048983+0000","last_clean":"2024-04-01T16:34:38.048983+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T16:34:38.048983+0000","last_undegraded":"2024-04-01T16:34:38.048983+0000","last_fullsized":"2024-04-01T16:34:38.048983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:08:37.254438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051388+0000","last_change":"2024-04-01T16:34:31.489434+0000","last_active":"2024-04-01T16:34:38.051388+0000","last_peered":"2024-04-01T16:34:38.051388+0000","last_clean":"2024-04-01T16:34:38.051388+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T16:34:38.051388+0000","last_undegraded":"2024-04-01T16:34:38.051388+0000","last_fullsized":"2024-04-01T16:34:38.051388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049618+0000","last_change":"2024-04-01T16:34:34.065342+0000","last_active":"2024-04-01T16:34:38.049618+0000","last_peered":"2024-04-01T16:34:38.049618+0000","last_clean":"2024-04-01T16:34:38.049618+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T16:34:38.049618+0000","last_undegraded":"2024-04-01T16:34:38.049618+0000","last_fullsized":"2024-04-01T16:34:38.049618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:56.911106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628588+0000","last_change":"2024-04-01T16:34:31.530201+0000","last_active":"2024-04-01T16:34:37.628588+0000","last_peered":"2024-04-01T16:34:37.628588+0000","last_clean":"2024-04-01T16:34:37.628588+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T16:34:37.628588+0000","last_undegraded":"2024-04-01T16:34:37.628588+0000","last_fullsized":"2024-04-01T16:34:37.628588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050852+0000","last_change":"2024-04-01T16:34:31.528238+0000","last_active":"2024-04-01T16:34:38.050852+0000","last_peered":"2024-04-01T16:34:38.050852+0000","last_clean":"2024-04-01T16:34:38.050852+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T16:34:38.050852+0000","last_undegraded":"2024-04-01T16:34:38.050852+0000","last_fullsized":"2024-04-01T16:34:38.050852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049939+0000","last_change":"2024-04-01T16:34:34.091302+0000","last_active":"2024-04-01T16:34:38.049939+0000","last_peered":"2024-04-01T16:34:38.049939+0000","last_clean":"2024-04-01T16:34:38.049939+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T16:34:38.049939+0000","last_undegraded":"2024-04-01T16:34:38.049939+0000","last_fullsized":"2024-04-01T16:34:38.049939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050684+0000","last_change":"2024-04-01T16:34:31.567946+0000","last_active":"2024-04-01T16:34:38.050684+0000","last_peered":"2024-04-01T16:34:38.050684+0000","last_clean":"2024-04-01T16:34:38.050684+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T16:34:38.050684+0000","last_undegraded":"2024-04-01T16:34:38.050684+0000","last_fullsized":"2024-04-01T16:34:38.050684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050534+0000","last_change":"2024-04-01T16:34:34.088894+0000","last_active":"2024-04-01T16:34:38.050534+0000","last_peered":"2024-04-01T16:34:38.050534+0000","last_clean":"2024-04-01T16:34:38.050534+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T16:34:38.050534+0000","last_undegraded":"2024-04-01T16:34:38.050534+0000","last_fullsized":"2024-04-01T16:34:38.050534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.629057+0000","last_change":"2024-04-01T16:34:31.566997+0000","last_active":"2024-04-01T16:34:37.629057+0000","last_peered":"2024-04-01T16:34:37.629057+0000","last_clean":"2024-04-01T16:34:37.629057+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T16:34:37.629057+0000","last_undegraded":"2024-04-01T16:34:37.629057+0000","last_fullsized":"2024-04-01T16:34:37.629057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051550+0000","last_change":"2024-04-01T16:34:34.030831+0000","last_active":"2024-04-01T16:34:38.051550+0000","last_peered":"2024-04-01T16:34:38.051550+0000","last_clean":"2024-04-01T16:34:38.051550+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T16:34:38.051550+0000","last_undegraded":"2024-04-01T16:34:38.051550+0000","last_fullsized":"2024-04-01T16:34:38.051550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051716+0000","last_change":"2024-04-01T16:34:31.569927+0000","last_active":"2024-04-01T16:34:38.051716+0000","last_peered":"2024-04-01T16:34:38.051716+0000","last_clean":"2024-04-01T16:34:38.051716+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T16:34:38.051716+0000","last_undegraded":"2024-04-01T16:34:38.051716+0000","last_fullsized":"2024-04-01T16:34:38.051716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:41.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051582+0000","last_change":"2024-04-01T16:34:34.068959+0000","last_active":"2024-04-01T16:34:38.051582+0000","last_peered":"2024-04-01T16:34:38.051582+0000","last_clean":"2024-04-01T16:34:38.051582+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T16:34:38.051582+0000","last_undegraded":"2024-04-01T16:34:38.051582+0000","last_fullsized":"2024-04-01T16:34:38.051582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:58:57.685708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051536+0000","last_change":"2024-04-01T16:34:31.562792+0000","last_active":"2024-04-01T16:34:38.051536+0000","last_peered":"2024-04-01T16:34:38.051536+0000","last_clean":"2024-04-01T16:34:38.051536+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T16:34:38.051536+0000","last_undegraded":"2024-04-01T16:34:38.051536+0000","last_fullsized":"2024-04-01T16:34:38.051536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:55.684911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049858+0000","last_change":"2024-04-01T16:34:33.916652+0000","last_active":"2024-04-01T16:34:38.049858+0000","last_peered":"2024-04-01T16:34:38.049858+0000","last_clean":"2024-04-01T16:34:38.049858+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T16:34:38.049858+0000","last_undegraded":"2024-04-01T16:34:38.049858+0000","last_fullsized":"2024-04-01T16:34:38.049858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628956+0000","last_change":"2024-04-01T16:34:31.531366+0000","last_active":"2024-04-01T16:34:37.628956+0000","last_peered":"2024-04-01T16:34:37.628956+0000","last_clean":"2024-04-01T16:34:37.628956+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T16:34:37.628956+0000","last_undegraded":"2024-04-01T16:34:37.628956+0000","last_fullsized":"2024-04-01T16:34:37.628956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605679+0000","last_change":"2024-04-01T16:34:34.085449+0000","last_active":"2024-04-01T16:34:37.605679+0000","last_peered":"2024-04-01T16:34:37.605679+0000","last_clean":"2024-04-01T16:34:37.605679+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T16:34:37.605679+0000","last_undegraded":"2024-04-01T16:34:37.605679+0000","last_fullsized":"2024-04-01T16:34:37.605679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049801+0000","last_change":"2024-04-01T16:34:31.444458+0000","last_active":"2024-04-01T16:34:38.049801+0000","last_peered":"2024-04-01T16:34:38.049801+0000","last_clean":"2024-04-01T16:34:38.049801+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T16:34:38.049801+0000","last_undegraded":"2024-04-01T16:34:38.049801+0000","last_fullsized":"2024-04-01T16:34:38.049801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050237+0000","last_change":"2024-04-01T16:34:34.071521+0000","last_active":"2024-04-01T16:34:38.050237+0000","last_peered":"2024-04-01T16:34:38.050237+0000","last_clean":"2024-04-01T16:34:38.050237+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T16:34:38.050237+0000","last_undegraded":"2024-04-01T16:34:38.050237+0000","last_fullsized":"2024-04-01T16:34:38.050237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:36:13.618956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051171+0000","last_change":"2024-04-01T16:34:31.566202+0000","last_active":"2024-04-01T16:34:38.051171+0000","last_peered":"2024-04-01T16:34:38.051171+0000","last_clean":"2024-04-01T16:34:38.051171+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T16:34:38.051171+0000","last_undegraded":"2024-04-01T16:34:38.051171+0000","last_fullsized":"2024-04-01T16:34:38.051171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:54.543283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605625+0000","last_change":"2024-04-01T16:34:33.930561+0000","last_active":"2024-04-01T16:34:37.605625+0000","last_peered":"2024-04-01T16:34:37.605625+0000","last_clean":"2024-04-01T16:34:37.605625+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T16:34:37.605625+0000","last_undegraded":"2024-04-01T16:34:37.605625+0000","last_fullsized":"2024-04-01T16:34:37.605625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628146+0000","last_change":"2024-04-01T16:34:31.535895+0000","last_active":"2024-04-01T16:34:37.628146+0000","last_peered":"2024-04-01T16:34:37.628146+0000","last_clean":"2024-04-01T16:34:37.628146+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T16:34:37.628146+0000","last_undegraded":"2024-04-01T16:34:37.628146+0000","last_fullsized":"2024-04-01T16:34:37.628146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:36:43.780845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628027+0000","last_change":"2024-04-01T16:34:34.068194+0000","last_active":"2024-04-01T16:34:37.628027+0000","last_peered":"2024-04-01T16:34:37.628027+0000","last_clean":"2024-04-01T16:34:37.628027+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T16:34:37.628027+0000","last_undegraded":"2024-04-01T16:34:37.628027+0000","last_fullsized":"2024-04-01T16:34:37.628027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591561+0000","last_change":"2024-04-01T16:34:31.515495+0000","last_active":"2024-04-01T16:34:37.591561+0000","last_peered":"2024-04-01T16:34:37.591561+0000","last_clean":"2024-04-01T16:34:37.591561+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T16:34:37.591561+0000","last_undegraded":"2024-04-01T16:34:37.591561+0000","last_fullsized":"2024-04-01T16:34:37.591561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:26:56.217819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.604988+0000","last_change":"2024-04-01T16:34:33.926318+0000","last_active":"2024-04-01T16:34:37.604988+0000","last_peered":"2024-04-01T16:34:37.604988+0000","last_clean":"2024-04-01T16:34:37.604988+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T16:34:37.604988+0000","last_undegraded":"2024-04-01T16:34:37.604988+0000","last_fullsized":"2024-04-01T16:34:37.604988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049886+0000","last_change":"2024-04-01T16:34:31.440349+0000","last_active":"2024-04-01T16:34:38.049886+0000","last_peered":"2024-04-01T16:34:38.049886+0000","last_clean":"2024-04-01T16:34:38.049886+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T16:34:38.049886+0000","last_undegraded":"2024-04-01T16:34:38.049886+0000","last_fullsized":"2024-04-01T16:34:38.049886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:29.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606304+0000","last_change":"2024-04-01T16:34:33.931211+0000","last_active":"2024-04-01T16:34:37.606304+0000","last_peered":"2024-04-01T16:34:37.606304+0000","last_clean":"2024-04-01T16:34:37.606304+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T16:34:37.606304+0000","last_undegraded":"2024-04-01T16:34:37.606304+0000","last_fullsized":"2024-04-01T16:34:37.606304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:15:45.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591811+0000","last_change":"2024-04-01T16:34:31.512433+0000","last_active":"2024-04-01T16:34:37.591811+0000","last_peered":"2024-04-01T16:34:37.591811+0000","last_clean":"2024-04-01T16:34:37.591811+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T16:34:37.591811+0000","last_undegraded":"2024-04-01T16:34:37.591811+0000","last_fullsized":"2024-04-01T16:34:37.591811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:16.032012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606826+0000","last_change":"2024-04-01T16:34:33.930791+0000","last_active":"2024-04-01T16:34:37.606826+0000","last_peered":"2024-04-01T16:34:37.606826+0000","last_clean":"2024-04-01T16:34:37.606826+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T16:34:37.606826+0000","last_undegraded":"2024-04-01T16:34:37.606826+0000","last_fullsized":"2024-04-01T16:34:37.606826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:53.102054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051625+0000","last_change":"2024-04-01T16:34:31.509375+0000","last_active":"2024-04-01T16:34:38.051625+0000","last_peered":"2024-04-01T16:34:38.051625+0000","last_clean":"2024-04-01T16:34:38.051625+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T16:34:38.051625+0000","last_undegraded":"2024-04-01T16:34:38.051625+0000","last_fullsized":"2024-04-01T16:34:38.051625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051112+0000","last_change":"2024-04-01T16:34:34.085219+0000","last_active":"2024-04-01T16:34:38.051112+0000","last_peered":"2024-04-01T16:34:38.051112+0000","last_clean":"2024-04-01T16:34:38.051112+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T16:34:38.051112+0000","last_undegraded":"2024-04-01T16:34:38.051112+0000","last_fullsized":"2024-04-01T16:34:38.051112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591620+0000","last_change":"2024-04-01T16:34:31.562761+0000","last_active":"2024-04-01T16:34:37.591620+0000","last_peered":"2024-04-01T16:34:37.591620+0000","last_clean":"2024-04-01T16:34:37.591620+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T16:34:37.591620+0000","last_undegraded":"2024-04-01T16:34:37.591620+0000","last_fullsized":"2024-04-01T16:34:37.591620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:23:33.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605752+0000","last_change":"2024-04-01T16:34:34.039521+0000","last_active":"2024-04-01T16:34:37.605752+0000","last_peered":"2024-04-01T16:34:37.605752+0000","last_clean":"2024-04-01T16:34:37.605752+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T16:34:37.605752+0000","last_undegraded":"2024-04-01T16:34:37.605752+0000","last_fullsized":"2024-04-01T16:34:37.605752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605216+0000","last_change":"2024-04-01T16:34:08.195697+0000","last_active":"2024-04-01T16:34:37.605216+0000","last_peered":"2024-04-01T16:34:37.605216+0000","last_clean":"2024-04-01T16:34:37.605216+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T16:34:37.605216+0000","last_undegraded":"2024-04-01T16:34:37.605216+0000","last_fullsized":"2024-04-01T16:34:37.605216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_clean_scrub_stamp":"2024-04-01T16:34:06.247737+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:05:51.067541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050610+0000","last_change":"2024-04-01T16:34:31.569697+0000","last_active":"2024-04-01T16:34:38.050610+0000","last_peered":"2024-04-01T16:34:38.050610+0000","last_clean":"2024-04-01T16:34:38.050610+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T16:34:38.050610+0000","last_undegraded":"2024-04-01T16:34:38.050610+0000","last_fullsized":"2024-04-01T16:34:38.050610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.736852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050625+0000","last_change":"2024-04-01T16:34:34.087298+0000","last_active":"2024-04-01T16:34:38.050625+0000","last_peered":"2024-04-01T16:34:38.050625+0000","last_clean":"2024-04-01T16:34:38.050625+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T16:34:38.050625+0000","last_undegraded":"2024-04-01T16:34:38.050625+0000","last_fullsized":"2024-04-01T16:34:38.050625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.604893+0000","last_change":"2024-04-01T16:34:31.509150+0000","last_active":"2024-04-01T16:34:37.604893+0000","last_peered":"2024-04-01T16:34:37.604893+0000","last_clean":"2024-04-01T16:34:37.604893+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T16:34:37.604893+0000","last_undegraded":"2024-04-01T16:34:37.604893+0000","last_fullsized":"2024-04-01T16:34:37.604893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049380+0000","last_change":"2024-04-01T16:34:34.068444+0000","last_active":"2024-04-01T16:34:38.049380+0000","last_peered":"2024-04-01T16:34:38.049380+0000","last_clean":"2024-04-01T16:34:38.049380+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T16:34:38.049380+0000","last_undegraded":"2024-04-01T16:34:38.049380+0000","last_fullsized":"2024-04-01T16:34:38.049380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:04.104676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591825+0000","last_change":"2024-04-01T16:34:31.512295+0000","last_active":"2024-04-01T16:34:37.591825+0000","last_peered":"2024-04-01T16:34:37.591825+0000","last_clean":"2024-04-01T16:34:37.591825+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T16:34:37.591825+0000","last_undegraded":"2024-04-01T16:34:37.591825+0000","last_fullsized":"2024-04-01T16:34:37.591825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:35.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049896+0000","last_change":"2024-04-01T16:34:34.083194+0000","last_active":"2024-04-01T16:34:38.049896+0000","last_peered":"2024-04-01T16:34:38.049896+0000","last_clean":"2024-04-01T16:34:38.049896+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T16:34:38.049896+0000","last_undegraded":"2024-04-01T16:34:38.049896+0000","last_fullsized":"2024-04-01T16:34:38.049896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051266+0000","last_change":"2024-04-01T16:34:31.569571+0000","last_active":"2024-04-01T16:34:38.051266+0000","last_peered":"2024-04-01T16:34:38.051266+0000","last_clean":"2024-04-01T16:34:38.051266+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T16:34:38.051266+0000","last_undegraded":"2024-04-01T16:34:38.051266+0000","last_fullsized":"2024-04-01T16:34:38.051266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:10.626933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049506+0000","last_change":"2024-04-01T16:34:34.063200+0000","last_active":"2024-04-01T16:34:38.049506+0000","last_peered":"2024-04-01T16:34:38.049506+0000","last_clean":"2024-04-01T16:34:38.049506+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T16:34:38.049506+0000","last_undegraded":"2024-04-01T16:34:38.049506+0000","last_fullsized":"2024-04-01T16:34:38.049506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:18.399835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051349+0000","last_change":"2024-04-01T16:34:31.512508+0000","last_active":"2024-04-01T16:34:38.051349+0000","last_peered":"2024-04-01T16:34:38.051349+0000","last_clean":"2024-04-01T16:34:38.051349+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T16:34:38.051349+0000","last_undegraded":"2024-04-01T16:34:38.051349+0000","last_fullsized":"2024-04-01T16:34:38.051349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050992+0000","last_change":"2024-04-01T16:34:34.084970+0000","last_active":"2024-04-01T16:34:38.050992+0000","last_peered":"2024-04-01T16:34:38.050992+0000","last_clean":"2024-04-01T16:34:38.050992+0000","last_became_active":"2024-04-01T16:34:34.084105+0000","last_became_peered":"2024-04-01T16:34:34.084105+0000","last_unstale":"2024-04-01T16:34:38.050992+0000","last_undegraded":"2024-04-01T16:34:38.050992+0000","last_fullsized":"2024-04-01T16:34:38.050992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606520+0000","last_change":"2024-04-01T16:34:31.426647+0000","last_active":"2024-04-01T16:34:37.606520+0000","last_peered":"2024-04-01T16:34:37.606520+0000","last_clean":"2024-04-01T16:34:37.606520+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T16:34:37.606520+0000","last_undegraded":"2024-04-01T16:34:37.606520+0000","last_fullsized":"2024-04-01T16:34:37.606520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:36.926701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051160+0000","last_change":"2024-04-01T16:34:34.087431+0000","last_active":"2024-04-01T16:34:38.051160+0000","last_peered":"2024-04-01T16:34:38.051160+0000","last_clean":"2024-04-01T16:34:38.051160+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T16:34:38.051160+0000","last_undegraded":"2024-04-01T16:34:38.051160+0000","last_fullsized":"2024-04-01T16:34:38.051160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.052029+0000","last_change":"2024-04-01T16:34:31.528790+0000","last_active":"2024-04-01T16:34:38.052029+0000","last_peered":"2024-04-01T16:34:38.052029+0000","last_clean":"2024-04-01T16:34:38.052029+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T16:34:38.052029+0000","last_undegraded":"2024-04-01T16:34:38.052029+0000","last_fullsized":"2024-04-01T16:34:38.052029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.052152+0000","last_change":"2024-04-01T16:34:34.085832+0000","last_active":"2024-04-01T16:34:38.052152+0000","last_peered":"2024-04-01T16:34:38.052152+0000","last_clean":"2024-04-01T16:34:38.052152+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T16:34:38.052152+0000","last_undegraded":"2024-04-01T16:34:38.052152+0000","last_fullsized":"2024-04-01T16:34:38.052152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.629267+0000","last_change":"2024-04-01T16:34:31.534057+0000","last_active":"2024-04-01T16:34:37.629267+0000","last_peered":"2024-04-01T16:34:37.629267+0000","last_clean":"2024-04-01T16:34:37.629267+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T16:34:37.629267+0000","last_undegraded":"2024-04-01T16:34:37.629267+0000","last_fullsized":"2024-04-01T16:34:37.629267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050929+0000","last_change":"2024-04-01T16:34:34.073261+0000","last_active":"2024-04-01T16:34:38.050929+0000","last_peered":"2024-04-01T16:34:38.050929+0000","last_clean":"2024-04-01T16:34:38.050929+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T16:34:38.050929+0000","last_undegraded":"2024-04-01T16:34:38.050929+0000","last_fullsized":"2024-04-01T16:34:38.050929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:38.619969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.604865+0000","last_change":"2024-04-01T16:34:31.423531+0000","last_active":"2024-04-01T16:34:37.604865+0000","last_peered":"2024-04-01T16:34:37.604865+0000","last_clean":"2024-04-01T16:34:37.604865+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T16:34:37.604865+0000","last_undegraded":"2024-04-01T16:34:37.604865+0000","last_fullsized":"2024-04-01T16:34:37.604865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049008+0000","last_change":"2024-04-01T16:34:34.086029+0000","last_active":"2024-04-01T16:34:38.049008+0000","last_peered":"2024-04-01T16:34:38.049008+0000","last_clean":"2024-04-01T16:34:38.049008+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T16:34:38.049008+0000","last_undegraded":"2024-04-01T16:34:38.049008+0000","last_fullsized":"2024-04-01T16:34:38.049008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051032+0000","last_change":"2024-04-01T16:34:31.509351+0000","last_active":"2024-04-01T16:34:38.051032+0000","last_peered":"2024-04-01T16:34:38.051032+0000","last_clean":"2024-04-01T16:34:38.051032+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T16:34:38.051032+0000","last_undegraded":"2024-04-01T16:34:38.051032+0000","last_fullsized":"2024-04-01T16:34:38.051032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050038+0000","last_change":"2024-04-01T16:34:34.091932+0000","last_active":"2024-04-01T16:34:38.050038+0000","last_peered":"2024-04-01T16:34:38.050038+0000","last_clean":"2024-04-01T16:34:38.050038+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T16:34:38.050038+0000","last_undegraded":"2024-04-01T16:34:38.050038+0000","last_fullsized":"2024-04-01T16:34:38.050038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:11:00.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050388+0000","last_change":"2024-04-01T16:34:31.517513+0000","last_active":"2024-04-01T16:34:38.050388+0000","last_peered":"2024-04-01T16:34:38.050388+0000","last_clean":"2024-04-01T16:34:38.050388+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T16:34:38.050388+0000","last_undegraded":"2024-04-01T16:34:38.050388+0000","last_fullsized":"2024-04-01T16:34:38.050388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:31.608594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051289+0000","last_change":"2024-04-01T16:34:34.092277+0000","last_active":"2024-04-01T16:34:38.051289+0000","last_peered":"2024-04-01T16:34:38.051289+0000","last_clean":"2024-04-01T16:34:38.051289+0000","last_became_active":"2024-04-01T16:34:34.091006+0000","last_became_peered":"2024-04-01T16:34:34.091006+0000","last_unstale":"2024-04-01T16:34:38.051289+0000","last_undegraded":"2024-04-01T16:34:38.051289+0000","last_fullsized":"2024-04-01T16:34:38.051289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:38:43.513904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605898+0000","last_change":"2024-04-01T16:34:31.444603+0000","last_active":"2024-04-01T16:34:37.605898+0000","last_peered":"2024-04-01T16:34:37.605898+0000","last_clean":"2024-04-01T16:34:37.605898+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T16:34:37.605898+0000","last_undegraded":"2024-04-01T16:34:37.605898+0000","last_fullsized":"2024-04-01T16:34:37.605898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628416+0000","last_change":"2024-04-01T16:34:34.034061+0000","last_active":"2024-04-01T16:34:37.628416+0000","last_peered":"2024-04-01T16:34:37.628416+0000","last_clean":"2024-04-01T16:34:37.628416+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T16:34:37.628416+0000","last_undegraded":"2024-04-01T16:34:37.628416+0000","last_fullsized":"2024-04-01T16:34:37.628416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051135+0000","last_change":"2024-04-01T16:34:34.035919+0000","last_active":"2024-04-01T16:34:38.051135+0000","last_peered":"2024-04-01T16:34:38.051135+0000","last_clean":"2024-04-01T16:34:38.051135+0000","last_became_active":"2024-04-01T16:34:34.035634+0000","last_became_peered":"2024-04-01T16:34:34.035634+0000","last_unstale":"2024-04-01T16:34:38.051135+0000","last_undegraded":"2024-04-01T16:34:38.051135+0000","last_fullsized":"2024-04-01T16:34:38.051135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:24:57.379837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605565+0000","last_change":"2024-04-01T16:34:31.563882+0000","last_active":"2024-04-01T16:34:37.605565+0000","last_peered":"2024-04-01T16:34:37.605565+0000","last_clean":"2024-04-01T16:34:37.605565+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T16:34:37.605565+0000","last_undegraded":"2024-04-01T16:34:37.605565+0000","last_fullsized":"2024-04-01T16:34:37.605565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:27.209535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050852+0000","last_change":"2024-04-01T16:34:34.034904+0000","last_active":"2024-04-01T16:34:38.050852+0000","last_peered":"2024-04-01T16:34:38.050852+0000","last_clean":"2024-04-01T16:34:38.050852+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T16:34:38.050852+0000","last_undegraded":"2024-04-01T16:34:38.050852+0000","last_fullsized":"2024-04-01T16:34:38.050852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606192+0000","last_change":"2024-04-01T16:34:31.530246+0000","last_active":"2024-04-01T16:34:37.606192+0000","last_peered":"2024-04-01T16:34:37.606192+0000","last_clean":"2024-04-01T16:34:37.606192+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T16:34:37.606192+0000","last_undegraded":"2024-04-01T16:34:37.606192+0000","last_fullsized":"2024-04-01T16:34:37.606192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:48.430325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051354+0000","last_change":"2024-04-01T16:34:34.066381+0000","last_active":"2024-04-01T16:34:38.051354+0000","last_peered":"2024-04-01T16:34:38.051354+0000","last_clean":"2024-04-01T16:34:38.051354+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T16:34:38.051354+0000","last_undegraded":"2024-04-01T16:34:38.051354+0000","last_fullsized":"2024-04-01T16:34:38.051354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:10.824493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051915+0000","last_change":"2024-04-01T16:34:31.490535+0000","last_active":"2024-04-01T16:34:38.051915+0000","last_peered":"2024-04-01T16:34:38.051915+0000","last_clean":"2024-04-01T16:34:38.051915+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T16:34:38.051915+0000","last_undegraded":"2024-04-01T16:34:38.051915+0000","last_fullsized":"2024-04-01T16:34:38.051915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:24.709969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051724+0000","last_change":"2024-04-01T16:34:34.087097+0000","last_active":"2024-04-01T16:34:38.051724+0000","last_peered":"2024-04-01T16:34:38.051724+0000","last_clean":"2024-04-01T16:34:38.051724+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T16:34:38.051724+0000","last_undegraded":"2024-04-01T16:34:38.051724+0000","last_fullsized":"2024-04-01T16:34:38.051724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:17:48.287828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"24'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.052000+0000","last_change":"2024-04-01T16:34:31.420599+0000","last_active":"2024-04-01T16:34:38.052000+0000","last_peered":"2024-04-01T16:34:38.052000+0000","last_clean":"2024-04-01T16:34:38.052000+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T16:34:38.052000+0000","last_undegraded":"2024-04-01T16:34:38.052000+0000","last_fullsized":"2024-04-01T16:34:38.052000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":685650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":94700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":685706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":94790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":94826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":96312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":96312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":94860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T16:34:45.755 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T16:34:45.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.999+0000 7fc94e800640 1 Processor -- start 2024-04-01T16:34:45.999 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:45.999+0000 7fc94e800640 1 -- start start 2024-04-01T16:34:46.000 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.001+0000 7fc94e800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc9480c6b30 0x7fc94815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:46.000 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.001+0000 7fc94e800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc948071ee0 0x7fc94815bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:46.000 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.001+0000 7fc94e800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9480737f0 con 0x7fc948152830 2024-04-01T16:34:46.000 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.001+0000 7fc94e800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fc948152c10 con 0x7fc948071ee0 2024-04-01T16:34:46.000 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.001+0000 7fc94e800640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc9480c72d0 con 0x7fc9480c6b30 2024-04-01T16:34:46.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.002+0000 7fc947400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fc948152830 0x7fc948072900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50152/0 (socket says 172.21.15.163:50152) 2024-04-01T16:34:46.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.002+0000 7fc947400640 1 -- 172.21.15.163:0/1015315968 learned_addr learned my addr 172.21.15.163:0/1015315968 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:46.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.002+0000 7fc946a00640 1 --2- 172.21.15.163:0/1015315968 >> v2:172.21.15.189:3300/0 conn(0x7fc9480c6b30 0x7fc94815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:46.002 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.003+0000 7fc947e00640 1 --2- 172.21.15.163:0/1015315968 >> v2:172.21.15.163:3300/0 conn(0x7fc948071ee0 0x7fc94815bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:46.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.007+0000 7fc946000640 1 -- 172.21.15.163:0/1015315968 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3734707918 0 0) 0x7fc9480737f0 con 0x7fc948152830 2024-04-01T16:34:46.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.007+0000 7fc946000640 1 -- 172.21.15.163:0/1015315968 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc92c003520 con 0x7fc948152830 2024-04-01T16:34:46.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.009+0000 7fc947e00640 1 -- 172.21.15.163:0/1015315968 >> v2:172.21.15.189:3300/0 conn(0x7fc9480c6b30 msgr2=0x7fc94815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:46.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.009+0000 7fc947e00640 1 --2- 172.21.15.163:0/1015315968 >> v2:172.21.15.189:3300/0 conn(0x7fc9480c6b30 0x7fc94815ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.009+0000 7fc947e00640 1 -- 172.21.15.163:0/1015315968 >> v1:172.21.15.163:6789/0 conn(0x7fc948152830 legacy=0x7fc948072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:46.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.009+0000 7fc947e00640 1 -- 172.21.15.163:0/1015315968 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9480c75b0 con 0x7fc948071ee0 2024-04-01T16:34:46.011 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.012+0000 7fc947e00640 1 --2- 172.21.15.163:0/1015315968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc948071ee0 0x7fc94815bf90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc948156070 tx=0x7fc94002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e027e0573359e86 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:46.022 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.023+0000 7fc946000640 1 -- 172.21.15.163:0/1015315968 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940039070 con 0x7fc948071ee0 2024-04-01T16:34:46.022 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.023+0000 7fc946000640 1 -- 172.21.15.163:0/1015315968 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94002cc80 con 0x7fc948071ee0 2024-04-01T16:34:46.023 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.023+0000 7fc946000640 1 -- 172.21.15.163:0/1015315968 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940034660 con 0x7fc948071ee0 2024-04-01T16:34:46.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.024+0000 7fc94e800640 1 -- 172.21.15.163:0/1015315968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc948071ee0 msgr2=0x7fc94815bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:46.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.024+0000 7fc94e800640 1 --2- 172.21.15.163:0/1015315968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc948071ee0 0x7fc94815bf90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc948156070 tx=0x7fc94002bed0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.024+0000 7fc94e800640 1 -- 172.21.15.163:0/1015315968 shutdown_connections 2024-04-01T16:34:46.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.024+0000 7fc94e800640 1 --2- 172.21.15.163:0/1015315968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc948071ee0 0x7fc94815bf90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.024+0000 7fc94e800640 1 --2- 172.21.15.163:0/1015315968 >> v2:172.21.15.189:3300/0 conn(0x7fc9480c6b30 0x7fc94815ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.024+0000 7fc94e800640 1 -- 172.21.15.163:0/1015315968 >> 172.21.15.163:0/1015315968 conn(0x7fc9480cbe20 msgr2=0x7fc9480cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:46.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.024+0000 7fc94e800640 1 -- 172.21.15.163:0/1015315968 shutdown_connections 2024-04-01T16:34:46.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.024+0000 7fc94e800640 1 -- 172.21.15.163:0/1015315968 wait complete. 2024-04-01T16:34:46.026 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.027+0000 7fc94e800640 1 Processor -- start 2024-04-01T16:34:46.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.027+0000 7fc94e800640 1 -- start start 2024-04-01T16:34:46.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.029+0000 7fc94e800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc948071ee0 0x7fc9481f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:46.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.029+0000 7fc94e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9480c6b30 0x7fc9481e1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:46.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.029+0000 7fc94e800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc948152830 0x7fc948146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:46.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.029+0000 7fc94e800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc948073a90 con 0x7fc948152830 2024-04-01T16:34:46.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.029+0000 7fc94e800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc9480c7b70 con 0x7fc9480c6b30 2024-04-01T16:34:46.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.029+0000 7fc94e800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc9480707f0 con 0x7fc948071ee0 2024-04-01T16:34:46.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.030+0000 7fc947e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc948152830 0x7fc948146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:46.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.030+0000 7fc947e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc948152830 0x7fc948146b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48036/0 (socket says 172.21.15.163:48036) 2024-04-01T16:34:46.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.030+0000 7fc947e00640 1 -- 172.21.15.163:0/1854536990 learned_addr learned my addr 172.21.15.163:0/1854536990 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:46.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.031+0000 7fc946a00640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9480c6b30 0x7fc9481e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:46.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.031+0000 7fc947400640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc948071ee0 0x7fc9481f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:46.033 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.034+0000 7fc947e00640 1 -- 172.21.15.163:0/1854536990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc948071ee0 msgr2=0x7fc9481f14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:46.033 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.034+0000 7fc947e00640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc948071ee0 0x7fc9481f14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.034 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.034+0000 7fc947e00640 1 -- 172.21.15.163:0/1854536990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9480c6b30 msgr2=0x7fc9481e1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:46.034 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.034+0000 7fc947e00640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9480c6b30 0x7fc9481e1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.034 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.034+0000 7fc947e00640 1 -- 172.21.15.163:0/1854536990 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9481e1850 con 0x7fc948152830 2024-04-01T16:34:46.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.037+0000 7fc947e00640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc948152830 0x7fc948146b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc940009e80 tx=0x7fc940004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:46.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.041+0000 7fc93f400640 1 -- 172.21.15.163:0/1854536990 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940039050 con 0x7fc948152830 2024-04-01T16:34:46.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.041+0000 7fc93f400640 1 -- 172.21.15.163:0/1854536990 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc940045070 con 0x7fc948152830 2024-04-01T16:34:46.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.041+0000 7fc93f400640 1 -- 172.21.15.163:0/1854536990 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940009450 con 0x7fc948152830 2024-04-01T16:34:46.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.041+0000 7fc94e800640 1 -- 172.21.15.163:0/1854536990 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9481f4000 con 0x7fc948152830 2024-04-01T16:34:46.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.041+0000 7fc94e800640 1 -- 172.21.15.163:0/1854536990 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9481f01e0 con 0x7fc948152830 2024-04-01T16:34:46.042 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.043+0000 7fc94e800640 1 -- 172.21.15.163:0/1854536990 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9481effd0 con 0x7fc948152830 2024-04-01T16:34:46.068 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.068+0000 7fc93f400640 1 -- 172.21.15.163:0/1854536990 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc94003e850 con 0x7fc948152830 2024-04-01T16:34:46.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.070+0000 7fc93f400640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc92806c940 0x7fc92806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:46.070 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.070+0000 7fc947400640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc92806c940 0x7fc92806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:46.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.072+0000 7fc947400640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc92806c940 0x7fc92806ee00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc938005880 tx=0x7fc938009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:46.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.368+0000 7fc93f400640 1 -- 172.21.15.163:0/1854536990 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7fc94007afc0 con 0x7fc948152830 2024-04-01T16:34:46.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.370+0000 7fc93f400640 1 -- 172.21.15.163:0/1854536990 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc94007cf20 con 0x7fc948152830 2024-04-01T16:34:46.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.582+0000 7fc94e800640 1 -- 172.21.15.163:0/1854536990 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9480756d0 con 0x7fc92806c940 2024-04-01T16:34:46.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.592+0000 7fc93f400640 1 -- 172.21.15.163:0/1854536990 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251908 (secure 0 0 0) 0x7fc9480756d0 con 0x7fc92806c940 2024-04-01T16:34:46.593 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:46.596 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T16:34:46.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.598+0000 7fc94e800640 1 -- 172.21.15.163:0/1854536990 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc92806c940 msgr2=0x7fc92806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:46.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.598+0000 7fc94e800640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc92806c940 0x7fc92806ee00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc938005880 tx=0x7fc938009040 comp rx=0 tx=0).stop 2024-04-01T16:34:46.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.598+0000 7fc94e800640 1 -- 172.21.15.163:0/1854536990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc948152830 msgr2=0x7fc948146b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:46.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.598+0000 7fc94e800640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc948152830 0x7fc948146b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc940009e80 tx=0x7fc940004a40 comp rx=0 tx=0).stop 2024-04-01T16:34:46.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.598+0000 7fc94e800640 1 -- 172.21.15.163:0/1854536990 shutdown_connections 2024-04-01T16:34:46.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.598+0000 7fc94e800640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc92806c940 0x7fc92806ee00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.598+0000 7fc94e800640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc948152830 0x7fc948146b30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.598+0000 7fc94e800640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9480c6b30 0x7fc9481e1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.598+0000 7fc94e800640 1 --2- 172.21.15.163:0/1854536990 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc948071ee0 0x7fc9481f14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.598+0000 7fc94e800640 1 -- 172.21.15.163:0/1854536990 >> 172.21.15.163:0/1854536990 conn(0x7fc9480cbe20 msgr2=0x7fc948147680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:46.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.598+0000 7fc94e800640 1 -- 172.21.15.163:0/1854536990 shutdown_connections 2024-04-01T16:34:46.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.598+0000 7fc94e800640 1 -- 172.21.15.163:0/1854536990 wait complete. 2024-04-01T16:34:46.617 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-01T16:34:45.787902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219428,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755292,"statfs":{"total":773094113280,"available":772869419008,"internally_reserved":0,"allocated":3317760,"data_stored":1943156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.473133"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606518+0000","last_change":"2024-04-01T16:34:34.033508+0000","last_active":"2024-04-01T16:34:37.606518+0000","last_peered":"2024-04-01T16:34:37.606518+0000","last_clean":"2024-04-01T16:34:37.606518+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T16:34:37.606518+0000","last_undegraded":"2024-04-01T16:34:37.606518+0000","last_fullsized":"2024-04-01T16:34:37.606518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051847+0000","last_change":"2024-04-01T16:34:34.065375+0000","last_active":"2024-04-01T16:34:38.051847+0000","last_peered":"2024-04-01T16:34:38.051847+0000","last_clean":"2024-04-01T16:34:38.051847+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T16:34:38.051847+0000","last_undegraded":"2024-04-01T16:34:38.051847+0000","last_fullsized":"2024-04-01T16:34:38.051847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050257+0000","last_change":"2024-04-01T16:34:34.084618+0000","last_active":"2024-04-01T16:34:38.050257+0000","last_peered":"2024-04-01T16:34:38.050257+0000","last_clean":"2024-04-01T16:34:38.050257+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T16:34:38.050257+0000","last_undegraded":"2024-04-01T16:34:38.050257+0000","last_fullsized":"2024-04-01T16:34:38.050257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:43.530081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050850+0000","last_change":"2024-04-01T16:34:34.088694+0000","last_active":"2024-04-01T16:34:38.050850+0000","last_peered":"2024-04-01T16:34:38.050850+0000","last_clean":"2024-04-01T16:34:38.050850+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T16:34:38.050850+0000","last_undegraded":"2024-04-01T16:34:38.050850+0000","last_fullsized":"2024-04-01T16:34:38.050850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605580+0000","last_change":"2024-04-01T16:34:34.085765+0000","last_active":"2024-04-01T16:34:37.605580+0000","last_peered":"2024-04-01T16:34:37.605580+0000","last_clean":"2024-04-01T16:34:37.605580+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T16:34:37.605580+0000","last_undegraded":"2024-04-01T16:34:37.605580+0000","last_fullsized":"2024-04-01T16:34:37.605580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050667+0000","last_change":"2024-04-01T16:34:34.066150+0000","last_active":"2024-04-01T16:34:38.050667+0000","last_peered":"2024-04-01T16:34:38.050667+0000","last_clean":"2024-04-01T16:34:38.050667+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T16:34:38.050667+0000","last_undegraded":"2024-04-01T16:34:38.050667+0000","last_fullsized":"2024-04-01T16:34:38.050667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:08:56.651785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.604963+0000","last_change":"2024-04-01T16:34:34.072924+0000","last_active":"2024-04-01T16:34:37.604963+0000","last_peered":"2024-04-01T16:34:37.604963+0000","last_clean":"2024-04-01T16:34:37.604963+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T16:34:37.604963+0000","last_undegraded":"2024-04-01T16:34:37.604963+0000","last_fullsized":"2024-04-01T16:34:37.604963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049767+0000","last_change":"2024-04-01T16:34:34.088361+0000","last_active":"2024-04-01T16:34:38.049767+0000","last_peered":"2024-04-01T16:34:38.049767+0000","last_clean":"2024-04-01T16:34:38.049767+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T16:34:38.049767+0000","last_undegraded":"2024-04-01T16:34:38.049767+0000","last_fullsized":"2024-04-01T16:34:38.049767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606669+0000","last_change":"2024-04-01T16:34:34.038534+0000","last_active":"2024-04-01T16:34:37.606669+0000","last_peered":"2024-04-01T16:34:37.606669+0000","last_clean":"2024-04-01T16:34:37.606669+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T16:34:37.606669+0000","last_undegraded":"2024-04-01T16:34:37.606669+0000","last_fullsized":"2024-04-01T16:34:37.606669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:54.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.629691+0000","last_change":"2024-04-01T16:34:34.040513+0000","last_active":"2024-04-01T16:34:37.629691+0000","last_peered":"2024-04-01T16:34:37.629691+0000","last_clean":"2024-04-01T16:34:37.629691+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T16:34:37.629691+0000","last_undegraded":"2024-04-01T16:34:37.629691+0000","last_fullsized":"2024-04-01T16:34:37.629691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.629194+0000","last_change":"2024-04-01T16:34:34.038167+0000","last_active":"2024-04-01T16:34:37.629194+0000","last_peered":"2024-04-01T16:34:37.629194+0000","last_clean":"2024-04-01T16:34:37.629194+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T16:34:37.629194+0000","last_undegraded":"2024-04-01T16:34:37.629194+0000","last_fullsized":"2024-04-01T16:34:37.629194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049775+0000","last_change":"2024-04-01T16:34:34.035177+0000","last_active":"2024-04-01T16:34:38.049775+0000","last_peered":"2024-04-01T16:34:38.049775+0000","last_clean":"2024-04-01T16:34:38.049775+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T16:34:38.049775+0000","last_undegraded":"2024-04-01T16:34:38.049775+0000","last_fullsized":"2024-04-01T16:34:38.049775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:37.711846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051189+0000","last_change":"2024-04-01T16:34:34.086031+0000","last_active":"2024-04-01T16:34:38.051189+0000","last_peered":"2024-04-01T16:34:38.051189+0000","last_clean":"2024-04-01T16:34:38.051189+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T16:34:38.051189+0000","last_undegraded":"2024-04-01T16:34:38.051189+0000","last_fullsized":"2024-04-01T16:34:38.051189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049973+0000","last_change":"2024-04-01T16:34:34.071535+0000","last_active":"2024-04-01T16:34:38.049973+0000","last_peered":"2024-04-01T16:34:38.049973+0000","last_clean":"2024-04-01T16:34:38.049973+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T16:34:38.049973+0000","last_undegraded":"2024-04-01T16:34:38.049973+0000","last_fullsized":"2024-04-01T16:34:38.049973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:45.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050801+0000","last_change":"2024-04-01T16:34:33.904701+0000","last_active":"2024-04-01T16:34:38.050801+0000","last_peered":"2024-04-01T16:34:38.050801+0000","last_clean":"2024-04-01T16:34:38.050801+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T16:34:38.050801+0000","last_undegraded":"2024-04-01T16:34:38.050801+0000","last_fullsized":"2024-04-01T16:34:38.050801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050376+0000","last_change":"2024-04-01T16:34:34.064695+0000","last_active":"2024-04-01T16:34:38.050376+0000","last_peered":"2024-04-01T16:34:38.050376+0000","last_clean":"2024-04-01T16:34:38.050376+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T16:34:38.050376+0000","last_undegraded":"2024-04-01T16:34:38.050376+0000","last_fullsized":"2024-04-01T16:34:38.050376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.798148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051612+0000","last_change":"2024-04-01T16:34:34.032994+0000","last_active":"2024-04-01T16:34:38.051612+0000","last_peered":"2024-04-01T16:34:38.051612+0000","last_clean":"2024-04-01T16:34:38.051612+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T16:34:38.051612+0000","last_undegraded":"2024-04-01T16:34:38.051612+0000","last_fullsized":"2024-04-01T16:34:38.051612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591780+0000","last_change":"2024-04-01T16:34:34.082238+0000","last_active":"2024-04-01T16:34:37.591780+0000","last_peered":"2024-04-01T16:34:37.591780+0000","last_clean":"2024-04-01T16:34:37.591780+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T16:34:37.591780+0000","last_undegraded":"2024-04-01T16:34:37.591780+0000","last_fullsized":"2024-04-01T16:34:37.591780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606200+0000","last_change":"2024-04-01T16:34:34.083056+0000","last_active":"2024-04-01T16:34:37.606200+0000","last_peered":"2024-04-01T16:34:37.606200+0000","last_clean":"2024-04-01T16:34:37.606200+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T16:34:37.606200+0000","last_undegraded":"2024-04-01T16:34:37.606200+0000","last_fullsized":"2024-04-01T16:34:37.606200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628826+0000","last_change":"2024-04-01T16:34:34.034017+0000","last_active":"2024-04-01T16:34:37.628826+0000","last_peered":"2024-04-01T16:34:37.628826+0000","last_clean":"2024-04-01T16:34:37.628826+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T16:34:37.628826+0000","last_undegraded":"2024-04-01T16:34:37.628826+0000","last_fullsized":"2024-04-01T16:34:37.628826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:33.976417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049407+0000","last_change":"2024-04-01T16:34:34.068541+0000","last_active":"2024-04-01T16:34:38.049407+0000","last_peered":"2024-04-01T16:34:38.049407+0000","last_clean":"2024-04-01T16:34:38.049407+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T16:34:38.049407+0000","last_undegraded":"2024-04-01T16:34:38.049407+0000","last_fullsized":"2024-04-01T16:34:38.049407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:29.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050928+0000","last_change":"2024-04-01T16:34:34.031774+0000","last_active":"2024-04-01T16:34:38.050928+0000","last_peered":"2024-04-01T16:34:38.050928+0000","last_clean":"2024-04-01T16:34:38.050928+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T16:34:38.050928+0000","last_undegraded":"2024-04-01T16:34:38.050928+0000","last_fullsized":"2024-04-01T16:34:38.050928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:39.294525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050666+0000","last_change":"2024-04-01T16:34:34.090324+0000","last_active":"2024-04-01T16:34:38.050666+0000","last_peered":"2024-04-01T16:34:38.050666+0000","last_clean":"2024-04-01T16:34:38.050666+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T16:34:38.050666+0000","last_undegraded":"2024-04-01T16:34:38.050666+0000","last_fullsized":"2024-04-01T16:34:38.050666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:55:40.168021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050588+0000","last_change":"2024-04-01T16:34:34.083544+0000","last_active":"2024-04-01T16:34:38.050588+0000","last_peered":"2024-04-01T16:34:38.050588+0000","last_clean":"2024-04-01T16:34:38.050588+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T16:34:38.050588+0000","last_undegraded":"2024-04-01T16:34:38.050588+0000","last_fullsized":"2024-04-01T16:34:38.050588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.052042+0000","last_change":"2024-04-01T16:34:34.090721+0000","last_active":"2024-04-01T16:34:38.052042+0000","last_peered":"2024-04-01T16:34:38.052042+0000","last_clean":"2024-04-01T16:34:38.052042+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T16:34:38.052042+0000","last_undegraded":"2024-04-01T16:34:38.052042+0000","last_fullsized":"2024-04-01T16:34:38.052042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.629780+0000","last_change":"2024-04-01T16:34:34.032989+0000","last_active":"2024-04-01T16:34:37.629780+0000","last_peered":"2024-04-01T16:34:37.629780+0000","last_clean":"2024-04-01T16:34:37.629780+0000","last_became_active":"2024-04-01T16:34:34.032529+0000","last_became_peered":"2024-04-01T16:34:34.032529+0000","last_unstale":"2024-04-01T16:34:37.629780+0000","last_undegraded":"2024-04-01T16:34:37.629780+0000","last_fullsized":"2024-04-01T16:34:37.629780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051382+0000","last_change":"2024-04-01T16:34:34.091911+0000","last_active":"2024-04-01T16:34:38.051382+0000","last_peered":"2024-04-01T16:34:38.051382+0000","last_clean":"2024-04-01T16:34:38.051382+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T16:34:38.051382+0000","last_undegraded":"2024-04-01T16:34:38.051382+0000","last_fullsized":"2024-04-01T16:34:38.051382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049301+0000","last_change":"2024-04-01T16:34:34.091540+0000","last_active":"2024-04-01T16:34:38.049301+0000","last_peered":"2024-04-01T16:34:38.049301+0000","last_clean":"2024-04-01T16:34:38.049301+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T16:34:38.049301+0000","last_undegraded":"2024-04-01T16:34:38.049301+0000","last_fullsized":"2024-04-01T16:34:38.049301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049518+0000","last_change":"2024-04-01T16:34:34.087634+0000","last_active":"2024-04-01T16:34:38.049518+0000","last_peered":"2024-04-01T16:34:38.049518+0000","last_clean":"2024-04-01T16:34:38.049518+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T16:34:38.049518+0000","last_undegraded":"2024-04-01T16:34:38.049518+0000","last_fullsized":"2024-04-01T16:34:38.049518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:12.994756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050993+0000","last_change":"2024-04-01T16:34:34.084026+0000","last_active":"2024-04-01T16:34:38.050993+0000","last_peered":"2024-04-01T16:34:38.050993+0000","last_clean":"2024-04-01T16:34:38.050993+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T16:34:38.050993+0000","last_undegraded":"2024-04-01T16:34:38.050993+0000","last_fullsized":"2024-04-01T16:34:38.050993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591723+0000","last_change":"2024-04-01T16:34:34.088300+0000","last_active":"2024-04-01T16:34:37.591723+0000","last_peered":"2024-04-01T16:34:37.591723+0000","last_clean":"2024-04-01T16:34:37.591723+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T16:34:37.591723+0000","last_undegraded":"2024-04-01T16:34:37.591723+0000","last_fullsized":"2024-04-01T16:34:37.591723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628014+0000","last_change":"2024-04-01T16:34:34.068348+0000","last_active":"2024-04-01T16:34:37.628014+0000","last_peered":"2024-04-01T16:34:37.628014+0000","last_clean":"2024-04-01T16:34:37.628014+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T16:34:37.628014+0000","last_undegraded":"2024-04-01T16:34:37.628014+0000","last_fullsized":"2024-04-01T16:34:37.628014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.048983+0000","last_change":"2024-04-01T16:34:33.901019+0000","last_active":"2024-04-01T16:34:38.048983+0000","last_peered":"2024-04-01T16:34:38.048983+0000","last_clean":"2024-04-01T16:34:38.048983+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T16:34:38.048983+0000","last_undegraded":"2024-04-01T16:34:38.048983+0000","last_fullsized":"2024-04-01T16:34:38.048983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:08:37.254438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051388+0000","last_change":"2024-04-01T16:34:31.489434+0000","last_active":"2024-04-01T16:34:38.051388+0000","last_peered":"2024-04-01T16:34:38.051388+0000","last_clean":"2024-04-01T16:34:38.051388+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T16:34:38.051388+0000","last_undegraded":"2024-04-01T16:34:38.051388+0000","last_fullsized":"2024-04-01T16:34:38.051388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049618+0000","last_change":"2024-04-01T16:34:34.065342+0000","last_active":"2024-04-01T16:34:38.049618+0000","last_peered":"2024-04-01T16:34:38.049618+0000","last_clean":"2024-04-01T16:34:38.049618+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T16:34:38.049618+0000","last_undegraded":"2024-04-01T16:34:38.049618+0000","last_fullsized":"2024-04-01T16:34:38.049618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:56.911106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628588+0000","last_change":"2024-04-01T16:34:31.530201+0000","last_active":"2024-04-01T16:34:37.628588+0000","last_peered":"2024-04-01T16:34:37.628588+0000","last_clean":"2024-04-01T16:34:37.628588+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T16:34:37.628588+0000","last_undegraded":"2024-04-01T16:34:37.628588+0000","last_fullsized":"2024-04-01T16:34:37.628588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050852+0000","last_change":"2024-04-01T16:34:31.528238+0000","last_active":"2024-04-01T16:34:38.050852+0000","last_peered":"2024-04-01T16:34:38.050852+0000","last_clean":"2024-04-01T16:34:38.050852+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T16:34:38.050852+0000","last_undegraded":"2024-04-01T16:34:38.050852+0000","last_fullsized":"2024-04-01T16:34:38.050852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049939+0000","last_change":"2024-04-01T16:34:34.091302+0000","last_active":"2024-04-01T16:34:38.049939+0000","last_peered":"2024-04-01T16:34:38.049939+0000","last_clean":"2024-04-01T16:34:38.049939+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T16:34:38.049939+0000","last_undegraded":"2024-04-01T16:34:38.049939+0000","last_fullsized":"2024-04-01T16:34:38.049939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050684+0000","last_change":"2024-04-01T16:34:31.567946+0000","last_active":"2024-04-01T16:34:38.050684+0000","last_peered":"2024-04-01T16:34:38.050684+0000","last_clean":"2024-04-01T16:34:38.050684+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T16:34:38.050684+0000","last_undegraded":"2024-04-01T16:34:38.050684+0000","last_fullsized":"2024-04-01T16:34:38.050684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050534+0000","last_change":"2024-04-01T16:34:34.088894+0000","last_active":"2024-04-01T16:34:38.050534+0000","last_peered":"2024-04-01T16:34:38.050534+0000","last_clean":"2024-04-01T16:34:38.050534+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T16:34:38.050534+0000","last_undegraded":"2024-04-01T16:34:38.050534+0000","last_fullsized":"2024-04-01T16:34:38.050534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.629057+0000","last_change":"2024-04-01T16:34:31.566997+0000","last_active":"2024-04-01T16:34:37.629057+0000","last_peered":"2024-04-01T16:34:37.629057+0000","last_clean":"2024-04-01T16:34:37.629057+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T16:34:37.629057+0000","last_undegraded":"2024-04-01T16:34:37.629057+0000","last_fullsized":"2024-04-01T16:34:37.629057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051550+0000","last_change":"2024-04-01T16:34:34.030831+0000","last_active":"2024-04-01T16:34:38.051550+0000","last_peered":"2024-04-01T16:34:38.051550+0000","last_clean":"2024-04-01T16:34:38.051550+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T16:34:38.051550+0000","last_undegraded":"2024-04-01T16:34:38.051550+0000","last_fullsized":"2024-04-01T16:34:38.051550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051716+0000","last_change":"2024-04-01T16:34:31.569927+0000","last_active":"2024-04-01T16:34:38.051716+0000","last_peered":"2024-04-01T16:34:38.051716+0000","last_clean":"2024-04-01T16:34:38.051716+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T16:34:38.051716+0000","last_undegraded":"2024-04-01T16:34:38.051716+0000","last_fullsized":"2024-04-01T16:34:38.051716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:41.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051582+0000","last_change":"2024-04-01T16:34:34.068959+0000","last_active":"2024-04-01T16:34:38.051582+0000","last_peered":"2024-04-01T16:34:38.051582+0000","last_clean":"2024-04-01T16:34:38.051582+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T16:34:38.051582+0000","last_undegraded":"2024-04-01T16:34:38.051582+0000","last_fullsized":"2024-04-01T16:34:38.051582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:58:57.685708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051536+0000","last_change":"2024-04-01T16:34:31.562792+0000","last_active":"2024-04-01T16:34:38.051536+0000","last_peered":"2024-04-01T16:34:38.051536+0000","last_clean":"2024-04-01T16:34:38.051536+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T16:34:38.051536+0000","last_undegraded":"2024-04-01T16:34:38.051536+0000","last_fullsized":"2024-04-01T16:34:38.051536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:55.684911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049858+0000","last_change":"2024-04-01T16:34:33.916652+0000","last_active":"2024-04-01T16:34:38.049858+0000","last_peered":"2024-04-01T16:34:38.049858+0000","last_clean":"2024-04-01T16:34:38.049858+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T16:34:38.049858+0000","last_undegraded":"2024-04-01T16:34:38.049858+0000","last_fullsized":"2024-04-01T16:34:38.049858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628956+0000","last_change":"2024-04-01T16:34:31.531366+0000","last_active":"2024-04-01T16:34:37.628956+0000","last_peered":"2024-04-01T16:34:37.628956+0000","last_clean":"2024-04-01T16:34:37.628956+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T16:34:37.628956+0000","last_undegraded":"2024-04-01T16:34:37.628956+0000","last_fullsized":"2024-04-01T16:34:37.628956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605679+0000","last_change":"2024-04-01T16:34:34.085449+0000","last_active":"2024-04-01T16:34:37.605679+0000","last_peered":"2024-04-01T16:34:37.605679+0000","last_clean":"2024-04-01T16:34:37.605679+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T16:34:37.605679+0000","last_undegraded":"2024-04-01T16:34:37.605679+0000","last_fullsized":"2024-04-01T16:34:37.605679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049801+0000","last_change":"2024-04-01T16:34:31.444458+0000","last_active":"2024-04-01T16:34:38.049801+0000","last_peered":"2024-04-01T16:34:38.049801+0000","last_clean":"2024-04-01T16:34:38.049801+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T16:34:38.049801+0000","last_undegraded":"2024-04-01T16:34:38.049801+0000","last_fullsized":"2024-04-01T16:34:38.049801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050237+0000","last_change":"2024-04-01T16:34:34.071521+0000","last_active":"2024-04-01T16:34:38.050237+0000","last_peered":"2024-04-01T16:34:38.050237+0000","last_clean":"2024-04-01T16:34:38.050237+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T16:34:38.050237+0000","last_undegraded":"2024-04-01T16:34:38.050237+0000","last_fullsized":"2024-04-01T16:34:38.050237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:36:13.618956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051171+0000","last_change":"2024-04-01T16:34:31.566202+0000","last_active":"2024-04-01T16:34:38.051171+0000","last_peered":"2024-04-01T16:34:38.051171+0000","last_clean":"2024-04-01T16:34:38.051171+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T16:34:38.051171+0000","last_undegraded":"2024-04-01T16:34:38.051171+0000","last_fullsized":"2024-04-01T16:34:38.051171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:54.543283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605625+0000","last_change":"2024-04-01T16:34:33.930561+0000","last_active":"2024-04-01T16:34:37.605625+0000","last_peered":"2024-04-01T16:34:37.605625+0000","last_clean":"2024-04-01T16:34:37.605625+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T16:34:37.605625+0000","last_undegraded":"2024-04-01T16:34:37.605625+0000","last_fullsized":"2024-04-01T16:34:37.605625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628146+0000","last_change":"2024-04-01T16:34:31.535895+0000","last_active":"2024-04-01T16:34:37.628146+0000","last_peered":"2024-04-01T16:34:37.628146+0000","last_clean":"2024-04-01T16:34:37.628146+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T16:34:37.628146+0000","last_undegraded":"2024-04-01T16:34:37.628146+0000","last_fullsized":"2024-04-01T16:34:37.628146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:36:43.780845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628027+0000","last_change":"2024-04-01T16:34:34.068194+0000","last_active":"2024-04-01T16:34:37.628027+0000","last_peered":"2024-04-01T16:34:37.628027+0000","last_clean":"2024-04-01T16:34:37.628027+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T16:34:37.628027+0000","last_undegraded":"2024-04-01T16:34:37.628027+0000","last_fullsized":"2024-04-01T16:34:37.628027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591561+0000","last_change":"2024-04-01T16:34:31.515495+0000","last_active":"2024-04-01T16:34:37.591561+0000","last_peered":"2024-04-01T16:34:37.591561+0000","last_clean":"2024-04-01T16:34:37.591561+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T16:34:37.591561+0000","last_undegraded":"2024-04-01T16:34:37.591561+0000","last_fullsized":"2024-04-01T16:34:37.591561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:26:56.217819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.604988+0000","last_change":"2024-04-01T16:34:33.926318+0000","last_active":"2024-04-01T16:34:37.604988+0000","last_peered":"2024-04-01T16:34:37.604988+0000","last_clean":"2024-04-01T16:34:37.604988+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T16:34:37.604988+0000","last_undegraded":"2024-04-01T16:34:37.604988+0000","last_fullsized":"2024-04-01T16:34:37.604988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049886+0000","last_change":"2024-04-01T16:34:31.440349+0000","last_active":"2024-04-01T16:34:38.049886+0000","last_peered":"2024-04-01T16:34:38.049886+0000","last_clean":"2024-04-01T16:34:38.049886+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T16:34:38.049886+0000","last_undegraded":"2024-04-01T16:34:38.049886+0000","last_fullsized":"2024-04-01T16:34:38.049886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:29.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606304+0000","last_change":"2024-04-01T16:34:33.931211+0000","last_active":"2024-04-01T16:34:37.606304+0000","last_peered":"2024-04-01T16:34:37.606304+0000","last_clean":"2024-04-01T16:34:37.606304+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T16:34:37.606304+0000","last_undegraded":"2024-04-01T16:34:37.606304+0000","last_fullsized":"2024-04-01T16:34:37.606304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:15:45.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591811+0000","last_change":"2024-04-01T16:34:31.512433+0000","last_active":"2024-04-01T16:34:37.591811+0000","last_peered":"2024-04-01T16:34:37.591811+0000","last_clean":"2024-04-01T16:34:37.591811+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T16:34:37.591811+0000","last_undegraded":"2024-04-01T16:34:37.591811+0000","last_fullsized":"2024-04-01T16:34:37.591811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:16.032012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606826+0000","last_change":"2024-04-01T16:34:33.930791+0000","last_active":"2024-04-01T16:34:37.606826+0000","last_peered":"2024-04-01T16:34:37.606826+0000","last_clean":"2024-04-01T16:34:37.606826+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T16:34:37.606826+0000","last_undegraded":"2024-04-01T16:34:37.606826+0000","last_fullsized":"2024-04-01T16:34:37.606826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:53.102054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051625+0000","last_change":"2024-04-01T16:34:31.509375+0000","last_active":"2024-04-01T16:34:38.051625+0000","last_peered":"2024-04-01T16:34:38.051625+0000","last_clean":"2024-04-01T16:34:38.051625+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T16:34:38.051625+0000","last_undegraded":"2024-04-01T16:34:38.051625+0000","last_fullsized":"2024-04-01T16:34:38.051625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051112+0000","last_change":"2024-04-01T16:34:34.085219+0000","last_active":"2024-04-01T16:34:38.051112+0000","last_peered":"2024-04-01T16:34:38.051112+0000","last_clean":"2024-04-01T16:34:38.051112+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T16:34:38.051112+0000","last_undegraded":"2024-04-01T16:34:38.051112+0000","last_fullsized":"2024-04-01T16:34:38.051112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591620+0000","last_change":"2024-04-01T16:34:31.562761+0000","last_active":"2024-04-01T16:34:37.591620+0000","last_peered":"2024-04-01T16:34:37.591620+0000","last_clean":"2024-04-01T16:34:37.591620+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T16:34:37.591620+0000","last_undegraded":"2024-04-01T16:34:37.591620+0000","last_fullsized":"2024-04-01T16:34:37.591620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:23:33.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605752+0000","last_change":"2024-04-01T16:34:34.039521+0000","last_active":"2024-04-01T16:34:37.605752+0000","last_peered":"2024-04-01T16:34:37.605752+0000","last_clean":"2024-04-01T16:34:37.605752+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T16:34:37.605752+0000","last_undegraded":"2024-04-01T16:34:37.605752+0000","last_fullsized":"2024-04-01T16:34:37.605752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605216+0000","last_change":"2024-04-01T16:34:08.195697+0000","last_active":"2024-04-01T16:34:37.605216+0000","last_peered":"2024-04-01T16:34:37.605216+0000","last_clean":"2024-04-01T16:34:37.605216+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T16:34:37.605216+0000","last_undegraded":"2024-04-01T16:34:37.605216+0000","last_fullsized":"2024-04-01T16:34:37.605216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_clean_scrub_stamp":"2024-04-01T16:34:06.247737+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:05:51.067541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050610+0000","last_change":"2024-04-01T16:34:31.569697+0000","last_active":"2024-04-01T16:34:38.050610+0000","last_peered":"2024-04-01T16:34:38.050610+0000","last_clean":"2024-04-01T16:34:38.050610+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T16:34:38.050610+0000","last_undegraded":"2024-04-01T16:34:38.050610+0000","last_fullsized":"2024-04-01T16:34:38.050610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.736852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050625+0000","last_change":"2024-04-01T16:34:34.087298+0000","last_active":"2024-04-01T16:34:38.050625+0000","last_peered":"2024-04-01T16:34:38.050625+0000","last_clean":"2024-04-01T16:34:38.050625+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T16:34:38.050625+0000","last_undegraded":"2024-04-01T16:34:38.050625+0000","last_fullsized":"2024-04-01T16:34:38.050625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.604893+0000","last_change":"2024-04-01T16:34:31.509150+0000","last_active":"2024-04-01T16:34:37.604893+0000","last_peered":"2024-04-01T16:34:37.604893+0000","last_clean":"2024-04-01T16:34:37.604893+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T16:34:37.604893+0000","last_undegraded":"2024-04-01T16:34:37.604893+0000","last_fullsized":"2024-04-01T16:34:37.604893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049380+0000","last_change":"2024-04-01T16:34:34.068444+0000","last_active":"2024-04-01T16:34:38.049380+0000","last_peered":"2024-04-01T16:34:38.049380+0000","last_clean":"2024-04-01T16:34:38.049380+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T16:34:38.049380+0000","last_undegraded":"2024-04-01T16:34:38.049380+0000","last_fullsized":"2024-04-01T16:34:38.049380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:04.104676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591825+0000","last_change":"2024-04-01T16:34:31.512295+0000","last_active":"2024-04-01T16:34:37.591825+0000","last_peered":"2024-04-01T16:34:37.591825+0000","last_clean":"2024-04-01T16:34:37.591825+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T16:34:37.591825+0000","last_undegraded":"2024-04-01T16:34:37.591825+0000","last_fullsized":"2024-04-01T16:34:37.591825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:35.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049896+0000","last_change":"2024-04-01T16:34:34.083194+0000","last_active":"2024-04-01T16:34:38.049896+0000","last_peered":"2024-04-01T16:34:38.049896+0000","last_clean":"2024-04-01T16:34:38.049896+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T16:34:38.049896+0000","last_undegraded":"2024-04-01T16:34:38.049896+0000","last_fullsized":"2024-04-01T16:34:38.049896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051266+0000","last_change":"2024-04-01T16:34:31.569571+0000","last_active":"2024-04-01T16:34:38.051266+0000","last_peered":"2024-04-01T16:34:38.051266+0000","last_clean":"2024-04-01T16:34:38.051266+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T16:34:38.051266+0000","last_undegraded":"2024-04-01T16:34:38.051266+0000","last_fullsized":"2024-04-01T16:34:38.051266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:10.626933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049506+0000","last_change":"2024-04-01T16:34:34.063200+0000","last_active":"2024-04-01T16:34:38.049506+0000","last_peered":"2024-04-01T16:34:38.049506+0000","last_clean":"2024-04-01T16:34:38.049506+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T16:34:38.049506+0000","last_undegraded":"2024-04-01T16:34:38.049506+0000","last_fullsized":"2024-04-01T16:34:38.049506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:18.399835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051349+0000","last_change":"2024-04-01T16:34:31.512508+0000","last_active":"2024-04-01T16:34:38.051349+0000","last_peered":"2024-04-01T16:34:38.051349+0000","last_clean":"2024-04-01T16:34:38.051349+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T16:34:38.051349+0000","last_undegraded":"2024-04-01T16:34:38.051349+0000","last_fullsized":"2024-04-01T16:34:38.051349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050992+0000","last_change":"2024-04-01T16:34:34.084970+0000","last_active":"2024-04-01T16:34:38.050992+0000","last_peered":"2024-04-01T16:34:38.050992+0000","last_clean":"2024-04-01T16:34:38.050992+0000","last_became_active":"2024-04-01T16:34:34.084105+0000","last_became_peered":"2024-04-01T16:34:34.084105+0000","last_unstale":"2024-04-01T16:34:38.050992+0000","last_undegraded":"2024-04-01T16:34:38.050992+0000","last_fullsized":"2024-04-01T16:34:38.050992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606520+0000","last_change":"2024-04-01T16:34:31.426647+0000","last_active":"2024-04-01T16:34:37.606520+0000","last_peered":"2024-04-01T16:34:37.606520+0000","last_clean":"2024-04-01T16:34:37.606520+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T16:34:37.606520+0000","last_undegraded":"2024-04-01T16:34:37.606520+0000","last_fullsized":"2024-04-01T16:34:37.606520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:36.926701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051160+0000","last_change":"2024-04-01T16:34:34.087431+0000","last_active":"2024-04-01T16:34:38.051160+0000","last_peered":"2024-04-01T16:34:38.051160+0000","last_clean":"2024-04-01T16:34:38.051160+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T16:34:38.051160+0000","last_undegraded":"2024-04-01T16:34:38.051160+0000","last_fullsized":"2024-04-01T16:34:38.051160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.052029+0000","last_change":"2024-04-01T16:34:31.528790+0000","last_active":"2024-04-01T16:34:38.052029+0000","last_peered":"2024-04-01T16:34:38.052029+0000","last_clean":"2024-04-01T16:34:38.052029+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T16:34:38.052029+0000","last_undegraded":"2024-04-01T16:34:38.052029+0000","last_fullsized":"2024-04-01T16:34:38.052029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.052152+0000","last_change":"2024-04-01T16:34:34.085832+0000","last_active":"2024-04-01T16:34:38.052152+0000","last_peered":"2024-04-01T16:34:38.052152+0000","last_clean":"2024-04-01T16:34:38.052152+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T16:34:38.052152+0000","last_undegraded":"2024-04-01T16:34:38.052152+0000","last_fullsized":"2024-04-01T16:34:38.052152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.629267+0000","last_change":"2024-04-01T16:34:31.534057+0000","last_active":"2024-04-01T16:34:37.629267+0000","last_peered":"2024-04-01T16:34:37.629267+0000","last_clean":"2024-04-01T16:34:37.629267+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T16:34:37.629267+0000","last_undegraded":"2024-04-01T16:34:37.629267+0000","last_fullsized":"2024-04-01T16:34:37.629267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050929+0000","last_change":"2024-04-01T16:34:34.073261+0000","last_active":"2024-04-01T16:34:38.050929+0000","last_peered":"2024-04-01T16:34:38.050929+0000","last_clean":"2024-04-01T16:34:38.050929+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T16:34:38.050929+0000","last_undegraded":"2024-04-01T16:34:38.050929+0000","last_fullsized":"2024-04-01T16:34:38.050929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:38.619969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.604865+0000","last_change":"2024-04-01T16:34:31.423531+0000","last_active":"2024-04-01T16:34:37.604865+0000","last_peered":"2024-04-01T16:34:37.604865+0000","last_clean":"2024-04-01T16:34:37.604865+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T16:34:37.604865+0000","last_undegraded":"2024-04-01T16:34:37.604865+0000","last_fullsized":"2024-04-01T16:34:37.604865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049008+0000","last_change":"2024-04-01T16:34:34.086029+0000","last_active":"2024-04-01T16:34:38.049008+0000","last_peered":"2024-04-01T16:34:38.049008+0000","last_clean":"2024-04-01T16:34:38.049008+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T16:34:38.049008+0000","last_undegraded":"2024-04-01T16:34:38.049008+0000","last_fullsized":"2024-04-01T16:34:38.049008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051032+0000","last_change":"2024-04-01T16:34:31.509351+0000","last_active":"2024-04-01T16:34:38.051032+0000","last_peered":"2024-04-01T16:34:38.051032+0000","last_clean":"2024-04-01T16:34:38.051032+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T16:34:38.051032+0000","last_undegraded":"2024-04-01T16:34:38.051032+0000","last_fullsized":"2024-04-01T16:34:38.051032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050038+0000","last_change":"2024-04-01T16:34:34.091932+0000","last_active":"2024-04-01T16:34:38.050038+0000","last_peered":"2024-04-01T16:34:38.050038+0000","last_clean":"2024-04-01T16:34:38.050038+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T16:34:38.050038+0000","last_undegraded":"2024-04-01T16:34:38.050038+0000","last_fullsized":"2024-04-01T16:34:38.050038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:11:00.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050388+0000","last_change":"2024-04-01T16:34:31.517513+0000","last_active":"2024-04-01T16:34:38.050388+0000","last_peered":"2024-04-01T16:34:38.050388+0000","last_clean":"2024-04-01T16:34:38.050388+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T16:34:38.050388+0000","last_undegraded":"2024-04-01T16:34:38.050388+0000","last_fullsized":"2024-04-01T16:34:38.050388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:31.608594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051289+0000","last_change":"2024-04-01T16:34:34.092277+0000","last_active":"2024-04-01T16:34:38.051289+0000","last_peered":"2024-04-01T16:34:38.051289+0000","last_clean":"2024-04-01T16:34:38.051289+0000","last_became_active":"2024-04-01T16:34:34.091006+0000","last_became_peered":"2024-04-01T16:34:34.091006+0000","last_unstale":"2024-04-01T16:34:38.051289+0000","last_undegraded":"2024-04-01T16:34:38.051289+0000","last_fullsized":"2024-04-01T16:34:38.051289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:38:43.513904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605898+0000","last_change":"2024-04-01T16:34:31.444603+0000","last_active":"2024-04-01T16:34:37.605898+0000","last_peered":"2024-04-01T16:34:37.605898+0000","last_clean":"2024-04-01T16:34:37.605898+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T16:34:37.605898+0000","last_undegraded":"2024-04-01T16:34:37.605898+0000","last_fullsized":"2024-04-01T16:34:37.605898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.628416+0000","last_change":"2024-04-01T16:34:34.034061+0000","last_active":"2024-04-01T16:34:37.628416+0000","last_peered":"2024-04-01T16:34:37.628416+0000","last_clean":"2024-04-01T16:34:37.628416+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T16:34:37.628416+0000","last_undegraded":"2024-04-01T16:34:37.628416+0000","last_fullsized":"2024-04-01T16:34:37.628416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051135+0000","last_change":"2024-04-01T16:34:34.035919+0000","last_active":"2024-04-01T16:34:38.051135+0000","last_peered":"2024-04-01T16:34:38.051135+0000","last_clean":"2024-04-01T16:34:38.051135+0000","last_became_active":"2024-04-01T16:34:34.035634+0000","last_became_peered":"2024-04-01T16:34:34.035634+0000","last_unstale":"2024-04-01T16:34:38.051135+0000","last_undegraded":"2024-04-01T16:34:38.051135+0000","last_fullsized":"2024-04-01T16:34:38.051135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:24:57.379837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605565+0000","last_change":"2024-04-01T16:34:31.563882+0000","last_active":"2024-04-01T16:34:37.605565+0000","last_peered":"2024-04-01T16:34:37.605565+0000","last_clean":"2024-04-01T16:34:37.605565+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T16:34:37.605565+0000","last_undegraded":"2024-04-01T16:34:37.605565+0000","last_fullsized":"2024-04-01T16:34:37.605565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:27.209535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050852+0000","last_change":"2024-04-01T16:34:34.034904+0000","last_active":"2024-04-01T16:34:38.050852+0000","last_peered":"2024-04-01T16:34:38.050852+0000","last_clean":"2024-04-01T16:34:38.050852+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T16:34:38.050852+0000","last_undegraded":"2024-04-01T16:34:38.050852+0000","last_fullsized":"2024-04-01T16:34:38.050852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606192+0000","last_change":"2024-04-01T16:34:31.530246+0000","last_active":"2024-04-01T16:34:37.606192+0000","last_peered":"2024-04-01T16:34:37.606192+0000","last_clean":"2024-04-01T16:34:37.606192+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T16:34:37.606192+0000","last_undegraded":"2024-04-01T16:34:37.606192+0000","last_fullsized":"2024-04-01T16:34:37.606192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:48.430325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051354+0000","last_change":"2024-04-01T16:34:34.066381+0000","last_active":"2024-04-01T16:34:38.051354+0000","last_peered":"2024-04-01T16:34:38.051354+0000","last_clean":"2024-04-01T16:34:38.051354+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T16:34:38.051354+0000","last_undegraded":"2024-04-01T16:34:38.051354+0000","last_fullsized":"2024-04-01T16:34:38.051354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:10.824493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051915+0000","last_change":"2024-04-01T16:34:31.490535+0000","last_active":"2024-04-01T16:34:38.051915+0000","last_peered":"2024-04-01T16:34:38.051915+0000","last_clean":"2024-04-01T16:34:38.051915+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T16:34:38.051915+0000","last_undegraded":"2024-04-01T16:34:38.051915+0000","last_fullsized":"2024-04-01T16:34:38.051915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:24.709969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051724+0000","last_change":"2024-04-01T16:34:34.087097+0000","last_active":"2024-04-01T16:34:38.051724+0000","last_peered":"2024-04-01T16:34:38.051724+0000","last_clean":"2024-04-01T16:34:38.051724+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T16:34:38.051724+0000","last_undegraded":"2024-04-01T16:34:38.051724+0000","last_fullsized":"2024-04-01T16:34:38.051724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:17:48.287828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"24'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.052000+0000","last_change":"2024-04-01T16:34:31.420599+0000","last_active":"2024-04-01T16:34:38.052000+0000","last_peered":"2024-04-01T16:34:38.052000+0000","last_clean":"2024-04-01T16:34:38.052000+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T16:34:38.052000+0000","last_undegraded":"2024-04-01T16:34:38.052000+0000","last_fullsized":"2024-04-01T16:34:38.052000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":685650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":94700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":685706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":94790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":94826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":96312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":96312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":94860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T16:34:46.620 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-01T16:34:46.621 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-01T16:34:46.621 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-01T16:34:46.621 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-01T16:34:46.621 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-01T16:34:46.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.868+0000 7f0e9f000640 1 Processor -- start 2024-04-01T16:34:46.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.868+0000 7f0e9f000640 1 -- start start 2024-04-01T16:34:46.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.870+0000 7f0e9f000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0e98151700 0x7f0e9815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:46.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.870+0000 7f0e9f000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e9815b040 con 0x7f0e98070100 2024-04-01T16:34:46.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.870+0000 7f0e9f000640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e9815b320 con 0x7f0e980c8160 2024-04-01T16:34:46.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.870+0000 7f0e9f000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f0e980c3060 con 0x7f0e98151700 2024-04-01T16:34:46.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.871+0000 7f0e97e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0e98151700 0x7f0e9815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:46.871 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.871+0000 7f0e97e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0e98151700 0x7f0e9815aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48044/0 (socket says 172.21.15.163:48044) 2024-04-01T16:34:46.871 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.871+0000 7f0e97e00640 1 -- 172.21.15.163:0/2560526749 learned_addr learned my addr 172.21.15.163:0/2560526749 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:46.875 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.875+0000 7f0e97e00640 1 -- 172.21.15.163:0/2560526749 >> v1:172.21.15.189:6789/0 conn(0x7f0e980c8160 legacy=0x7f0e980c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:46.875 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.875+0000 7f0e97e00640 1 -- 172.21.15.163:0/2560526749 >> v1:172.21.15.163:6789/0 conn(0x7f0e98070100 legacy=0x7f0e980c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:46.875 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.875+0000 7f0e97e00640 1 -- 172.21.15.163:0/2560526749 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9815b600 con 0x7f0e98151700 2024-04-01T16:34:46.878 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.879+0000 7f0e97e00640 1 --2- 172.21.15.163:0/2560526749 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98151700 0x7f0e9815aa00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009870 tx=0x7f0e8402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641484cf6de5ffbc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:46.883 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.883+0000 7f0e96a00640 1 -- 172.21.15.163:0/2560526749 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84034070 con 0x7f0e98151700 2024-04-01T16:34:46.883 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.883+0000 7f0e96a00640 1 -- 172.21.15.163:0/2560526749 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e84030860 con 0x7f0e98151700 2024-04-01T16:34:46.883 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.883+0000 7f0e96a00640 1 -- 172.21.15.163:0/2560526749 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84030c30 con 0x7f0e98151700 2024-04-01T16:34:46.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.884+0000 7f0e9f000640 1 -- 172.21.15.163:0/2560526749 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98151700 msgr2=0x7f0e9815aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:46.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.884+0000 7f0e9f000640 1 --2- 172.21.15.163:0/2560526749 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98151700 0x7f0e9815aa00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009870 tx=0x7f0e8402b9a0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.884+0000 7f0e9f000640 1 -- 172.21.15.163:0/2560526749 shutdown_connections 2024-04-01T16:34:46.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.884+0000 7f0e9f000640 1 --2- 172.21.15.163:0/2560526749 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98151700 0x7f0e9815aa00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.884+0000 7f0e9f000640 1 -- 172.21.15.163:0/2560526749 >> 172.21.15.163:0/2560526749 conn(0x7f0e980cbe20 msgr2=0x7f0e980cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:46.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.884+0000 7f0e9f000640 1 -- 172.21.15.163:0/2560526749 shutdown_connections 2024-04-01T16:34:46.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.885+0000 7f0e9f000640 1 -- 172.21.15.163:0/2560526749 wait complete. 2024-04-01T16:34:46.886 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.886+0000 7f0e9f000640 1 Processor -- start 2024-04-01T16:34:46.886 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.887+0000 7f0e9f000640 1 -- start start 2024-04-01T16:34:46.887 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.887+0000 7f0e9f000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e98070100 0x7f0e9814ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:46.887 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.887+0000 7f0e9f000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e980c8160 0x7f0e9814f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:46.887 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.887+0000 7f0e9f000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e981f52c0 0x7f0e98149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:46.887 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.887+0000 7f0e9f000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0e980c7390 con 0x7f0e980c8160 2024-04-01T16:34:46.887 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.887+0000 7f0e9f000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9815b8e0 con 0x7f0e981f52c0 2024-04-01T16:34:46.887 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.887+0000 7f0e9f000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0e98151ae0 con 0x7f0e98070100 2024-04-01T16:34:46.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.888+0000 7f0e97400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e980c8160 0x7f0e9814f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:46.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.889+0000 7f0e97400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e980c8160 0x7f0e9814f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48052/0 (socket says 172.21.15.163:48052) 2024-04-01T16:34:46.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.889+0000 7f0e97400640 1 -- 172.21.15.163:0/3411645994 learned_addr learned my addr 172.21.15.163:0/3411645994 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:46.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.889+0000 7f0e9d000640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e981f52c0 0x7f0e98149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:46.889 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.889+0000 7f0e97e00640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e98070100 0x7f0e9814ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:46.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.892+0000 7f0e97400640 1 -- 172.21.15.163:0/3411645994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e98070100 msgr2=0x7f0e9814ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:46.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.892+0000 7f0e97400640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e98070100 0x7f0e9814ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.892+0000 7f0e97400640 1 -- 172.21.15.163:0/3411645994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e981f52c0 msgr2=0x7f0e98149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:46.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.892+0000 7f0e97400640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e981f52c0 0x7f0e98149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:46.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.892+0000 7f0e97400640 1 -- 172.21.15.163:0/3411645994 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e980b1a30 con 0x7f0e980c8160 2024-04-01T16:34:46.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.895+0000 7f0e97400640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e980c8160 0x7f0e9814f7e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800b3f0 tx=0x7f0e8800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:46.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.899+0000 7f0e8fe00640 1 -- 172.21.15.163:0/3411645994 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88015020 con 0x7f0e980c8160 2024-04-01T16:34:46.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.899+0000 7f0e8fe00640 1 -- 172.21.15.163:0/3411645994 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88011830 con 0x7f0e980c8160 2024-04-01T16:34:46.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.899+0000 7f0e8fe00640 1 -- 172.21.15.163:0/3411645994 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88011c20 con 0x7f0e980c8160 2024-04-01T16:34:46.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.900+0000 7f0e9f000640 1 -- 172.21.15.163:0/3411645994 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9814ac10 con 0x7f0e980c8160 2024-04-01T16:34:46.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.900+0000 7f0e9f000640 1 -- 172.21.15.163:0/3411645994 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e981f47e0 con 0x7f0e980c8160 2024-04-01T16:34:46.900 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.901+0000 7f0e9f000640 1 -- 172.21.15.163:0/3411645994 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e980cb040 con 0x7f0e980c8160 2024-04-01T16:34:46.922 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.923+0000 7f0e8fe00640 1 -- 172.21.15.163:0/3411645994 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e88018020 con 0x7f0e980c8160 2024-04-01T16:34:46.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.924+0000 7f0e8fe00640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0e7806c970 0x7f0e7806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:46.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.925+0000 7f0e97e00640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0e7806c970 0x7f0e7806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:46.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.926+0000 7f0e97e00640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0e7806c970 0x7f0e7806ee30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e84036000 tx=0x7f0e84008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:46.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:46.926+0000 7f0e8fe00640 1 -- 172.21.15.163:0/3411645994 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f0e880579b0 con 0x7f0e980c8160 2024-04-01T16:34:47.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.211+0000 7f0e8fe00640 1 -- 172.21.15.163:0/3411645994 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0e980cb040 con 0x7f0e980c8160 2024-04-01T16:34:47.477 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.477+0000 7f0e9f000640 1 -- 172.21.15.163:0/3411645994 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0e980c8670 con 0x7f0e980c8160 2024-04-01T16:34:47.700 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.701+0000 7f0e8fe00640 1 -- 172.21.15.163:0/3411645994 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174141 (secure 0 0 0) 0x7f0e980c8670 con 0x7f0e980c8160 2024-04-01T16:34:47.703 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:47.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.706+0000 7f0e9f000640 1 -- 172.21.15.163:0/3411645994 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0e7806c970 msgr2=0x7f0e7806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:47.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.706+0000 7f0e9f000640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0e7806c970 0x7f0e7806ee30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e84036000 tx=0x7f0e84008030 comp rx=0 tx=0).stop 2024-04-01T16:34:47.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.706+0000 7f0e9f000640 1 -- 172.21.15.163:0/3411645994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e980c8160 msgr2=0x7f0e9814f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:47.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.706+0000 7f0e9f000640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e980c8160 0x7f0e9814f7e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800b3f0 tx=0x7f0e8800b8b0 comp rx=0 tx=0).stop 2024-04-01T16:34:47.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.706+0000 7f0e9f000640 1 -- 172.21.15.163:0/3411645994 shutdown_connections 2024-04-01T16:34:47.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.706+0000 7f0e9f000640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0e7806c970 0x7f0e7806ee30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:47.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.706+0000 7f0e9f000640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e981f52c0 0x7f0e98149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:47.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.706+0000 7f0e9f000640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e980c8160 0x7f0e9814f7e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:47.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.706+0000 7f0e9f000640 1 --2- 172.21.15.163:0/3411645994 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0e98070100 0x7f0e9814ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:47.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.706+0000 7f0e9f000640 1 -- 172.21.15.163:0/3411645994 >> 172.21.15.163:0/3411645994 conn(0x7f0e980cbe20 msgr2=0x7f0e9815a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:47.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.706+0000 7f0e9f000640 1 -- 172.21.15.163:0/3411645994 shutdown_connections 2024-04-01T16:34:47.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.706+0000 7f0e9f000640 1 -- 172.21.15.163:0/3411645994 wait complete. 2024-04-01T16:34:47.724 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":4133086793},{"type":"v1","addr":"172.21.15.163:6801","nonce":4133086793}]},"active_addr":"172.21.15.163:6801/4133086793","active_change":"2024-04-01T16:33:49.147647+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":665054564}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":3190171208}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":694648343}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":407239937}]}]} 2024-04-01T16:34:47.727 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-01T16:34:47.727 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-01T16:34:47.728 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T16:34:47.927 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.927+0000 7f2cd8a00640 1 Processor -- start 2024-04-01T16:34:47.927 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.927+0000 7f2cd8a00640 1 -- start start 2024-04-01T16:34:47.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.928+0000 7f2cd8a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2cd4070100 0x7f2cd415aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:47.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.928+0000 7f2cd8a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cd415b040 con 0x7f2cd4151700 2024-04-01T16:34:47.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.928+0000 7f2cd8a00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cd415b320 con 0x7f2cd40c8160 2024-04-01T16:34:47.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.928+0000 7f2cd8a00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f2cd40c3060 con 0x7f2cd4070100 2024-04-01T16:34:47.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.929+0000 7f2cd1e00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f2cd4151700 0x7f2cd40c7820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50174/0 (socket says 172.21.15.163:50174) 2024-04-01T16:34:47.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.929+0000 7f2cd1e00640 1 -- 172.21.15.163:0/4205785388 learned_addr learned my addr 172.21.15.163:0/4205785388 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:47.931 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.931+0000 7f2cd1400640 1 --2- 172.21.15.163:0/4205785388 >> v2:172.21.15.189:3300/0 conn(0x7f2cd4070100 0x7f2cd415aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:47.933 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.932+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708560780 0 0) 0x7f2cd415b040 con 0x7f2cd4151700 2024-04-01T16:34:47.933 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.933+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb8003520 con 0x7f2cd4151700 2024-04-01T16:34:47.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1858899419 0 0) 0x7f2cb8003520 con 0x7f2cd4151700 2024-04-01T16:34:47.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 >> v2:172.21.15.189:3300/0 conn(0x7f2cd4070100 msgr2=0x7f2cd415aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:47.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 --2- 172.21.15.163:0/4205785388 >> v2:172.21.15.189:3300/0 conn(0x7f2cd4070100 0x7f2cd415aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:47.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 >> v1:172.21.15.189:6789/0 conn(0x7f2cd40c8160 legacy=0x7f2cd40c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:47.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd415b600 con 0x7f2cd4151700 2024-04-01T16:34:47.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7f2cc4001670 con 0x7f2cd4151700 2024-04-01T16:34:47.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 >> v1:172.21.15.163:6789/0 conn(0x7f2cd4151700 legacy=0x7f2cd40c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:47.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 --2- 172.21.15.163:0/4205785388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb8003a00 0x7f2cb8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:47.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 --2- 172.21.15.163:0/4205785388 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cb8004800 0x7f2cb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:47.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 --2- 172.21.15.163:0/4205785388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cb80051c0 0x7f2cb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:47.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb800c090 con 0x7f2cb8004800 2024-04-01T16:34:47.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb800c240 con 0x7f2cb8003a00 2024-04-01T16:34:47.939 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.937+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb800c440 con 0x7f2cb80051c0 2024-04-01T16:34:47.939 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.939+0000 7f2cd2800640 1 --2- 172.21.15.163:0/4205785388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cb80051c0 0x7f2cb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:47.942 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.942+0000 7f2cd1400640 1 --2- 172.21.15.163:0/4205785388 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cb8004800 0x7f2cb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:47.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.947+0000 7f2cd2800640 1 -- 172.21.15.163:0/4205785388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb8003a00 msgr2=0x7f2cb8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:47.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.947+0000 7f2cd2800640 1 --2- 172.21.15.163:0/4205785388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb8003a00 0x7f2cb8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:47.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.947+0000 7f2cd2800640 1 -- 172.21.15.163:0/4205785388 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cb8004800 msgr2=0x7f2cb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:47.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.947+0000 7f2cd2800640 1 --2- 172.21.15.163:0/4205785388 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cb8004800 0x7f2cb8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:47.948 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.947+0000 7f2cd2800640 1 -- 172.21.15.163:0/4205785388 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb8003520 con 0x7f2cb80051c0 2024-04-01T16:34:47.948 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.948+0000 7f2cd2800640 1 -- 172.21.15.163:0/4205785388 reap_dead start 2024-04-01T16:34:47.953 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.953+0000 7f2cd2800640 1 --2- 172.21.15.163:0/4205785388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cb80051c0 0x7f2cb800b9c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc001e50 tx=0x7f2cb8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b531a0ffc5be510d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:47.965 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.965+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc033070 con 0x7f2cb80051c0 2024-04-01T16:34:47.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.965+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ccc003b90 con 0x7f2cb80051c0 2024-04-01T16:34:47.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.965+0000 7f2cd0a00640 1 -- 172.21.15.163:0/4205785388 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc001a70 con 0x7f2cb80051c0 2024-04-01T16:34:47.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.966+0000 7f2cd8a00640 1 -- 172.21.15.163:0/4205785388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cb80051c0 msgr2=0x7f2cb800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:47.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.966+0000 7f2cd8a00640 1 --2- 172.21.15.163:0/4205785388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cb80051c0 0x7f2cb800b9c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc001e50 tx=0x7f2cb8005830 comp rx=0 tx=0).stop 2024-04-01T16:34:47.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.966+0000 7f2cd8a00640 1 -- 172.21.15.163:0/4205785388 shutdown_connections 2024-04-01T16:34:47.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.966+0000 7f2cd8a00640 1 --2- 172.21.15.163:0/4205785388 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cb80051c0 0x7f2cb800b9c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:47.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.966+0000 7f2cd8a00640 1 -- 172.21.15.163:0/4205785388 >> 172.21.15.163:0/4205785388 conn(0x7f2cd40cbe20 msgr2=0x7f2cd40cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:47.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.966+0000 7f2cd8a00640 1 -- 172.21.15.163:0/4205785388 shutdown_connections 2024-04-01T16:34:47.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.967+0000 7f2cd8a00640 1 -- 172.21.15.163:0/4205785388 wait complete. 2024-04-01T16:34:47.969 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.969+0000 7f2cd8a00640 1 Processor -- start 2024-04-01T16:34:47.969 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.969+0000 7f2cd8a00640 1 -- start start 2024-04-01T16:34:47.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.970+0000 7f2cd8a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb80051c0 0x7f2cd40ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:47.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.970+0000 7f2cd8a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cd40c3810 0x7f2cd41f0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:47.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.970+0000 7f2cd8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd4159aa0 0x7f2cd4144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:47.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.970+0000 7f2cd8a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd40c7390 con 0x7f2cd4159aa0 2024-04-01T16:34:47.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.970+0000 7f2cd8a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd415b8e0 con 0x7f2cb80051c0 2024-04-01T16:34:47.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.970+0000 7f2cd8a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd4151ae0 con 0x7f2cd40c3810 2024-04-01T16:34:47.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.971+0000 7f2cd2800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd4159aa0 0x7f2cd4144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:47.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.971+0000 7f2cd2800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd4159aa0 0x7f2cd4144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48064/0 (socket says 172.21.15.163:48064) 2024-04-01T16:34:47.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.971+0000 7f2cd2800640 1 -- 172.21.15.163:0/1919132227 learned_addr learned my addr 172.21.15.163:0/1919132227 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:47.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.972+0000 7f2cd1e00640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb80051c0 0x7f2cd40ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:47.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.972+0000 7f2cd1400640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cd40c3810 0x7f2cd41f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:47.976 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.976+0000 7f2cd2800640 1 -- 172.21.15.163:0/1919132227 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cd40c3810 msgr2=0x7f2cd41f0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:47.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.976+0000 7f2cd2800640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cd40c3810 0x7f2cd41f0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:47.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.976+0000 7f2cd2800640 1 -- 172.21.15.163:0/1919132227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb80051c0 msgr2=0x7f2cd40ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:47.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.976+0000 7f2cd2800640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb80051c0 0x7f2cd40ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:47.977 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.976+0000 7f2cd2800640 1 -- 172.21.15.163:0/1919132227 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd40c44e0 con 0x7f2cd4159aa0 2024-04-01T16:34:47.979 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.979+0000 7f2cd2800640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd4159aa0 0x7f2cd4144670 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc001f70 tx=0x7f2ccc0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:47.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.984+0000 7f2cca000640 1 -- 172.21.15.163:0/1919132227 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc033070 con 0x7f2cd4159aa0 2024-04-01T16:34:47.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.985+0000 7f2cca000640 1 -- 172.21.15.163:0/1919132227 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ccc005600 con 0x7f2cd4159aa0 2024-04-01T16:34:47.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.985+0000 7f2cca000640 1 -- 172.21.15.163:0/1919132227 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc001a70 con 0x7f2cd4159aa0 2024-04-01T16:34:47.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.985+0000 7f2cd8a00640 1 -- 172.21.15.163:0/1919132227 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd40c5000 con 0x7f2cd4159aa0 2024-04-01T16:34:47.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.985+0000 7f2cd8a00640 1 -- 172.21.15.163:0/1919132227 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd4158580 con 0x7f2cd4159aa0 2024-04-01T16:34:47.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:47.986+0000 7f2cd8a00640 1 -- 172.21.15.163:0/1919132227 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd40756d0 con 0x7f2cd4159aa0 2024-04-01T16:34:48.302 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.302+0000 7f2cca000640 1 -- 172.21.15.163:0/1919132227 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ccc02f460 con 0x7f2cd4159aa0 2024-04-01T16:34:48.306 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.306+0000 7f2cca000640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2cb406c970 0x7f2cb406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:48.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.306+0000 7f2cd1e00640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2cb406c970 0x7f2cb406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:48.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.308+0000 7f2cd1e00640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2cb406c970 0x7f2cb406ee30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4000fd0 tx=0x7f2cc4001970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:48.347 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.347+0000 7f2cca000640 1 -- 172.21.15.163:0/1919132227 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f2ccc079410 con 0x7f2cd4159aa0 2024-04-01T16:34:48.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.348+0000 7f2cca000640 1 -- 172.21.15.163:0/1919132227 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2ccc07ba70 con 0x7f2cd4159aa0 2024-04-01T16:34:48.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.552+0000 7f2cd8a00640 1 -- 172.21.15.163:0/1919132227 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2cd40739e0 con 0x7f2cd4159aa0 2024-04-01T16:34:48.640 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.639+0000 7f2cca000640 1 -- 172.21.15.163:0/1919132227 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16653 (secure 0 0 0) 0x7f2ccc07b370 con 0x7f2cd4159aa0 2024-04-01T16:34:48.640 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:48.641 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":25,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:37.282127+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T16:34:29.028272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T16:34:31.534879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:34:48.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.643+0000 7f2cd8a00640 1 -- 172.21.15.163:0/1919132227 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2cb406c970 msgr2=0x7f2cb406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:48.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.643+0000 7f2cd8a00640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2cb406c970 0x7f2cb406ee30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4000fd0 tx=0x7f2cc4001970 comp rx=0 tx=0).stop 2024-04-01T16:34:48.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.643+0000 7f2cd8a00640 1 -- 172.21.15.163:0/1919132227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd4159aa0 msgr2=0x7f2cd4144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:48.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.643+0000 7f2cd8a00640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd4159aa0 0x7f2cd4144670 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc001f70 tx=0x7f2ccc0014a0 comp rx=0 tx=0).stop 2024-04-01T16:34:48.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.643+0000 7f2cd8a00640 1 -- 172.21.15.163:0/1919132227 shutdown_connections 2024-04-01T16:34:48.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.643+0000 7f2cd8a00640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2cb406c970 0x7f2cb406ee30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:48.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.643+0000 7f2cd8a00640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cd4159aa0 0x7f2cd4144670 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:48.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.643+0000 7f2cd8a00640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2cd40c3810 0x7f2cd41f0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:48.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.643+0000 7f2cd8a00640 1 --2- 172.21.15.163:0/1919132227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb80051c0 0x7f2cd40ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:48.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.643+0000 7f2cd8a00640 1 -- 172.21.15.163:0/1919132227 >> 172.21.15.163:0/1919132227 conn(0x7f2cd40cbe20 msgr2=0x7f2cd40cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:48.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.643+0000 7f2cd8a00640 1 -- 172.21.15.163:0/1919132227 shutdown_connections 2024-04-01T16:34:48.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.643+0000 7f2cd8a00640 1 -- 172.21.15.163:0/1919132227 wait complete. 2024-04-01T16:34:48.665 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-01T16:34:48.665 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T16:34:48.872 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.871+0000 7f21ac400640 1 Processor -- start 2024-04-01T16:34:48.872 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.871+0000 7f21ac400640 1 -- start start 2024-04-01T16:34:48.873 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.873+0000 7f21ac400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f21a40cc260 0x7f21a4166300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:48.873 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.873+0000 7f21ac400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a415b960 con 0x7f21a4154f00 2024-04-01T16:34:48.873 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.873+0000 7f21ac400640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a415b680 con 0x7f21a406d500 2024-04-01T16:34:48.873 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.873+0000 7f21ac400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f21a415b430 con 0x7f21a40cc260 2024-04-01T16:34:48.874 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.873+0000 7f21aa400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f21a40cc260 0x7f21a4166300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:48.874 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.874+0000 7f21aa400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f21a40cc260 0x7f21a4166300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48072/0 (socket says 172.21.15.163:48072) 2024-04-01T16:34:48.874 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.874+0000 7f21aa400640 1 -- 172.21.15.163:0/2471180651 learned_addr learned my addr 172.21.15.163:0/2471180651 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:48.877 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.877+0000 7f21aa400640 1 -- 172.21.15.163:0/2471180651 >> v1:172.21.15.189:6789/0 conn(0x7f21a406d500 legacy=0x7f21a406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:48.877 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.877+0000 7f21aa400640 1 -- 172.21.15.163:0/2471180651 >> v1:172.21.15.163:6789/0 conn(0x7f21a4154f00 legacy=0x7f21a40cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:48.878 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.877+0000 7f21aa400640 1 -- 172.21.15.163:0/2471180651 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a40caaa0 con 0x7f21a40cc260 2024-04-01T16:34:48.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.884+0000 7f21aa400640 1 --2- 172.21.15.163:0/2471180651 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21a40cc260 0x7f21a4166300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f219c009e50 tx=0x7f219c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e464a19783e41a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:48.893 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.893+0000 7f21a3e00640 1 -- 172.21.15.163:0/2471180651 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c02ca80 con 0x7f21a40cc260 2024-04-01T16:34:48.893 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.893+0000 7f21a3e00640 1 -- 172.21.15.163:0/2471180651 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c02cc20 con 0x7f21a40cc260 2024-04-01T16:34:48.893 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.893+0000 7f21a3e00640 1 -- 172.21.15.163:0/2471180651 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0343f0 con 0x7f21a40cc260 2024-04-01T16:34:48.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.894+0000 7f21ac400640 1 -- 172.21.15.163:0/2471180651 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21a40cc260 msgr2=0x7f21a4166300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:48.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.894+0000 7f21ac400640 1 --2- 172.21.15.163:0/2471180651 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21a40cc260 0x7f21a4166300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f219c009e50 tx=0x7f219c02bee0 comp rx=0 tx=0).stop 2024-04-01T16:34:48.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.894+0000 7f21ac400640 1 -- 172.21.15.163:0/2471180651 shutdown_connections 2024-04-01T16:34:48.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.894+0000 7f21ac400640 1 --2- 172.21.15.163:0/2471180651 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21a40cc260 0x7f21a4166300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:48.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.894+0000 7f21ac400640 1 -- 172.21.15.163:0/2471180651 >> 172.21.15.163:0/2471180651 conn(0x7f21a40d01d0 msgr2=0x7f21a40d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:48.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.894+0000 7f21ac400640 1 -- 172.21.15.163:0/2471180651 shutdown_connections 2024-04-01T16:34:48.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.894+0000 7f21ac400640 1 -- 172.21.15.163:0/2471180651 wait complete. 2024-04-01T16:34:48.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.896+0000 7f21ac400640 1 Processor -- start 2024-04-01T16:34:48.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.896+0000 7f21ac400640 1 -- start start 2024-04-01T16:34:48.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.897+0000 7f21ac400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21a406d500 0x7f21a415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:48.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.897+0000 7f21ac400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21a40cc260 0x7f21a415e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:48.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.897+0000 7f21ac400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21a4154f00 0x7f21a414f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:48.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.897+0000 7f21ac400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f21a40cb060 con 0x7f21a4154f00 2024-04-01T16:34:48.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.897+0000 7f21ac400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f21a40cb3d0 con 0x7f21a406d500 2024-04-01T16:34:48.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.897+0000 7f21ac400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f21a40c5580 con 0x7f21a40cc260 2024-04-01T16:34:48.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.898+0000 7f21aa400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21a4154f00 0x7f21a414f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:48.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.899+0000 7f21a9000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21a40cc260 0x7f21a415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:48.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.899+0000 7f21a9a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21a406d500 0x7f21a415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:48.900 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.900+0000 7f21a9000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21a40cc260 0x7f21a415e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:46858/0 (socket says 172.21.15.163:46858) 2024-04-01T16:34:48.900 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.900+0000 7f21a9000640 1 -- 172.21.15.163:0/955487930 learned_addr learned my addr 172.21.15.163:0/955487930 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:48.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.909+0000 7f21a9000640 1 -- 172.21.15.163:0/955487930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21a406d500 msgr2=0x7f21a415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:48.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.909+0000 7f21a9000640 1 --2- 172.21.15.163:0/955487930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21a406d500 0x7f21a415dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:48.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.909+0000 7f21a9000640 1 -- 172.21.15.163:0/955487930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21a4154f00 msgr2=0x7f21a414f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:48.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.909+0000 7f21a9000640 1 --2- 172.21.15.163:0/955487930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21a4154f00 0x7f21a414f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:48.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.909+0000 7f21a9000640 1 -- 172.21.15.163:0/955487930 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a415ced0 con 0x7f21a40cc260 2024-04-01T16:34:48.917 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.917+0000 7f21a9000640 1 --2- 172.21.15.163:0/955487930 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21a40cc260 0x7f21a415e160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f219000b3f0 tx=0x7f219000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:48.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.925+0000 7f21a1600640 1 -- 172.21.15.163:0/955487930 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190015020 con 0x7f21a40cc260 2024-04-01T16:34:48.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.925+0000 7f21a1600640 1 -- 172.21.15.163:0/955487930 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2190011830 con 0x7f21a40cc260 2024-04-01T16:34:48.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.925+0000 7f21a1600640 1 -- 172.21.15.163:0/955487930 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190011c00 con 0x7f21a40cc260 2024-04-01T16:34:48.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.925+0000 7f21ac400640 1 -- 172.21.15.163:0/955487930 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a41e52d0 con 0x7f21a40cc260 2024-04-01T16:34:48.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.925+0000 7f21ac400640 1 -- 172.21.15.163:0/955487930 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a415d140 con 0x7f21a40cc260 2024-04-01T16:34:48.927 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.927+0000 7f21ac400640 1 -- 172.21.15.163:0/955487930 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a40c9dc0 con 0x7f21a40cc260 2024-04-01T16:34:48.978 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.978+0000 7f21a1600640 1 -- 172.21.15.163:0/955487930 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2190018020 con 0x7f21a40cc260 2024-04-01T16:34:48.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.979+0000 7f21a1600640 1 --2- 172.21.15.163:0/955487930 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f218406c940 0x7f218406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:48.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.980+0000 7f21a9a00640 1 --2- 172.21.15.163:0/955487930 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f218406c940 0x7f218406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:48.981 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.981+0000 7f21a9a00640 1 --2- 172.21.15.163:0/955487930 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f218406c940 0x7f218406ee00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2198001780 tx=0x7f2198009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:48.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:48.984+0000 7f21a1600640 1 -- 172.21.15.163:0/955487930 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f2190057d90 con 0x7f21a40cc260 2024-04-01T16:34:49.363 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.362+0000 7f21a1600640 1 -- 172.21.15.163:0/955487930 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f21a40c9dc0 con 0x7f21a40cc260 2024-04-01T16:34:49.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.572+0000 7f21ac400640 1 -- 172.21.15.163:0/955487930 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21a40756d0 con 0x7f21a40cc260 2024-04-01T16:34:49.769 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.769+0000 7f21a1600640 1 -- 172.21.15.163:0/955487930 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16653 (secure 0 0 0) 0x7f219001f020 con 0x7f21a40cc260 2024-04-01T16:34:49.770 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:49.770 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":25,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:37.282127+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T16:34:29.028272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T16:34:31.534879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:34:49.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.772+0000 7f21ac400640 1 -- 172.21.15.163:0/955487930 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f218406c940 msgr2=0x7f218406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:49.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.772+0000 7f21ac400640 1 --2- 172.21.15.163:0/955487930 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f218406c940 0x7f218406ee00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2198001780 tx=0x7f2198009040 comp rx=0 tx=0).stop 2024-04-01T16:34:49.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.772+0000 7f21ac400640 1 -- 172.21.15.163:0/955487930 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21a40cc260 msgr2=0x7f21a415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:49.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.772+0000 7f21ac400640 1 --2- 172.21.15.163:0/955487930 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21a40cc260 0x7f21a415e160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f219000b3f0 tx=0x7f219000b8b0 comp rx=0 tx=0).stop 2024-04-01T16:34:49.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.772+0000 7f21ac400640 1 -- 172.21.15.163:0/955487930 shutdown_connections 2024-04-01T16:34:49.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.772+0000 7f21ac400640 1 --2- 172.21.15.163:0/955487930 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f218406c940 0x7f218406ee00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:49.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.772+0000 7f21ac400640 1 --2- 172.21.15.163:0/955487930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21a4154f00 0x7f21a414f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:49.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.772+0000 7f21ac400640 1 --2- 172.21.15.163:0/955487930 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f21a40cc260 0x7f21a415e160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:49.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.772+0000 7f21ac400640 1 --2- 172.21.15.163:0/955487930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21a406d500 0x7f21a415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:49.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.772+0000 7f21ac400640 1 -- 172.21.15.163:0/955487930 >> 172.21.15.163:0/955487930 conn(0x7f21a40d01d0 msgr2=0x7f21a4153d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:49.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.772+0000 7f21ac400640 1 -- 172.21.15.163:0/955487930 shutdown_connections 2024-04-01T16:34:49.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:49.772+0000 7f21ac400640 1 -- 172.21.15.163:0/955487930 wait complete. 2024-04-01T16:34:49.794 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-01T16:34:49.795 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-01T16:34:49.795 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-01T16:34:49.796 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-01T16:34:49.796 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-01T16:34:49.796 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-01T16:34:49.797 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-01T16:34:49.797 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-01T16:34:50.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.116+0000 7fdbcbe00640 1 Processor -- start 2024-04-01T16:34:50.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.116+0000 7fdbcbe00640 1 -- start start 2024-04-01T16:34:50.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.118+0000 7fdbcbe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbcc154c70 0x7fdbcc0cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.119 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.118+0000 7fdbcbe00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdbcc0ce3e0 0x7fdbcc0cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.119 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.118+0000 7fdbcbe00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbcc0b1ef0 con 0x7fdbcc0cedb0 2024-04-01T16:34:50.119 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.118+0000 7fdbcbe00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fdbcc0ca790 con 0x7fdbcc0ce3e0 2024-04-01T16:34:50.119 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.118+0000 7fdbcbe00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdbcc155050 con 0x7fdbcc154c70 2024-04-01T16:34:50.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.121+0000 7fdbcaa00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbcc154c70 0x7fdbcc0cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.122+0000 7fdbcaa00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbcc154c70 0x7fdbcc0cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:46860/0 (socket says 172.21.15.163:46860) 2024-04-01T16:34:50.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.122+0000 7fdbcaa00640 1 -- 172.21.15.163:0/1543313891 learned_addr learned my addr 172.21.15.163:0/1543313891 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.123+0000 7fcb57e00640 1 Processor -- start 2024-04-01T16:34:50.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.123+0000 7fcb57e00640 1 -- start start 2024-04-01T16:34:50.124 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.123+0000 7f49c4800640 1 Processor -- start 2024-04-01T16:34:50.124 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.123+0000 7f49c4800640 1 -- start start 2024-04-01T16:34:50.125 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.125+0000 7f49c4800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f49bc0c54d0 0x7f49bc150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.125+0000 7fcb57e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcb580c8660 0x7fcb58072a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.126+0000 7f49c4800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49bc070320 0x7f49bc156860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.126+0000 7f49c4800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49bc0ca7e0 con 0x7f49bc0c6c40 2024-04-01T16:34:50.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.126+0000 7f49c4800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f49bc0cb3c0 con 0x7f49bc0c54d0 2024-04-01T16:34:50.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.126+0000 7f49c4800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f49bc0caac0 con 0x7f49bc070320 2024-04-01T16:34:50.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.126+0000 7f633ea00640 1 Processor -- start 2024-04-01T16:34:50.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.126+0000 7fcb57e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb580c47f0 con 0x7fcb580c8a40 2024-04-01T16:34:50.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.126+0000 7f633ea00640 1 -- start start 2024-04-01T16:34:50.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.126+0000 7fcb57e00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb58073730 con 0x7fcb58150c70 2024-04-01T16:34:50.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.126+0000 7fcb57e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fcb58073a10 con 0x7fcb580c8660 2024-04-01T16:34:50.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.128+0000 7f633ea00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6338154730 0x7f63380caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.129 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.128+0000 7fdbcaa00640 1 -- 172.21.15.163:0/1543313891 >> v2:172.21.15.163:3300/0 conn(0x7fdbcc0ce3e0 msgr2=0x7fdbcc0cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.129 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.128+0000 7fdbcaa00640 1 --2- 172.21.15.163:0/1543313891 >> v2:172.21.15.163:3300/0 conn(0x7fdbcc0ce3e0 0x7fdbcc0cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.129 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.128+0000 7fdbcaa00640 1 -- 172.21.15.163:0/1543313891 >> v1:172.21.15.163:6789/0 conn(0x7fdbcc0cedb0 legacy=0x7fdbcc0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.129 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.128+0000 7fdbcaa00640 1 -- 172.21.15.163:0/1543313891 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc0b1c10 con 0x7fdbcc154c70 2024-04-01T16:34:50.129 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.128+0000 7f633ea00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63380cb800 0x7f63380cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.129 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.128+0000 7f633ea00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63380cc170 con 0x7f633815b260 2024-04-01T16:34:50.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.128+0000 7f633ea00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f633806c590 con 0x7f6338154730 2024-04-01T16:34:50.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.128+0000 7f633ea00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f633806c870 con 0x7f63380cb800 2024-04-01T16:34:50.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.133+0000 7f4502000640 1 Processor -- start 2024-04-01T16:34:50.134 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.133+0000 7f4502000640 1 -- start start 2024-04-01T16:34:50.134 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.134+0000 7f4502000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f44fc0cbce0 0x7f44fc0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.134 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.134+0000 7f4502000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc15b970 con 0x7f44fc06c480 2024-04-01T16:34:50.134 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.134+0000 7f4502000640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc0d0800 con 0x7f44fc15b480 2024-04-01T16:34:50.135 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.134+0000 7f4502000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f44fc0ca9d0 con 0x7f44fc0cbce0 2024-04-01T16:34:50.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.136+0000 7f49c1400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49bc070320 0x7f49bc156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.136+0000 7efef4c00640 1 Processor -- start 2024-04-01T16:34:50.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.136+0000 7f569e800640 1 Processor -- start 2024-04-01T16:34:50.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.136+0000 7efef4c00640 1 -- start start 2024-04-01T16:34:50.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.137+0000 7fdbcaa00640 1 --2- 172.21.15.163:0/1543313891 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbcc154c70 0x7fdbcc0cac20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc1551d0 tx=0x7fdbbc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=407ef1e61a7be73d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.137+0000 7f569e800640 1 -- start start 2024-04-01T16:34:50.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.138+0000 7f633ca00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63380cb800 0x7f63380cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.138+0000 7efef4c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efef0154c60 0x7efef015a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.138+0000 7efef4c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efef006c590 con 0x7efef00cd0e0 2024-04-01T16:34:50.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.138+0000 7efef4c00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efef006c850 con 0x7efef00cd4c0 2024-04-01T16:34:50.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.138+0000 7efef4c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7efef006cb30 con 0x7efef0154c60 2024-04-01T16:34:50.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.138+0000 7f569e800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f56980cd0e0 0x7f569815a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.138+0000 7f569e800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56980cd4c0 0x7f5698154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.138+0000 7f569e800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f56980cadd0 0x7f5698154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.138+0000 7f569e800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f569806c590 con 0x7f56980cadd0 2024-04-01T16:34:50.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.138+0000 7f569e800640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f569806c850 con 0x7f56980cd0e0 2024-04-01T16:34:50.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.138+0000 7f569e800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f569806cb30 con 0x7f56980cd4c0 2024-04-01T16:34:50.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.140+0000 7f49c1400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49bc070320 0x7f49bc156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:46864/0 (socket says 172.21.15.163:46864) 2024-04-01T16:34:50.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.140+0000 7f49c1400640 1 -- 172.21.15.163:0/3797678738 learned_addr learned my addr 172.21.15.163:0/3797678738 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.142+0000 7f633ca00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63380cb800 0x7f63380cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:46874/0 (socket says 172.21.15.163:46874) 2024-04-01T16:34:50.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.142+0000 7f633ca00640 1 -- 172.21.15.163:0/4115764292 learned_addr learned my addr 172.21.15.163:0/4115764292 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.147+0000 7efd99e00640 1 Processor -- start 2024-04-01T16:34:50.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.147+0000 7efd99e00640 1 -- start start 2024-04-01T16:34:50.149 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.149+0000 7efd99e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd940cd0e0 0x7efd9415a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.149 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.149+0000 7efd99e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efd940cd4c0 0x7efd94154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.150 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.149+0000 7efd99e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7efd940cadd0 0x7efd94154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.150 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.149+0000 7efd99e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7efd9406c590 con 0x7efd940cd4c0 2024-04-01T16:34:50.150 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.149+0000 7efd99e00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7efd9406c850 con 0x7efd940cadd0 2024-04-01T16:34:50.150 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.149+0000 7efd99e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efd9406cb30 con 0x7efd940cd0e0 2024-04-01T16:34:50.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.154+0000 7f49c1400640 1 -- 172.21.15.163:0/3797678738 >> v2:172.21.15.163:3300/0 conn(0x7f49bc0c54d0 msgr2=0x7f49bc150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.155 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.154+0000 7f49c1400640 1 --2- 172.21.15.163:0/3797678738 >> v2:172.21.15.163:3300/0 conn(0x7f49bc0c54d0 0x7f49bc150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.155 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.154+0000 7f49c1400640 1 -- 172.21.15.163:0/3797678738 >> v1:172.21.15.189:6789/0 conn(0x7f49bc0c6c40 legacy=0x7f49bc06b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.155 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.154+0000 7f49c1400640 1 -- 172.21.15.163:0/3797678738 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc0cb610 con 0x7f49bc070320 2024-04-01T16:34:50.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.157+0000 7fdbc9600640 1 -- 172.21.15.163:0/1543313891 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc034070 con 0x7fdbcc154c70 2024-04-01T16:34:50.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.157+0000 7fdbc9600640 1 -- 172.21.15.163:0/1543313891 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbbc030840 con 0x7fdbcc154c70 2024-04-01T16:34:50.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.157+0000 7fdbc9600640 1 -- 172.21.15.163:0/1543313891 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc030c10 con 0x7fdbcc154c70 2024-04-01T16:34:50.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.157+0000 7fdbcbe00640 1 -- 172.21.15.163:0/1543313891 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbcc154c70 msgr2=0x7fdbcc0cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.157+0000 7fdbcbe00640 1 --2- 172.21.15.163:0/1543313891 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbcc154c70 0x7fdbcc0cac20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc1551d0 tx=0x7fdbbc02b980 comp rx=0 tx=0).stop 2024-04-01T16:34:50.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.158+0000 7fdbcbe00640 1 -- 172.21.15.163:0/1543313891 shutdown_connections 2024-04-01T16:34:50.159 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.158+0000 7fdbcbe00640 1 --2- 172.21.15.163:0/1543313891 >> v2:172.21.15.163:3300/0 conn(0x7fdbcc0ce3e0 0x7fdbcc0cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.159 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.158+0000 7fdbcbe00640 1 --2- 172.21.15.163:0/1543313891 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbcc154c70 0x7fdbcc0cac20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.159 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.158+0000 7fdbcbe00640 1 -- 172.21.15.163:0/1543313891 >> 172.21.15.163:0/1543313891 conn(0x7fdbcc067280 msgr2=0x7fdbcc067690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.159 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.158+0000 7fdbcbe00640 1 -- 172.21.15.163:0/1543313891 shutdown_connections 2024-04-01T16:34:50.159 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.158+0000 7fdbcbe00640 1 -- 172.21.15.163:0/1543313891 wait complete. 2024-04-01T16:34:50.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.159+0000 7fdbcbe00640 1 Processor -- start 2024-04-01T16:34:50.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.160+0000 7fdbcbe00640 1 -- start start 2024-04-01T16:34:50.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.160+0000 7fdbcbe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbcc0ce3e0 0x7fdbcc1e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.160+0000 7fdbcbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbcc0cedb0 0x7fdbcc14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.160+0000 7fdbcbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbcc154c70 0x7fdbcc14e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.160+0000 7fdbcbe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc0b2190 con 0x7fdbcc0cedb0 2024-04-01T16:34:50.162 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.160+0000 7fdbcbe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc15eb90 con 0x7fdbcc154c70 2024-04-01T16:34:50.162 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.160+0000 7fdbcbe00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdbcc1f0ad0 con 0x7fdbcc0ce3e0 2024-04-01T16:34:50.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.165+0000 7f633ca00640 1 -- 172.21.15.163:0/4115764292 >> v2:172.21.15.163:3300/0 conn(0x7f6338154730 msgr2=0x7f63380caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.165+0000 7f633ca00640 1 --2- 172.21.15.163:0/4115764292 >> v2:172.21.15.163:3300/0 conn(0x7f6338154730 0x7f63380caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.165+0000 7f633ca00640 1 -- 172.21.15.163:0/4115764292 >> v1:172.21.15.189:6789/0 conn(0x7f633815b260 legacy=0x7f63380cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.165+0000 7f633ca00640 1 -- 172.21.15.163:0/4115764292 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633806cb50 con 0x7f63380cb800 2024-04-01T16:34:50.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.170+0000 7f44fbe00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f44fc0cbce0 0x7f44fc0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.171+0000 7f44fbe00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f44fc0cbce0 0x7f44fc0cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48136/0 (socket says 172.21.15.163:48136) 2024-04-01T16:34:50.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.171+0000 7f44fbe00640 1 -- 172.21.15.163:0/127484898 learned_addr learned my addr 172.21.15.163:0/127484898 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.172 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.171+0000 7f49c1400640 1 --2- 172.21.15.163:0/3797678738 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49bc070320 0x7f49bc156860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009870 tx=0x7f49b002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49c2570bc4baa66 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.173 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.173+0000 7f633ca00640 1 --2- 172.21.15.163:0/4115764292 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63380cb800 0x7f63380cbc30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f633806d840 tx=0x7f633002bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25fb50c514fad234 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.175 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.175+0000 7f44fbe00640 1 -- 172.21.15.163:0/127484898 >> v1:172.21.15.189:6789/0 conn(0x7f44fc15b480 legacy=0x7f44fc163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.175 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.175+0000 7f44fbe00640 1 -- 172.21.15.163:0/127484898 >> v1:172.21.15.163:6789/0 conn(0x7f44fc06c480 legacy=0x7f44fc0cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.175 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.175+0000 7f44fbe00640 1 -- 172.21.15.163:0/127484898 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc0d0ae0 con 0x7f44fc0cbce0 2024-04-01T16:34:50.177 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.177+0000 7fcb56a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcb580c8660 0x7fcb58072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.178 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.178+0000 7efd92000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efd940cd4c0 0x7efd94154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.178 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.178+0000 7f44fbe00640 1 --2- 172.21.15.163:0/127484898 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44fc0cbce0 0x7f44fc0cc470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009e50 tx=0x7f44f402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bee684fb27031a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.179+0000 7fcb56a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcb580c8660 0x7fcb58072a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48118/0 (socket says 172.21.15.163:48118) 2024-04-01T16:34:50.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.179+0000 7fcb56a00640 1 -- 172.21.15.163:0/2994027120 learned_addr learned my addr 172.21.15.163:0/2994027120 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.179+0000 7efd92000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efd940cd4c0 0x7efd94154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48172/0 (socket says 172.21.15.163:48172) 2024-04-01T16:34:50.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.179+0000 7efd92000640 1 -- 172.21.15.163:0/2725084856 learned_addr learned my addr 172.21.15.163:0/2725084856 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.182 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.182+0000 7efeee800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efef0154c60 0x7efef015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.184+0000 7fcb56a00640 1 -- 172.21.15.163:0/2994027120 >> v1:172.21.15.189:6789/0 conn(0x7fcb58150c70 legacy=0x7fcb58156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.184+0000 7fcb56a00640 1 -- 172.21.15.163:0/2994027120 >> v1:172.21.15.163:6789/0 conn(0x7fcb580c8a40 legacy=0x7fcb58150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.184+0000 7fcb56a00640 1 -- 172.21.15.163:0/2994027120 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb580c4a60 con 0x7fcb580c8660 2024-04-01T16:34:50.186 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.186+0000 7efd92000640 1 -- 172.21.15.163:0/2725084856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd940cd0e0 msgr2=0x7efd9415a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.186 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.186+0000 7efd92000640 1 --2- 172.21.15.163:0/2725084856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd940cd0e0 0x7efd9415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.186 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.186+0000 7efd92000640 1 -- 172.21.15.163:0/2725084856 >> v2:172.21.15.189:3300/0 conn(0x7efd940cadd0 msgr2=0x7efd94154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.186 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.186+0000 7efd92000640 1 --2- 172.21.15.163:0/2725084856 >> v2:172.21.15.189:3300/0 conn(0x7efd940cadd0 0x7efd94154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.186 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.186+0000 7efd92000640 1 -- 172.21.15.163:0/2725084856 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9406ce10 con 0x7efd940cd4c0 2024-04-01T16:34:50.187 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.186+0000 7efeee800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efef0154c60 0x7efef015a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48148/0 (socket says 172.21.15.163:48148) 2024-04-01T16:34:50.187 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.186+0000 7efeee800640 1 -- 172.21.15.163:0/3341831825 learned_addr learned my addr 172.21.15.163:0/3341831825 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.188+0000 7f5697e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f56980cadd0 0x7f5698154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.190+0000 7f5697e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f56980cadd0 0x7f5698154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48158/0 (socket says 172.21.15.163:48158) 2024-04-01T16:34:50.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.190+0000 7f5697e00640 1 -- 172.21.15.163:0/1589554567 learned_addr learned my addr 172.21.15.163:0/1589554567 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.191 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.191+0000 7efeee800640 1 -- 172.21.15.163:0/3341831825 >> v1:172.21.15.189:6789/0 conn(0x7efef00cd4c0 legacy=0x7efef00cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.191 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.191+0000 7efeee800640 1 -- 172.21.15.163:0/3341831825 >> v1:172.21.15.163:6789/0 conn(0x7efef00cd0e0 legacy=0x7efef0154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.192 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.191+0000 7efeee800640 1 -- 172.21.15.163:0/3341831825 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef006ce10 con 0x7efef0154c60 2024-04-01T16:34:50.192 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.191+0000 7efd92000640 1 --2- 172.21.15.163:0/2725084856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd940cd4c0 0x7efd94154550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd9415b820 tx=0x7efd8002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0460273a780817a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.192 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.192+0000 7f49c0a00640 1 -- 172.21.15.163:0/3797678738 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0034070 con 0x7f49bc070320 2024-04-01T16:34:50.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.194+0000 7f5696a00640 1 --2- 172.21.15.163:0/1589554567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56980cd4c0 0x7f5698154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.197+0000 7f5697e00640 1 -- 172.21.15.163:0/1589554567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56980cd4c0 msgr2=0x7f5698154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.197+0000 7f5697e00640 1 --2- 172.21.15.163:0/1589554567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56980cd4c0 0x7f5698154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.197+0000 7f5697e00640 1 -- 172.21.15.163:0/1589554567 >> v2:172.21.15.189:3300/0 conn(0x7f56980cd0e0 msgr2=0x7f569815a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.197+0000 7f5697e00640 1 --2- 172.21.15.163:0/1589554567 >> v2:172.21.15.189:3300/0 conn(0x7f56980cd0e0 0x7f569815a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.197+0000 7f5697e00640 1 -- 172.21.15.163:0/1589554567 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569806ce10 con 0x7f56980cadd0 2024-04-01T16:34:50.199 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.199+0000 7efeee800640 1 --2- 172.21.15.163:0/3341831825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efef0154c60 0x7efef015a740 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efee8009e50 tx=0x7efee802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0eb4e50ed3e2c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.200 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.200+0000 7f5697e00640 1 --2- 172.21.15.163:0/1589554567 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56980cadd0 0x7f5698154a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f569806dd90 tx=0x7f568802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf853ca1aa8d9089 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.204 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.203+0000 7fdbca000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbcc0cedb0 0x7fdbcc14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.204 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.204+0000 7fdbca000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbcc0cedb0 0x7fdbcc14e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48188/0 (socket says 172.21.15.163:48188) 2024-04-01T16:34:50.204 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.204+0000 7fdbca000640 1 -- 172.21.15.163:0/742846266 learned_addr learned my addr 172.21.15.163:0/742846266 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.207 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.207+0000 7fdbcb400640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbcc154c70 0x7fdbcc14e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.209 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.209+0000 7efd91600640 1 -- 172.21.15.163:0/2725084856 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80035020 con 0x7efd940cd4c0 2024-04-01T16:34:50.209 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.209+0000 7efd91600640 1 -- 172.21.15.163:0/2725084856 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd80031870 con 0x7efd940cd4c0 2024-04-01T16:34:50.209 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.209+0000 7efd91600640 1 -- 172.21.15.163:0/2725084856 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80031c40 con 0x7efd940cd4c0 2024-04-01T16:34:50.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.210+0000 7efd99e00640 1 -- 172.21.15.163:0/2725084856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd940cd4c0 msgr2=0x7efd94154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.210+0000 7efd99e00640 1 --2- 172.21.15.163:0/2725084856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd940cd4c0 0x7efd94154550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd9415b820 tx=0x7efd8002b910 comp rx=0 tx=0).stop 2024-04-01T16:34:50.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.210+0000 7efd99e00640 1 -- 172.21.15.163:0/2725084856 shutdown_connections 2024-04-01T16:34:50.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.210+0000 7efd99e00640 1 --2- 172.21.15.163:0/2725084856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd940cd4c0 0x7efd94154550 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.210+0000 7efd99e00640 1 --2- 172.21.15.163:0/2725084856 >> v2:172.21.15.189:3300/0 conn(0x7efd940cadd0 0x7efd94154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.210+0000 7efd99e00640 1 --2- 172.21.15.163:0/2725084856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd940cd0e0 0x7efd9415a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.210+0000 7efd99e00640 1 -- 172.21.15.163:0/2725084856 >> 172.21.15.163:0/2725084856 conn(0x7efd94067460 msgr2=0x7efd94067870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.210+0000 7efd99e00640 1 -- 172.21.15.163:0/2725084856 shutdown_connections 2024-04-01T16:34:50.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.210+0000 7efd99e00640 1 -- 172.21.15.163:0/2725084856 wait complete. 2024-04-01T16:34:50.212 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.212+0000 7efd99e00640 1 Processor -- start 2024-04-01T16:34:50.212 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.212+0000 7efd99e00640 1 -- start start 2024-04-01T16:34:50.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.212+0000 7fdbca000640 1 -- 172.21.15.163:0/742846266 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbcc0ce3e0 msgr2=0x7fdbcc1e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.212+0000 7fdbca000640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdbcc0ce3e0 0x7fdbcc1e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.212+0000 7fdbca000640 1 -- 172.21.15.163:0/742846266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbcc154c70 msgr2=0x7fdbcc14e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.212+0000 7fdbca000640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbcc154c70 0x7fdbcc14e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.212+0000 7fdbca000640 1 -- 172.21.15.163:0/742846266 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc1f0db0 con 0x7fdbcc0cedb0 2024-04-01T16:34:50.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.213+0000 7efd99e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd940cadd0 0x7efd9414f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.214 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.213+0000 7efd99e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd940cd0e0 0x7efd941f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.214 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.213+0000 7efd99e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd940cd4c0 0x7efd94148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.214 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.213+0000 7efd99e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efd9406e050 con 0x7efd940cd0e0 2024-04-01T16:34:50.214 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.213+0000 7efd99e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efd9406d3d0 con 0x7efd940cd4c0 2024-04-01T16:34:50.214 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.213+0000 7efd99e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efd9406e1d0 con 0x7efd940cadd0 2024-04-01T16:34:50.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.214+0000 7fcb56a00640 1 --2- 172.21.15.163:0/2994027120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb580c8660 0x7fcb58072a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009870 tx=0x7fcb4402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2fce1dda4e53af server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.217 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.216+0000 7fdbca000640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbcc0cedb0 0x7fdbcc14e070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800b4a0 tx=0x7fdbb800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.220+0000 7f5696000640 1 -- 172.21.15.163:0/1589554567 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688035020 con 0x7f56980cadd0 2024-04-01T16:34:50.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.220+0000 7f5696000640 1 -- 172.21.15.163:0/1589554567 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5688031870 con 0x7f56980cadd0 2024-04-01T16:34:50.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.220+0000 7f5696000640 1 -- 172.21.15.163:0/1589554567 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688031c40 con 0x7f56980cadd0 2024-04-01T16:34:50.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.221+0000 7f569e800640 1 -- 172.21.15.163:0/1589554567 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56980cadd0 msgr2=0x7f5698154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.221+0000 7f569e800640 1 --2- 172.21.15.163:0/1589554567 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56980cadd0 0x7f5698154a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f569806dd90 tx=0x7f568802b910 comp rx=0 tx=0).stop 2024-04-01T16:34:50.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.221+0000 7f569e800640 1 -- 172.21.15.163:0/1589554567 shutdown_connections 2024-04-01T16:34:50.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.221+0000 7f569e800640 1 --2- 172.21.15.163:0/1589554567 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56980cadd0 0x7f5698154a90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.221+0000 7f569e800640 1 --2- 172.21.15.163:0/1589554567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56980cd4c0 0x7f5698154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.221+0000 7f569e800640 1 --2- 172.21.15.163:0/1589554567 >> v2:172.21.15.189:3300/0 conn(0x7f56980cd0e0 0x7f569815a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.221+0000 7f569e800640 1 -- 172.21.15.163:0/1589554567 >> 172.21.15.163:0/1589554567 conn(0x7f5698067460 msgr2=0x7f5698067870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.221+0000 7f569e800640 1 -- 172.21.15.163:0/1589554567 shutdown_connections 2024-04-01T16:34:50.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.221+0000 7f569e800640 1 -- 172.21.15.163:0/1589554567 wait complete. 2024-04-01T16:34:50.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.223+0000 7fcb55600640 1 -- 172.21.15.163:0/2994027120 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44034070 con 0x7fcb580c8660 2024-04-01T16:34:50.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.223+0000 7fcb55600640 1 -- 172.21.15.163:0/2994027120 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb44030860 con 0x7fcb580c8660 2024-04-01T16:34:50.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.223+0000 7fcb55600640 1 -- 172.21.15.163:0/2994027120 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44030c30 con 0x7fcb580c8660 2024-04-01T16:34:50.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.223+0000 7f569e800640 1 Processor -- start 2024-04-01T16:34:50.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.223+0000 7f569e800640 1 -- start start 2024-04-01T16:34:50.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7fcb57e00640 1 -- 172.21.15.163:0/2994027120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb580c8660 msgr2=0x7fcb58072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7fcb57e00640 1 --2- 172.21.15.163:0/2994027120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb580c8660 0x7fcb58072a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009870 tx=0x7fcb4402b9a0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7fcb57e00640 1 -- 172.21.15.163:0/2994027120 shutdown_connections 2024-04-01T16:34:50.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7fcb57e00640 1 --2- 172.21.15.163:0/2994027120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb580c8660 0x7fcb58072a90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7fcb57e00640 1 -- 172.21.15.163:0/2994027120 >> 172.21.15.163:0/2994027120 conn(0x7fcb5806f750 msgr2=0x7fcb5806fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7fcb57e00640 1 -- 172.21.15.163:0/2994027120 shutdown_connections 2024-04-01T16:34:50.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7fcb57e00640 1 -- 172.21.15.163:0/2994027120 wait complete. 2024-04-01T16:34:50.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7f569e800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56980cadd0 0x7f5698144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7f569e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56980cd0e0 0x7f56981f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7f569e800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56980cd4c0 0x7f56981f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7f569e800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f569806e050 con 0x7f56980cd4c0 2024-04-01T16:34:50.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7f569e800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f569806d3d0 con 0x7f56980cd0e0 2024-04-01T16:34:50.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.224+0000 7f569e800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f569806e1d0 con 0x7f56980cadd0 2024-04-01T16:34:50.226 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.226+0000 7fcb57e00640 1 Processor -- start 2024-04-01T16:34:50.226 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.226+0000 7fcb57e00640 1 -- start start 2024-04-01T16:34:50.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.227+0000 7fcb57e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb580c8660 0x7fcb58151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.227+0000 7fcb57e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb580c8a40 0x7fcb581521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.227+0000 7fcb57e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb58150c70 0x7fcb580c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.227+0000 7fcb57e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fcb580c7ff0 con 0x7fcb580c8660 2024-04-01T16:34:50.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.227+0000 7fcb57e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb580c5020 con 0x7fcb58150c70 2024-04-01T16:34:50.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.227+0000 7fcb57e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcb580c8170 con 0x7fcb580c8a40 2024-04-01T16:34:50.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.227+0000 7f44fa000640 1 -- 172.21.15.163:0/127484898 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f402cb20 con 0x7f44fc0cbce0 2024-04-01T16:34:50.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.227+0000 7f44fa000640 1 -- 172.21.15.163:0/127484898 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f402ccc0 con 0x7f44fc0cbce0 2024-04-01T16:34:50.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.227+0000 7f44fa000640 1 -- 172.21.15.163:0/127484898 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4034610 con 0x7f44fc0cbce0 2024-04-01T16:34:50.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.228+0000 7f4502000640 1 -- 172.21.15.163:0/127484898 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44fc0cbce0 msgr2=0x7f44fc0cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.228+0000 7f4502000640 1 --2- 172.21.15.163:0/127484898 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44fc0cbce0 0x7f44fc0cc470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009e50 tx=0x7f44f402bf80 comp rx=0 tx=0).stop 2024-04-01T16:34:50.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.228+0000 7efd92000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd940cd0e0 0x7efd941f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.228+0000 7f4502000640 1 -- 172.21.15.163:0/127484898 shutdown_connections 2024-04-01T16:34:50.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.228+0000 7f4502000640 1 --2- 172.21.15.163:0/127484898 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44fc0cbce0 0x7f44fc0cc470 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.228+0000 7f4502000640 1 -- 172.21.15.163:0/127484898 >> 172.21.15.163:0/127484898 conn(0x7f44fc0678b0 msgr2=0x7f44fc0d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.228+0000 7f4502000640 1 -- 172.21.15.163:0/127484898 shutdown_connections 2024-04-01T16:34:50.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.228+0000 7f4502000640 1 -- 172.21.15.163:0/127484898 wait complete. 2024-04-01T16:34:50.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.228+0000 7efeeca00640 1 -- 172.21.15.163:0/3341831825 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee802c9f0 con 0x7efef0154c60 2024-04-01T16:34:50.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.228+0000 7efeeca00640 1 -- 172.21.15.163:0/3341831825 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee802cb90 con 0x7efef0154c60 2024-04-01T16:34:50.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.228+0000 7efeeca00640 1 -- 172.21.15.163:0/3341831825 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee80343f0 con 0x7efef0154c60 2024-04-01T16:34:50.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.229+0000 7efef4c00640 1 -- 172.21.15.163:0/3341831825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efef0154c60 msgr2=0x7efef015a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.229+0000 7efef4c00640 1 --2- 172.21.15.163:0/3341831825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efef0154c60 0x7efef015a740 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efee8009e50 tx=0x7efee802be50 comp rx=0 tx=0).stop 2024-04-01T16:34:50.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.230+0000 7efef4c00640 1 -- 172.21.15.163:0/3341831825 shutdown_connections 2024-04-01T16:34:50.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.230+0000 7efef4c00640 1 --2- 172.21.15.163:0/3341831825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efef0154c60 0x7efef015a740 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.230+0000 7efef4c00640 1 -- 172.21.15.163:0/3341831825 >> 172.21.15.163:0/3341831825 conn(0x7efef0067460 msgr2=0x7efef0067870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.230+0000 7efef4c00640 1 -- 172.21.15.163:0/3341831825 shutdown_connections 2024-04-01T16:34:50.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.230+0000 7f4502000640 1 Processor -- start 2024-04-01T16:34:50.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.230+0000 7efef4c00640 1 -- 172.21.15.163:0/3341831825 wait complete. 2024-04-01T16:34:50.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.230+0000 7f4502000640 1 -- start start 2024-04-01T16:34:50.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.231+0000 7efd92000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd940cd0e0 0x7efd941f3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48194/0 (socket says 172.21.15.163:48194) 2024-04-01T16:34:50.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.231+0000 7efd92000640 1 -- 172.21.15.163:0/103532801 learned_addr learned my addr 172.21.15.163:0/103532801 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.232+0000 7f4502000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f44fc06c480 0x7f44fc0c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.232+0000 7f4502000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44fc0cbce0 0x7f44fc0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.232+0000 7f4502000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44fc15b480 0x7f44fc1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.232+0000 7f4502000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc0c5580 con 0x7f44fc15b480 2024-04-01T16:34:50.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.232+0000 7f4502000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc0caf00 con 0x7f44fc0cbce0 2024-04-01T16:34:50.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.232+0000 7f4502000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f44fc0c5700 con 0x7f44fc06c480 2024-04-01T16:34:50.234 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.232+0000 7efef4c00640 1 Processor -- start 2024-04-01T16:34:50.234 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.233+0000 7efef4c00640 1 -- start start 2024-04-01T16:34:50.234 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.233+0000 7efef4c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efef00cd0e0 0x7efef0149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.234 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.233+0000 7efef4c00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efef00cd4c0 0x7efef00c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.234 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.234+0000 7efef4c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efef0154c60 0x7efef01f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.234+0000 7efef4c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efef00cc1f0 con 0x7efef0154c60 2024-04-01T16:34:50.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.234+0000 7efef4c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efef006d3d0 con 0x7efef00cd0e0 2024-04-01T16:34:50.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.234+0000 7efef4c00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7efef00cc370 con 0x7efef00cd4c0 2024-04-01T16:34:50.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.236+0000 7efd92000640 1 -- 172.21.15.163:0/103532801 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd940cadd0 msgr2=0x7efd9414f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.236+0000 7efd92000640 1 --2- 172.21.15.163:0/103532801 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efd940cadd0 0x7efd9414f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.236+0000 7efd92000640 1 -- 172.21.15.163:0/103532801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd940cd4c0 msgr2=0x7efd94148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.236+0000 7efd92000640 1 --2- 172.21.15.163:0/103532801 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd940cd4c0 0x7efd94148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.236+0000 7efd92000640 1 -- 172.21.15.163:0/103532801 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9415e480 con 0x7efd940cd0e0 2024-04-01T16:34:50.238 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.238+0000 7fdbc2a00640 1 -- 172.21.15.163:0/742846266 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8014070 con 0x7fdbcc0cedb0 2024-04-01T16:34:50.238 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.238+0000 7fdbc2a00640 1 -- 172.21.15.163:0/742846266 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbb8010610 con 0x7fdbcc0cedb0 2024-04-01T16:34:50.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.238+0000 7fdbc2a00640 1 -- 172.21.15.163:0/742846266 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8010a00 con 0x7fdbcc0cedb0 2024-04-01T16:34:50.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.238+0000 7fdbcbe00640 1 -- 172.21.15.163:0/742846266 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbcc1f1090 con 0x7fdbcc0cedb0 2024-04-01T16:34:50.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.238+0000 7fdbcbe00640 1 -- 172.21.15.163:0/742846266 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbcc1508f0 con 0x7fdbcc0cedb0 2024-04-01T16:34:50.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.239+0000 7fdbcbe00640 1 -- 172.21.15.163:0/742846266 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdbcc1f15b0 con 0x7fdbcc0cedb0 2024-04-01T16:34:50.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.241+0000 7efd92000640 1 --2- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd940cd0e0 0x7efd941f3b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efd800090b0 tx=0x7efd800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.244 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.244+0000 7f5697e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56980cd4c0 0x7f56981f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.245 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.245+0000 7f44fbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44fc15b480 0x7f44fc1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.253+0000 7f44fbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44fc15b480 0x7f44fc1504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48216/0 (socket says 172.21.15.163:48216) 2024-04-01T16:34:50.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.253+0000 7f44fbe00640 1 -- 172.21.15.163:0/1396432034 learned_addr learned my addr 172.21.15.163:0/1396432034 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.268 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.267+0000 7f5697e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56980cd4c0 0x7f56981f4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48196/0 (socket says 172.21.15.163:48196) 2024-04-01T16:34:50.268 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.267+0000 7f5697e00640 1 -- 172.21.15.163:0/3029115232 learned_addr learned my addr 172.21.15.163:0/3029115232 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.268+0000 7fdbc2a00640 1 -- 172.21.15.163:0/742846266 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdbb8017070 con 0x7fdbcc0cedb0 2024-04-01T16:34:50.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.269+0000 7fdbc2a00640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdbac06c970 0x7fdbac06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.270 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.270+0000 7fdbcaa00640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdbac06c970 0x7fdbac06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.270 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.270+0000 7fdbcaa00640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdbac06c970 0x7fdbac06ee30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc036000 tx=0x7fdbbc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.273 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.272+0000 7fdbc2a00640 1 -- 172.21.15.163:0/742846266 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7fdbb8057860 con 0x7fdbcc0cedb0 2024-04-01T16:34:50.273 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.272+0000 7fdbc2a00640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] conn(0x7fdbac074b10 0x7fdbac076f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.273 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.272+0000 7fdbc2a00640 1 -- 172.21.15.163:0/742846266 --> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbac0775e0 con 0x7fdbac074b10 2024-04-01T16:34:50.273 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.272+0000 7fdbc2a00640 1 -- 172.21.15.163:0/742846266 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdbb8055a60 con 0x7fdbcc0cedb0 2024-04-01T16:34:50.273 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.273+0000 7fdbcb400640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] conn(0x7fdbac074b10 0x7fdbac076f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.273 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.273+0000 7fdbcb400640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] conn(0x7fdbac074b10 0x7fdbac076f30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.275 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.275+0000 7fdbc2a00640 1 -- 172.21.15.163:0/742846266 <== osd.2 v2:172.21.15.163:6802/239774303 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdbac0775e0 con 0x7fdbac074b10 2024-04-01T16:34:50.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.277+0000 7f44fbe00640 1 -- 172.21.15.163:0/1396432034 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f44fc06c480 msgr2=0x7f44fc0c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.277+0000 7f44fbe00640 1 --2- 172.21.15.163:0/1396432034 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f44fc06c480 0x7f44fc0c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.277+0000 7f44fbe00640 1 -- 172.21.15.163:0/1396432034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44fc0cbce0 msgr2=0x7f44fc0c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.277+0000 7f44fbe00640 1 --2- 172.21.15.163:0/1396432034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f44fc0cbce0 0x7f44fc0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.278 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.277+0000 7f44fbe00640 1 -- 172.21.15.163:0/1396432034 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc15ec50 con 0x7f44fc15b480 2024-04-01T16:34:50.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.280+0000 7f5697e00640 1 -- 172.21.15.163:0/3029115232 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56980cadd0 msgr2=0x7f5698144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.280+0000 7f5697e00640 1 --2- 172.21.15.163:0/3029115232 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f56980cadd0 0x7f5698144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.280+0000 7f5697e00640 1 -- 172.21.15.163:0/3029115232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56980cd0e0 msgr2=0x7f56981f0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.280+0000 7f5697e00640 1 --2- 172.21.15.163:0/3029115232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56980cd0e0 0x7f56981f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.280+0000 7f5697e00640 1 -- 172.21.15.163:0/3029115232 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56981443d0 con 0x7f56980cd4c0 2024-04-01T16:34:50.284 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.284+0000 7f5697e00640 1 --2- 172.21.15.163:0/3029115232 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56980cd4c0 0x7f56981f4270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5688009960 tx=0x7f56880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.285 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.285+0000 7f44fbe00640 1 --2- 172.21.15.163:0/1396432034 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44fc15b480 0x7f44fc1504a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009e50 tx=0x7f44f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.286 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.286+0000 7fcb56a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb580c8660 0x7fcb58151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.291 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.291+0000 7efeee800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efef0154c60 0x7efef01f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.291 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.291+0000 7fcb56a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb580c8660 0x7fcb58151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48200/0 (socket says 172.21.15.163:48200) 2024-04-01T16:34:50.292 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.291+0000 7fcb56a00640 1 -- 172.21.15.163:0/699472018 learned_addr learned my addr 172.21.15.163:0/699472018 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.293+0000 7fdbcbe00640 1 -- 172.21.15.163:0/742846266 --> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdbcc0756d0 con 0x7fdbac074b10 2024-04-01T16:34:50.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.293+0000 7fdbc2a00640 1 -- 172.21.15.163:0/742846266 <== osd.2 v2:172.21.15.163:6802/239774303 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdbcc0756d0 con 0x7fdbac074b10 2024-04-01T16:34:50.294 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.293+0000 7efeee800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efef0154c60 0x7efef01f09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48220/0 (socket says 172.21.15.163:48220) 2024-04-01T16:34:50.294 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.293+0000 7efeee800640 1 -- 172.21.15.163:0/584687622 learned_addr learned my addr 172.21.15.163:0/584687622 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.293+0000 7fdbcbe00640 1 -- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] conn(0x7fdbac074b10 msgr2=0x7fdbac076f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.293+0000 7fdbcbe00640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] conn(0x7fdbac074b10 0x7fdbac076f30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.294+0000 7fdbcbe00640 1 -- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdbac06c970 msgr2=0x7fdbac06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.294+0000 7fdbcbe00640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdbac06c970 0x7fdbac06ee30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc036000 tx=0x7fdbbc030000 comp rx=0 tx=0).stop 2024-04-01T16:34:50.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.294+0000 7fdbcbe00640 1 -- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbcc0cedb0 msgr2=0x7fdbcc14e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.294+0000 7fdbcbe00640 1 --2- 172.21.15.163:0/742846266 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbcc0cedb0 0x7fdbcc14e070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800b4a0 tx=0x7fdbb800b960 comp rx=0 tx=0).stop 2024-04-01T16:34:50.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.294+0000 7fdbcb400640 1 -- 172.21.15.163:0/742846266 reap_dead start 2024-04-01T16:34:50.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.294+0000 7fdbcbe00640 1 -- 172.21.15.163:0/742846266 shutdown_connections 2024-04-01T16:34:50.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.294+0000 7fdbcbe00640 1 -- 172.21.15.163:0/742846266 >> 172.21.15.163:0/742846266 conn(0x7fdbcc067280 msgr2=0x7fdbcc0b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.296 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.294+0000 7fdbcbe00640 1 -- 172.21.15.163:0/742846266 shutdown_connections 2024-04-01T16:34:50.296 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.294+0000 7fdbcbe00640 1 -- 172.21.15.163:0/742846266 wait complete. 2024-04-01T16:34:50.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.298+0000 7fcb56a00640 1 -- 172.21.15.163:0/699472018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb580c8a40 msgr2=0x7fcb581521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.298+0000 7fcb56a00640 1 --2- 172.21.15.163:0/699472018 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcb580c8a40 0x7fcb581521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.298+0000 7fcb56a00640 1 -- 172.21.15.163:0/699472018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb58150c70 msgr2=0x7fcb580c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.298+0000 7fcb56a00640 1 --2- 172.21.15.163:0/699472018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb58150c70 0x7fcb580c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.298+0000 7fcb56a00640 1 -- 172.21.15.163:0/699472018 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5813b2c0 con 0x7fcb580c8660 2024-04-01T16:34:50.302 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.302+0000 7f6336a00640 1 -- 172.21.15.163:0/4115764292 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633002caf0 con 0x7f63380cb800 2024-04-01T16:34:50.302 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.302+0000 7f6336a00640 1 -- 172.21.15.163:0/4115764292 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633002cc90 con 0x7f63380cb800 2024-04-01T16:34:50.302 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.302+0000 7f6336a00640 1 -- 172.21.15.163:0/4115764292 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330034610 con 0x7f63380cb800 2024-04-01T16:34:50.304 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.303+0000 7f633ea00640 1 -- 172.21.15.163:0/4115764292 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63380cb800 msgr2=0x7f63380cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.304 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.303+0000 7f633ea00640 1 --2- 172.21.15.163:0/4115764292 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63380cb800 0x7f63380cbc30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f633806d840 tx=0x7f633002bf50 comp rx=0 tx=0).stop 2024-04-01T16:34:50.304 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.303+0000 7f633ea00640 1 -- 172.21.15.163:0/4115764292 shutdown_connections 2024-04-01T16:34:50.304 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.303+0000 7f633ea00640 1 --2- 172.21.15.163:0/4115764292 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f63380cb800 0x7f63380cbc30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.304 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.303+0000 7f633ea00640 1 --2- 172.21.15.163:0/4115764292 >> v2:172.21.15.163:3300/0 conn(0x7f6338154730 0x7f63380caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.304 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.303+0000 7f633ea00640 1 -- 172.21.15.163:0/4115764292 >> 172.21.15.163:0/4115764292 conn(0x7f6338067460 msgr2=0x7f6338067870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.304 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.303+0000 7f633ea00640 1 -- 172.21.15.163:0/4115764292 shutdown_connections 2024-04-01T16:34:50.304 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.303+0000 7f633ea00640 1 -- 172.21.15.163:0/4115764292 wait complete. 2024-04-01T16:34:50.305 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.304+0000 7f49c0a00640 1 -- 172.21.15.163:0/3797678738 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b0030840 con 0x7f49bc070320 2024-04-01T16:34:50.305 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.304+0000 7f49c0a00640 1 -- 172.21.15.163:0/3797678738 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0030c10 con 0x7f49bc070320 2024-04-01T16:34:50.305 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.304+0000 7efeee800640 1 -- 172.21.15.163:0/584687622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efef00cd4c0 msgr2=0x7efef00c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.306 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.304+0000 7efeee800640 1 --2- 172.21.15.163:0/584687622 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7efef00cd4c0 0x7efef00c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.306 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.304+0000 7efeee800640 1 -- 172.21.15.163:0/584687622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efef00cd0e0 msgr2=0x7efef0149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.306 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.304+0000 7efeee800640 1 --2- 172.21.15.163:0/584687622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efef00cd0e0 0x7efef0149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.306 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.304+0000 7efeee800640 1 -- 172.21.15.163:0/584687622 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef01f4740 con 0x7efef0154c60 2024-04-01T16:34:50.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.305+0000 7f49c4800640 1 -- 172.21.15.163:0/3797678738 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49bc070320 msgr2=0x7f49bc156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.305+0000 7f49c4800640 1 --2- 172.21.15.163:0/3797678738 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49bc070320 0x7f49bc156860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009870 tx=0x7f49b002b980 comp rx=0 tx=0).stop 2024-04-01T16:34:50.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.305+0000 7f49c4800640 1 -- 172.21.15.163:0/3797678738 shutdown_connections 2024-04-01T16:34:50.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.305+0000 7f49c4800640 1 --2- 172.21.15.163:0/3797678738 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49bc070320 0x7f49bc156860 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.305+0000 7f49c4800640 1 --2- 172.21.15.163:0/3797678738 >> v2:172.21.15.163:3300/0 conn(0x7f49bc0c54d0 0x7f49bc150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.305+0000 7f49c4800640 1 -- 172.21.15.163:0/3797678738 >> 172.21.15.163:0/3797678738 conn(0x7f49bc06f830 msgr2=0x7f49bc06fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.305+0000 7f49c4800640 1 -- 172.21.15.163:0/3797678738 shutdown_connections 2024-04-01T16:34:50.307 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.305+0000 7f49c4800640 1 -- 172.21.15.163:0/3797678738 wait complete. 2024-04-01T16:34:50.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.306+0000 7f633ea00640 1 Processor -- start 2024-04-01T16:34:50.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.306+0000 7f633ea00640 1 -- start start 2024-04-01T16:34:50.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.307+0000 7f49c4800640 1 Processor -- start 2024-04-01T16:34:50.309 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.307+0000 7f633ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63380cb800 0x7f63381f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.309 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.307+0000 7f633ea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6338154730 0x7f63380cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.309 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.307+0000 7f633ea00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f633815b260 0x7f6338148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.309 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.307+0000 7f49c4800640 1 -- start start 2024-04-01T16:34:50.309 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.307+0000 7f633ea00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f633806dfc0 con 0x7f6338154730 2024-04-01T16:34:50.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.307+0000 7f633ea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f633806d110 con 0x7f63380cb800 2024-04-01T16:34:50.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.307+0000 7f633ea00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f633815b6d0 con 0x7f633815b260 2024-04-01T16:34:50.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.309+0000 7f49c4800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49bc070320 0x7f49bc154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.309+0000 7f49c4800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49bc0c54d0 0x7f49bc13c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.309+0000 7f49c4800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49bc0c6c40 0x7f49bc13ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.309+0000 7f49c4800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc0c60d0 con 0x7f49bc0c6c40 2024-04-01T16:34:50.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.309+0000 7f49c4800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc0c5f50 con 0x7f49bc070320 2024-04-01T16:34:50.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.309+0000 7f49c4800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f49bc0c30f0 con 0x7f49bc0c54d0 2024-04-01T16:34:50.311 INFO:teuthology.orchestra.run.smithi163.stdout:64424509454 2024-04-01T16:34:50.312 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-01T16:34:50.316 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.315+0000 7fcb56a00640 1 --2- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb580c8660 0x7fcb58151c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb44000c00 tx=0x7fcb44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.321+0000 7f6337e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63380cb800 0x7f63381f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.322+0000 7f49c1e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49bc070320 0x7f49bc154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.322+0000 7f6337e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63380cb800 0x7f63381f4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:38286/0 (socket says 172.21.15.163:38286) 2024-04-01T16:34:50.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.322+0000 7f6337e00640 1 -- 172.21.15.163:0/3487114602 learned_addr learned my addr 172.21.15.163:0/3487114602 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.324 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.324+0000 7f49c1e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49bc070320 0x7f49bc154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:38290/0 (socket says 172.21.15.163:38290) 2024-04-01T16:34:50.324 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.324+0000 7f49c1e00640 1 -- 172.21.15.163:0/2427687146 learned_addr learned my addr 172.21.15.163:0/2427687146 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.327+0000 7f633ca00640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f633815b260 0x7f6338148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.328+0000 7efeee800640 1 --2- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efef0154c60 0x7efef01f09b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efee8009e50 tx=0x7efee8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.328+0000 7f6337e00640 1 -- 172.21.15.163:0/3487114602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f633815b260 msgr2=0x7f6338148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.328+0000 7f6337e00640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f633815b260 0x7f6338148a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.328+0000 7f6337e00640 1 -- 172.21.15.163:0/3487114602 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6338154730 msgr2=0x7f63380cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.328+0000 7f6337e00640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6338154730 0x7f63380cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.328+0000 7f6337e00640 1 -- 172.21.15.163:0/3487114602 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63380690c0 con 0x7f63380cb800 2024-04-01T16:34:50.334 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.333+0000 7f49c1400640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49bc0c54d0 0x7f49bc13c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.335 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.335+0000 7f6337e00640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63380cb800 0x7f63381f4250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f632800b4a0 tx=0x7f632800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.344+0000 7f49c1e00640 1 -- 172.21.15.163:0/2427687146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49bc0c54d0 msgr2=0x7f49bc13c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.344+0000 7f49c1e00640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f49bc0c54d0 0x7f49bc13c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.344+0000 7f49c1e00640 1 -- 172.21.15.163:0/2427687146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49bc0c6c40 msgr2=0x7f49bc13ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.344+0000 7f49c1e00640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49bc0c6c40 0x7f49bc13ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.344+0000 7f49c1e00640 1 -- 172.21.15.163:0/2427687146 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc13a870 con 0x7f49bc070320 2024-04-01T16:34:50.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.357+0000 7f632fe00640 1 -- 172.21.15.163:0/3487114602 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328014070 con 0x7f63380cb800 2024-04-01T16:34:50.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.357+0000 7f632fe00640 1 -- 172.21.15.163:0/3487114602 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6328010610 con 0x7f63380cb800 2024-04-01T16:34:50.358 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.357+0000 7f632fe00640 1 -- 172.21.15.163:0/3487114602 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328010a00 con 0x7f63380cb800 2024-04-01T16:34:50.358 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.357+0000 7f633ea00640 1 -- 172.21.15.163:0/3487114602 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63380c7ab0 con 0x7f63380cb800 2024-04-01T16:34:50.358 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.357+0000 7f633ea00640 1 -- 172.21.15.163:0/3487114602 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633815a3b0 con 0x7f63380cb800 2024-04-01T16:34:50.358 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.358+0000 7f633ea00640 1 -- 172.21.15.163:0/3487114602 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f63381f3e30 con 0x7f63380cb800 2024-04-01T16:34:50.359 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.358+0000 7f49c1e00640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49bc070320 0x7f49bc154c00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f49a800b4a0 tx=0x7f49a800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.370+0000 7efd8b400640 1 -- 172.21.15.163:0/103532801 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8003ad60 con 0x7efd940cd0e0 2024-04-01T16:34:50.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.370+0000 7efd8b400640 1 -- 172.21.15.163:0/103532801 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd800443f0 con 0x7efd940cd0e0 2024-04-01T16:34:50.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.370+0000 7efd8b400640 1 -- 172.21.15.163:0/103532801 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd800447e0 con 0x7efd940cd0e0 2024-04-01T16:34:50.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.370+0000 7efd99e00640 1 -- 172.21.15.163:0/103532801 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd940cdff0 con 0x7efd940cd0e0 2024-04-01T16:34:50.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.371+0000 7efd99e00640 1 -- 172.21.15.163:0/103532801 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd941f3630 con 0x7efd940cd0e0 2024-04-01T16:34:50.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.371+0000 7efd99e00640 1 -- 172.21.15.163:0/103532801 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd941eff20 con 0x7efd940cd0e0 2024-04-01T16:34:50.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.379+0000 7f568f400640 1 -- 172.21.15.163:0/3029115232 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688040070 con 0x7f56980cd4c0 2024-04-01T16:34:50.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.380+0000 7f568f400640 1 -- 172.21.15.163:0/3029115232 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f568803a420 con 0x7f56980cd4c0 2024-04-01T16:34:50.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.380+0000 7f569e800640 1 -- 172.21.15.163:0/3029115232 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56981446b0 con 0x7f56980cd4c0 2024-04-01T16:34:50.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.380+0000 7f568f400640 1 -- 172.21.15.163:0/3029115232 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688035040 con 0x7f56980cd4c0 2024-04-01T16:34:50.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.380+0000 7f569e800640 1 -- 172.21.15.163:0/3029115232 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56981f0640 con 0x7f56980cd4c0 2024-04-01T16:34:50.381 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.381+0000 7f569e800640 1 -- 172.21.15.163:0/3029115232 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f56980756d0 con 0x7f56980cd4c0 2024-04-01T16:34:50.404 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.403+0000 7fcb4ea00640 1 -- 172.21.15.163:0/699472018 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44048070 con 0x7fcb580c8660 2024-04-01T16:34:50.404 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.404+0000 7fcb4ea00640 1 -- 172.21.15.163:0/699472018 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb44030660 con 0x7fcb580c8660 2024-04-01T16:34:50.404 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.404+0000 7fcb57e00640 1 -- 172.21.15.163:0/699472018 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5813a030 con 0x7fcb580c8660 2024-04-01T16:34:50.404 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.404+0000 7fcb4ea00640 1 -- 172.21.15.163:0/699472018 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44034040 con 0x7fcb580c8660 2024-04-01T16:34:50.404 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.404+0000 7fcb57e00640 1 -- 172.21.15.163:0/699472018 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb5813afe0 con 0x7fcb580c8660 2024-04-01T16:34:50.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.405+0000 7fcb57e00640 1 -- 172.21.15.163:0/699472018 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcb580756d0 con 0x7fcb580c8660 2024-04-01T16:34:50.406 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.405+0000 7f44f3400640 1 -- 172.21.15.163:0/1396432034 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4043020 con 0x7f44fc15b480 2024-04-01T16:34:50.406 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.405+0000 7f44f3400640 1 -- 172.21.15.163:0/1396432034 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f403e450 con 0x7f44fc15b480 2024-04-01T16:34:50.406 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.405+0000 7f44f3400640 1 -- 172.21.15.163:0/1396432034 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4009510 con 0x7f44fc15b480 2024-04-01T16:34:50.406 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.405+0000 7f632fe00640 1 -- 172.21.15.163:0/3487114602 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6328017070 con 0x7f63380cb800 2024-04-01T16:34:50.407 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.405+0000 7f4502000640 1 -- 172.21.15.163:0/1396432034 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44fc0c8420 con 0x7f44fc15b480 2024-04-01T16:34:50.407 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.405+0000 7f4502000640 1 -- 172.21.15.163:0/1396432034 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44fc0c89e0 con 0x7f44fc15b480 2024-04-01T16:34:50.407 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.406+0000 7f632fe00640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f631806c940 0x7f631806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.407 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.407+0000 7f4502000640 1 -- 172.21.15.163:0/1396432034 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f44fc0c81d0 con 0x7f44fc15b480 2024-04-01T16:34:50.408 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.407+0000 7f6337400640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f631806c940 0x7f631806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.408 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.407+0000 7f6337400640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f631806c940 0x7f631806ee00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f63381f1290 tx=0x7f6324006ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.410+0000 7f632fe00640 1 -- 172.21.15.163:0/3487114602 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f6328057960 con 0x7f63380cb800 2024-04-01T16:34:50.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.410+0000 7f632fe00640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] conn(0x7f6318074b40 0x7f6318076f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.410+0000 7f632fe00640 1 -- 172.21.15.163:0/3487114602 --> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6318077610 con 0x7f6318074b40 2024-04-01T16:34:50.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.410+0000 7f632fe00640 1 -- 172.21.15.163:0/3487114602 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6328055b60 con 0x7f63380cb800 2024-04-01T16:34:50.411 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.410+0000 7f633ca00640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] conn(0x7f6318074b40 0x7f6318076f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.411 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.411+0000 7f633ca00640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] conn(0x7f6318074b40 0x7f6318076f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.413 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.413+0000 7f632fe00640 1 -- 172.21.15.163:0/3487114602 <== osd.4 v2:172.21.15.189:6814/4109894803 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6318077610 con 0x7f6318074b40 2024-04-01T16:34:50.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.418+0000 7f49b6000640 1 -- 172.21.15.163:0/2427687146 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8014070 con 0x7f49bc070320 2024-04-01T16:34:50.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.418+0000 7f49b6000640 1 -- 172.21.15.163:0/2427687146 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a8010610 con 0x7f49bc070320 2024-04-01T16:34:50.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.418+0000 7f49b6000640 1 -- 172.21.15.163:0/2427687146 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8010a00 con 0x7f49bc070320 2024-04-01T16:34:50.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.418+0000 7f49c4800640 1 -- 172.21.15.163:0/2427687146 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49bc14eeb0 con 0x7f49bc070320 2024-04-01T16:34:50.419 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.418+0000 7f49c4800640 1 -- 172.21.15.163:0/2427687146 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49bc150020 con 0x7f49bc070320 2024-04-01T16:34:50.419 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.419+0000 7f49c4800640 1 -- 172.21.15.163:0/2427687146 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49bc0756d0 con 0x7f49bc070320 2024-04-01T16:34:50.426 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.425+0000 7efee6000640 1 -- 172.21.15.163:0/584687622 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee8043020 con 0x7efef0154c60 2024-04-01T16:34:50.426 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.425+0000 7efee6000640 1 -- 172.21.15.163:0/584687622 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee803e450 con 0x7efef0154c60 2024-04-01T16:34:50.426 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.425+0000 7efee6000640 1 -- 172.21.15.163:0/584687622 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee8009510 con 0x7efef0154c60 2024-04-01T16:34:50.426 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.425+0000 7efef4c00640 1 -- 172.21.15.163:0/584687622 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef01f3bc0 con 0x7efef0154c60 2024-04-01T16:34:50.426 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.425+0000 7efef4c00640 1 -- 172.21.15.163:0/584687622 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef01f4180 con 0x7efef0154c60 2024-04-01T16:34:50.426 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.426+0000 7efd8b400640 1 -- 172.21.15.163:0/103532801 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd80038020 con 0x7efd940cd0e0 2024-04-01T16:34:50.426 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.426+0000 7efef4c00640 1 -- 172.21.15.163:0/584687622 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efef00756d0 con 0x7efef0154c60 2024-04-01T16:34:50.427 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.427+0000 7efd8b400640 1 --2- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efd7406c970 0x7efd7406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.428 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.428+0000 7efd92a00640 1 --2- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efd7406c970 0x7efd7406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.428 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.428+0000 7efd92a00640 1 --2- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efd7406c970 0x7efd7406ee30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efd84009710 tx=0x7efd84006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.431+0000 7efd8b400640 1 -- 172.21.15.163:0/103532801 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7efd8007a8a0 con 0x7efd940cd0e0 2024-04-01T16:34:50.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.431+0000 7efd8b400640 1 --2- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] conn(0x7efd74074b70 0x7efd74076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.431+0000 7efd8b400640 1 -- 172.21.15.163:0/103532801 --> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd80045ec0 con 0x7efd74074b70 2024-04-01T16:34:50.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.431+0000 7efd8b400640 1 -- 172.21.15.163:0/103532801 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efd80078aa0 con 0x7efd940cd0e0 2024-04-01T16:34:50.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.432+0000 7efd93400640 1 --2- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] conn(0x7efd74074b70 0x7efd74076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.432+0000 7efd93400640 1 --2- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] conn(0x7efd74074b70 0x7efd74076f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.433 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.433+0000 7efd8b400640 1 -- 172.21.15.163:0/103532801 <== osd.1 v2:172.21.15.163:6817/1379211103 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd80045ec0 con 0x7efd74074b70 2024-04-01T16:34:50.440 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.439+0000 7f633ea00640 1 -- 172.21.15.163:0/3487114602 --> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f63380756d0 con 0x7f6318074b40 2024-04-01T16:34:50.441 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.441+0000 7f632fe00640 1 -- 172.21.15.163:0/3487114602 <== osd.4 v2:172.21.15.189:6814/4109894803 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f63380756d0 con 0x7f6318074b40 2024-04-01T16:34:50.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.441+0000 7f633ea00640 1 -- 172.21.15.163:0/3487114602 >> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] conn(0x7f6318074b40 msgr2=0x7f6318076f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.441+0000 7f633ea00640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] conn(0x7f6318074b40 0x7f6318076f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.441+0000 7f633ea00640 1 -- 172.21.15.163:0/3487114602 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f631806c940 msgr2=0x7f631806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.441+0000 7f633ea00640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f631806c940 0x7f631806ee00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f63381f1290 tx=0x7f6324006ba0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.441+0000 7f633ea00640 1 -- 172.21.15.163:0/3487114602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63380cb800 msgr2=0x7f63381f4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.441+0000 7f633ea00640 1 --2- 172.21.15.163:0/3487114602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63380cb800 0x7f63381f4250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f632800b4a0 tx=0x7f632800b960 comp rx=0 tx=0).stop 2024-04-01T16:34:50.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.441+0000 7f633ca00640 1 -- 172.21.15.163:0/3487114602 reap_dead start 2024-04-01T16:34:50.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.442+0000 7f633ea00640 1 -- 172.21.15.163:0/3487114602 shutdown_connections 2024-04-01T16:34:50.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.442+0000 7f633ea00640 1 -- 172.21.15.163:0/3487114602 >> 172.21.15.163:0/3487114602 conn(0x7f6338067460 msgr2=0x7f63381528d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.442+0000 7f633ea00640 1 -- 172.21.15.163:0/3487114602 shutdown_connections 2024-04-01T16:34:50.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.442+0000 7f633ea00640 1 -- 172.21.15.163:0/3487114602 wait complete. 2024-04-01T16:34:50.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.449+0000 7efd99e00640 1 -- 172.21.15.163:0/103532801 --> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd9415e930 con 0x7efd74074b70 2024-04-01T16:34:50.450 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.450+0000 7efd8b400640 1 -- 172.21.15.163:0/103532801 <== osd.1 v2:172.21.15.163:6817/1379211103 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efd9415e930 con 0x7efd74074b70 2024-04-01T16:34:50.450 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.450+0000 7f568f400640 1 -- 172.21.15.163:0/3029115232 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5688038020 con 0x7f56980cd4c0 2024-04-01T16:34:50.451 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.450+0000 7efd99e00640 1 -- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] conn(0x7efd74074b70 msgr2=0x7efd74076f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.451 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.450+0000 7efd99e00640 1 --2- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] conn(0x7efd74074b70 0x7efd74076f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.451 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.450+0000 7efd99e00640 1 -- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efd7406c970 msgr2=0x7efd7406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.451 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.450+0000 7efd99e00640 1 --2- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efd7406c970 0x7efd7406ee30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efd84009710 tx=0x7efd84006c90 comp rx=0 tx=0).stop 2024-04-01T16:34:50.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.450+0000 7efd99e00640 1 -- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd940cd0e0 msgr2=0x7efd941f3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.450+0000 7efd99e00640 1 --2- 172.21.15.163:0/103532801 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd940cd0e0 0x7efd941f3b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efd800090b0 tx=0x7efd800046c0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.451+0000 7efd93400640 1 -- 172.21.15.163:0/103532801 reap_dead start 2024-04-01T16:34:50.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.451+0000 7efd99e00640 1 -- 172.21.15.163:0/103532801 shutdown_connections 2024-04-01T16:34:50.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.451+0000 7efd99e00640 1 -- 172.21.15.163:0/103532801 >> 172.21.15.163:0/103532801 conn(0x7efd94067460 msgr2=0x7efd94159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.451+0000 7efd99e00640 1 -- 172.21.15.163:0/103532801 shutdown_connections 2024-04-01T16:34:50.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.451+0000 7efd99e00640 1 -- 172.21.15.163:0/103532801 wait complete. 2024-04-01T16:34:50.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.452+0000 7f568f400640 1 --2- 172.21.15.163:0/3029115232 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f567806c940 0x7f567806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.452+0000 7f5697400640 1 --2- 172.21.15.163:0/3029115232 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f567806c940 0x7f567806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.456 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.455+0000 7f5697400640 1 --2- 172.21.15.163:0/3029115232 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f567806c940 0x7f567806ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f569000ab90 tx=0x7f5690009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.459 INFO:teuthology.orchestra.run.smithi163.stdout:64424509452 2024-04-01T16:34:50.460 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-01T16:34:50.465 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.464+0000 7f568f400640 1 -- 172.21.15.163:0/3029115232 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f568807a2f0 con 0x7f56980cd4c0 2024-04-01T16:34:50.465 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.464+0000 7f568f400640 1 --2- 172.21.15.163:0/3029115232 >> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] conn(0x7f5678074b40 0x7f5678076f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.465 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.464+0000 7f568f400640 1 -- 172.21.15.163:0/3029115232 --> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5688045ec0 con 0x7f5678074b40 2024-04-01T16:34:50.465 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.464+0000 7f568f400640 1 -- 172.21.15.163:0/3029115232 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f56880784f0 con 0x7f56980cd4c0 2024-04-01T16:34:50.469 INFO:teuthology.orchestra.run.smithi163.stdout:60129542158 2024-04-01T16:34:50.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.465+0000 7f5696a00640 1 --2- 172.21.15.163:0/3029115232 >> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] conn(0x7f5678074b40 0x7f5678076f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.466+0000 7f5696a00640 1 --2- 172.21.15.163:0/3029115232 >> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] conn(0x7f5678074b40 0x7f5678076f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.470 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-01T16:34:50.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.468+0000 7f568f400640 1 -- 172.21.15.163:0/3029115232 <== osd.5 v2:172.21.15.189:6800/1777830067 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5688045ec0 con 0x7f5678074b40 2024-04-01T16:34:50.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.480+0000 7f44f3400640 1 -- 172.21.15.163:0/1396432034 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f44f4046020 con 0x7f44fc15b480 2024-04-01T16:34:50.485 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.481+0000 7f49b6000640 1 -- 172.21.15.163:0/2427687146 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49a8017070 con 0x7f49bc070320 2024-04-01T16:34:50.485 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.482+0000 7f49b6000640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f499c06c970 0x7f499c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.485 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.483+0000 7f49c1400640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f499c06c970 0x7f499c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.485 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.483+0000 7f49c1400640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f499c06c970 0x7f499c06ee30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f49b0036000 tx=0x7f49b0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.486 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.481+0000 7f44f3400640 1 --2- 172.21.15.163:0/1396432034 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f44dc06c940 0x7f44dc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.486 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.482+0000 7f44fb400640 1 --2- 172.21.15.163:0/1396432034 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f44dc06c940 0x7f44dc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.486 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.483+0000 7f44fb400640 1 --2- 172.21.15.163:0/1396432034 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f44dc06c940 0x7f44dc06ee00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f44ec001560 tx=0x7f44ec007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.487 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.487+0000 7f569e800640 1 -- 172.21.15.163:0/3029115232 --> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f56980cb2e0 con 0x7f5678074b40 2024-04-01T16:34:50.488 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.488+0000 7f568f400640 1 -- 172.21.15.163:0/3029115232 <== osd.5 v2:172.21.15.189:6800/1777830067 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f56980cb2e0 con 0x7f5678074b40 2024-04-01T16:34:50.489 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.489+0000 7f569e800640 1 -- 172.21.15.163:0/3029115232 >> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] conn(0x7f5678074b40 msgr2=0x7f5678076f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.489 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.489+0000 7f569e800640 1 --2- 172.21.15.163:0/3029115232 >> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] conn(0x7f5678074b40 0x7f5678076f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.489+0000 7f569e800640 1 -- 172.21.15.163:0/3029115232 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f567806c940 msgr2=0x7f567806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.489+0000 7f569e800640 1 --2- 172.21.15.163:0/3029115232 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f567806c940 0x7f567806ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f569000ab90 tx=0x7f5690009250 comp rx=0 tx=0).stop 2024-04-01T16:34:50.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.489+0000 7f569e800640 1 -- 172.21.15.163:0/3029115232 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56980cd4c0 msgr2=0x7f56981f4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.489+0000 7f569e800640 1 --2- 172.21.15.163:0/3029115232 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56980cd4c0 0x7f56981f4270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5688009960 tx=0x7f56880046c0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.489+0000 7f5697e00640 1 -- 172.21.15.163:0/3029115232 reap_dead start 2024-04-01T16:34:50.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.489+0000 7f569e800640 1 -- 172.21.15.163:0/3029115232 shutdown_connections 2024-04-01T16:34:50.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.489+0000 7f569e800640 1 -- 172.21.15.163:0/3029115232 >> 172.21.15.163:0/3029115232 conn(0x7f5698067460 msgr2=0x7f56980c5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.489+0000 7f569e800640 1 -- 172.21.15.163:0/3029115232 shutdown_connections 2024-04-01T16:34:50.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.489+0000 7f569e800640 1 -- 172.21.15.163:0/3029115232 wait complete. 2024-04-01T16:34:50.491 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.490+0000 7f49b6000640 1 -- 172.21.15.163:0/2427687146 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f49a8057860 con 0x7f49bc070320 2024-04-01T16:34:50.491 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.491+0000 7f49b6000640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] conn(0x7f499c074b70 0x7f499c076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.491 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.491+0000 7fc6c9400640 1 Processor -- start 2024-04-01T16:34:50.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.491+0000 7f49b6000640 1 -- 172.21.15.163:0/2427687146 --> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f499c077640 con 0x7f499c074b70 2024-04-01T16:34:50.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.491+0000 7f49b6000640 1 -- 172.21.15.163:0/2427687146 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f49a8055a60 con 0x7f49bc070320 2024-04-01T16:34:50.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.491+0000 7fc6c9400640 1 -- start start 2024-04-01T16:34:50.492 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.491+0000 7f49c2800640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] conn(0x7f499c074b70 0x7f499c076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.493+0000 7f49c2800640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] conn(0x7f499c074b70 0x7f499c076f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.492+0000 7fc6c9400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 0x7fc6c406c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.492+0000 7fc6c9400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fc6c40cc260 0x7fc6c406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.492+0000 7fc6c9400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6c415b960 con 0x7fc6c4154f00 2024-04-01T16:34:50.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.492+0000 7fc6c9400640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fc6c415b430 con 0x7fc6c40cc260 2024-04-01T16:34:50.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.492+0000 7fc6c9400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c40cb3d0 con 0x7fc6c406d500 2024-04-01T16:34:50.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.495+0000 7fc6c1e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 0x7fc6c406c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.496 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.496+0000 7f49b6000640 1 -- 172.21.15.163:0/2427687146 <== osd.6 v2:172.21.15.189:6809/4014790814 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f499c077640 con 0x7f499c074b70 2024-04-01T16:34:50.496 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.496+0000 7fc6c1e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 0x7fc6c406c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:46994/0 (socket says 172.21.15.163:46994) 2024-04-01T16:34:50.496 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.496+0000 7fc6c1e00640 1 -- 172.21.15.163:0/3156946669 learned_addr learned my addr 172.21.15.163:0/3156946669 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.498 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.498+0000 7fc6c3200640 1 --2- 172.21.15.163:0/3156946669 >> v2:172.21.15.189:3300/0 conn(0x7fc6c40cc260 0x7fc6c406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.503 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.502+0000 7fc6c1e00640 1 -- 172.21.15.163:0/3156946669 >> v2:172.21.15.189:3300/0 conn(0x7fc6c40cc260 msgr2=0x7fc6c406ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.503 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.502+0000 7fc6c1e00640 1 --2- 172.21.15.163:0/3156946669 >> v2:172.21.15.189:3300/0 conn(0x7fc6c40cc260 0x7fc6c406ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.503 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.502+0000 7fc6c1e00640 1 -- 172.21.15.163:0/3156946669 >> v1:172.21.15.163:6789/0 conn(0x7fc6c4154f00 legacy=0x7fc6c40cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.503 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.502+0000 7fc6c1e00640 1 -- 172.21.15.163:0/3156946669 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c415b680 con 0x7fc6c406d500 2024-04-01T16:34:50.511 INFO:teuthology.orchestra.run.smithi163.stdout:64424509451 2024-04-01T16:34:50.511 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-01T16:34:50.513 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.513+0000 7fc6c1e00640 1 --2- 172.21.15.163:0/3156946669 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 0x7fc6c406c8d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009870 tx=0x7fc6b002b7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=380c626809f066da server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.517 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.516+0000 7f49c4800640 1 -- 172.21.15.163:0/2427687146 --> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49bc06c070 con 0x7f499c074b70 2024-04-01T16:34:50.517 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.517+0000 7f49b6000640 1 -- 172.21.15.163:0/2427687146 <== osd.6 v2:172.21.15.189:6809/4014790814 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f49bc06c070 con 0x7f499c074b70 2024-04-01T16:34:50.518 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.517+0000 7f49c4800640 1 -- 172.21.15.163:0/2427687146 >> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] conn(0x7f499c074b70 msgr2=0x7f499c076f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.518 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.517+0000 7f49c4800640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] conn(0x7f499c074b70 0x7f499c076f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.519 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.518+0000 7f49c4800640 1 -- 172.21.15.163:0/2427687146 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f499c06c970 msgr2=0x7f499c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.519 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.518+0000 7f49c4800640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f499c06c970 0x7f499c06ee30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f49b0036000 tx=0x7f49b0008030 comp rx=0 tx=0).stop 2024-04-01T16:34:50.519 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.518+0000 7f49c4800640 1 -- 172.21.15.163:0/2427687146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49bc070320 msgr2=0x7f49bc154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.519 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.518+0000 7f49c4800640 1 --2- 172.21.15.163:0/2427687146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49bc070320 0x7f49bc154c00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f49a800b4a0 tx=0x7f49a800b960 comp rx=0 tx=0).stop 2024-04-01T16:34:50.519 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.518+0000 7f49c2800640 1 -- 172.21.15.163:0/2427687146 reap_dead start 2024-04-01T16:34:50.519 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.518+0000 7f49c4800640 1 -- 172.21.15.163:0/2427687146 shutdown_connections 2024-04-01T16:34:50.519 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.518+0000 7f49c4800640 1 -- 172.21.15.163:0/2427687146 >> 172.21.15.163:0/2427687146 conn(0x7f49bc06f830 msgr2=0x7f49bc06b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.519 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.518+0000 7f49c4800640 1 -- 172.21.15.163:0/2427687146 shutdown_connections 2024-04-01T16:34:50.519 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.518+0000 7f49c4800640 1 -- 172.21.15.163:0/2427687146 wait complete. 2024-04-01T16:34:50.520 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.520+0000 7fc6c1400640 1 -- 172.21.15.163:0/3156946669 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0038070 con 0x7fc6c406d500 2024-04-01T16:34:50.524 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.523+0000 7f44f3400640 1 -- 172.21.15.163:0/1396432034 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f44f407a8a0 con 0x7f44fc15b480 2024-04-01T16:34:50.524 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.524+0000 7f44f3400640 1 --2- 172.21.15.163:0/1396432034 >> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] conn(0x7f44dc074b40 0x7f44dc076f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.524 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.524+0000 7f44f3400640 1 -- 172.21.15.163:0/1396432034 --> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44f4035e90 con 0x7f44dc074b40 2024-04-01T16:34:50.524 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.524+0000 7f44f3400640 1 -- 172.21.15.163:0/1396432034 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f44f4078aa0 con 0x7f44fc15b480 2024-04-01T16:34:50.525 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.525+0000 7fcb4ea00640 1 -- 172.21.15.163:0/699472018 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb4404b070 con 0x7fcb580c8660 2024-04-01T16:34:50.527 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.526+0000 7fcb4ea00640 1 --2- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fcb3806c940 0x7fcb3806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.527 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.527+0000 7fcb56000640 1 --2- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fcb3806c940 0x7fcb3806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.527 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.525+0000 7f44faa00640 1 --2- 172.21.15.163:0/1396432034 >> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] conn(0x7f44dc074b40 0x7f44dc076f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.526+0000 7f44faa00640 1 --2- 172.21.15.163:0/1396432034 >> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] conn(0x7f44dc074b40 0x7f44dc076f60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.528+0000 7f44f3400640 1 -- 172.21.15.163:0/1396432034 <== osd.7 v2:172.21.15.189:6808/2925885107 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f44f4035e90 con 0x7f44dc074b40 2024-04-01T16:34:50.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.528+0000 7fcb56000640 1 --2- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fcb3806c940 0x7fcb3806ee00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb5813b6d0 tx=0x7fcb48007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.531+0000 7fc6c1400640 1 -- 172.21.15.163:0/3156946669 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b0033620 con 0x7fc6c406d500 2024-04-01T16:34:50.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.531+0000 7fc6c1400640 1 -- 172.21.15.163:0/3156946669 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00339f0 con 0x7fc6c406d500 2024-04-01T16:34:50.532 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.531+0000 7fcb4ea00640 1 -- 172.21.15.163:0/699472018 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7fcb44030810 con 0x7fcb580c8660 2024-04-01T16:34:50.532 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.531+0000 7fcb4ea00640 1 --2- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] conn(0x7fcb38074b40 0x7fcb38076f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.532 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.532+0000 7fcb4ea00640 1 -- 172.21.15.163:0/699472018 --> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb38077610 con 0x7fcb38074b40 2024-04-01T16:34:50.532 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.532+0000 7fcb4ea00640 1 -- 172.21.15.163:0/699472018 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcb44078470 con 0x7fcb580c8660 2024-04-01T16:34:50.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.532+0000 7fc6c9400640 1 -- 172.21.15.163:0/3156946669 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 msgr2=0x7fc6c406c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.532+0000 7fc6c9400640 1 --2- 172.21.15.163:0/3156946669 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 0x7fc6c406c8d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009870 tx=0x7fc6b002b7d0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.532+0000 7fc6c9400640 1 -- 172.21.15.163:0/3156946669 shutdown_connections 2024-04-01T16:34:50.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.533+0000 7fc6c9400640 1 --2- 172.21.15.163:0/3156946669 >> v2:172.21.15.189:3300/0 conn(0x7fc6c40cc260 0x7fc6c406ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.533+0000 7fc6c9400640 1 --2- 172.21.15.163:0/3156946669 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 0x7fc6c406c8d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.533+0000 7fc6c9400640 1 -- 172.21.15.163:0/3156946669 >> 172.21.15.163:0/3156946669 conn(0x7fc6c40d01d0 msgr2=0x7fc6c40d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.534 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.532+0000 7fcb57400640 1 --2- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] conn(0x7fcb38074b40 0x7fcb38076f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.534 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.533+0000 7fc6c9400640 1 -- 172.21.15.163:0/3156946669 shutdown_connections 2024-04-01T16:34:50.534 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.533+0000 7fc6c9400640 1 -- 172.21.15.163:0/3156946669 wait complete. 2024-04-01T16:34:50.534 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.534+0000 7fcb57400640 1 --2- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] conn(0x7fcb38074b40 0x7fcb38076f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.536 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.536+0000 7fc6c9400640 1 Processor -- start 2024-04-01T16:34:50.537 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.536+0000 7fcb4ea00640 1 -- 172.21.15.163:0/699472018 <== osd.3 v2:172.21.15.163:6816/3700943422 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb38077610 con 0x7fcb38074b40 2024-04-01T16:34:50.537 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.536+0000 7fc6c9400640 1 -- start start 2024-04-01T16:34:50.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.538+0000 7fc6c9400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 0x7fc6c406f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.538+0000 7fc6c9400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6c40cc260 0x7fc6c415e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.538+0000 7fc6c9400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4154f00 0x7fc6c41f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.539 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.538+0000 7fc6c9400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c40cb060 con 0x7fc6c40cc260 2024-04-01T16:34:50.539 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.539+0000 7fc6c9400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c40cad80 con 0x7fc6c4154f00 2024-04-01T16:34:50.539 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.539+0000 7fc6c9400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c40c5580 con 0x7fc6c406d500 2024-04-01T16:34:50.540 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.540+0000 7fc6c2800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 0x7fc6c406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.540 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.540+0000 7fc6c3200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4154f00 0x7fc6c41f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.542 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.540+0000 7fc6c3200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4154f00 0x7fc6c41f7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:38308/0 (socket says 172.21.15.163:38308) 2024-04-01T16:34:50.542 INFO:teuthology.orchestra.run.smithi163.stdout:60129542157 2024-04-01T16:34:50.543 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-01T16:34:50.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.541+0000 7fc6c2800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 0x7fc6c406f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:47008/0 (socket says 172.21.15.163:47008) 2024-04-01T16:34:50.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.541+0000 7fc6c2800640 1 -- 172.21.15.163:0/4160619302 learned_addr learned my addr 172.21.15.163:0/4160619302 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.551 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.550+0000 7fc6c3200640 1 -- 172.21.15.163:0/4160619302 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 msgr2=0x7fc6c406f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.551 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.550+0000 7fc6c3200640 1 --2- 172.21.15.163:0/4160619302 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 0x7fc6c406f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.551 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.550+0000 7fc6c3200640 1 -- 172.21.15.163:0/4160619302 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6c40cc260 msgr2=0x7fc6c415e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.551 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.550+0000 7fc6c3200640 1 --2- 172.21.15.163:0/4160619302 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6c40cc260 0x7fc6c415e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.551 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.550+0000 7fc6c3200640 1 -- 172.21.15.163:0/4160619302 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c41f6c90 con 0x7fc6c4154f00 2024-04-01T16:34:50.556 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.556+0000 7fc6c3200640 1 --2- 172.21.15.163:0/4160619302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4154f00 0x7fc6c41f7ff0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00eb70 tx=0x7fc6bc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.559+0000 7f4502000640 1 -- 172.21.15.163:0/1396432034 --> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f44fc06d4f0 con 0x7f44dc074b40 2024-04-01T16:34:50.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.560+0000 7f44f3400640 1 -- 172.21.15.163:0/1396432034 <== osd.7 v2:172.21.15.189:6808/2925885107 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f44fc06d4f0 con 0x7f44dc074b40 2024-04-01T16:34:50.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.560+0000 7f4502000640 1 -- 172.21.15.163:0/1396432034 >> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] conn(0x7f44dc074b40 msgr2=0x7f44dc076f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.560+0000 7f4502000640 1 --2- 172.21.15.163:0/1396432034 >> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] conn(0x7f44dc074b40 0x7f44dc076f60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.560+0000 7f4502000640 1 -- 172.21.15.163:0/1396432034 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f44dc06c940 msgr2=0x7f44dc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.560+0000 7f4502000640 1 --2- 172.21.15.163:0/1396432034 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f44dc06c940 0x7f44dc06ee00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f44ec001560 tx=0x7f44ec007990 comp rx=0 tx=0).stop 2024-04-01T16:34:50.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.560+0000 7f4502000640 1 -- 172.21.15.163:0/1396432034 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44fc15b480 msgr2=0x7f44fc1504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.560+0000 7f4502000640 1 --2- 172.21.15.163:0/1396432034 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44fc15b480 0x7f44fc1504a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009e50 tx=0x7f44f4004a40 comp rx=0 tx=0).stop 2024-04-01T16:34:50.562 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.561+0000 7f44fbe00640 1 -- 172.21.15.163:0/1396432034 reap_dead start 2024-04-01T16:34:50.562 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.561+0000 7f4502000640 1 -- 172.21.15.163:0/1396432034 shutdown_connections 2024-04-01T16:34:50.562 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.561+0000 7f4502000640 1 -- 172.21.15.163:0/1396432034 >> 172.21.15.163:0/1396432034 conn(0x7f44fc0678b0 msgr2=0x7f44fc0b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.562+0000 7fcb57e00640 1 -- 172.21.15.163:0/699472018 --> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcb58073390 con 0x7fcb38074b40 2024-04-01T16:34:50.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.562+0000 7f4502000640 1 -- 172.21.15.163:0/1396432034 shutdown_connections 2024-04-01T16:34:50.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.563+0000 7f4502000640 1 -- 172.21.15.163:0/1396432034 wait complete. 2024-04-01T16:34:50.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.563+0000 7efee6000640 1 -- 172.21.15.163:0/584687622 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efee8046020 con 0x7efef0154c60 2024-04-01T16:34:50.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.564+0000 7fcb4ea00640 1 -- 172.21.15.163:0/699472018 <== osd.3 v2:172.21.15.163:6816/3700943422 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcb58073390 con 0x7fcb38074b40 2024-04-01T16:34:50.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.565+0000 7fcb57e00640 1 -- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] conn(0x7fcb38074b40 msgr2=0x7fcb38076f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.565+0000 7fcb57e00640 1 --2- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] conn(0x7fcb38074b40 0x7fcb38076f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.565+0000 7efee6000640 1 --2- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efed006c940 0x7efed006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7fcb57e00640 1 -- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fcb3806c940 msgr2=0x7fcb3806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7fcb57e00640 1 --2- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fcb3806c940 0x7fcb3806ee00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb5813b6d0 tx=0x7fcb48007990 comp rx=0 tx=0).stop 2024-04-01T16:34:50.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7fcb57e00640 1 -- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb580c8660 msgr2=0x7fcb58151c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7fcb57e00640 1 --2- 172.21.15.163:0/699472018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb580c8660 0x7fcb58151c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb44000c00 tx=0x7fcb44004730 comp rx=0 tx=0).stop 2024-04-01T16:34:50.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7fcb57400640 1 -- 172.21.15.163:0/699472018 reap_dead start 2024-04-01T16:34:50.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7efeede00640 1 --2- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efed006c940 0x7efed006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7fc6baa00640 1 -- 172.21.15.163:0/4160619302 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc018020 con 0x7fc6c4154f00 2024-04-01T16:34:50.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7fc6baa00640 1 -- 172.21.15.163:0/4160619302 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6bc00cd20 con 0x7fc6c4154f00 2024-04-01T16:34:50.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7fc6baa00640 1 -- 172.21.15.163:0/4160619302 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0146c0 con 0x7fc6c4154f00 2024-04-01T16:34:50.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7fc6c9400640 1 -- 172.21.15.163:0/4160619302 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c406fac0 con 0x7fc6c4154f00 2024-04-01T16:34:50.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7fc6c9400640 1 -- 172.21.15.163:0/4160619302 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c41f7230 con 0x7fc6c4154f00 2024-04-01T16:34:50.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7fcb57e00640 1 -- 172.21.15.163:0/699472018 shutdown_connections 2024-04-01T16:34:50.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.566+0000 7fcb57e00640 1 -- 172.21.15.163:0/699472018 >> 172.21.15.163:0/699472018 conn(0x7fcb5806f750 msgr2=0x7fcb581542d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.568+0000 7efeede00640 1 --2- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efed006c940 0x7efed006ee00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efee0001560 tx=0x7efee0007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.569 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.568+0000 7fcb57e00640 1 -- 172.21.15.163:0/699472018 shutdown_connections 2024-04-01T16:34:50.569 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.568+0000 7fc6c9400640 1 -- 172.21.15.163:0/4160619302 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c408cfe0 con 0x7fc6c4154f00 2024-04-01T16:34:50.569 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.568+0000 7fcb57e00640 1 -- 172.21.15.163:0/699472018 wait complete. 2024-04-01T16:34:50.570 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.570+0000 7efee6000640 1 -- 172.21.15.163:0/584687622 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7efee807a7d0 con 0x7efef0154c60 2024-04-01T16:34:50.570 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.570+0000 7efee6000640 1 --2- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] conn(0x7efed0074ae0 0x7efed0076f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.570+0000 7efee6000640 1 -- 172.21.15.163:0/584687622 --> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efed00775b0 con 0x7efed0074ae0 2024-04-01T16:34:50.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.570+0000 7efee6000640 1 -- 172.21.15.163:0/584687622 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efee80789d0 con 0x7efef0154c60 2024-04-01T16:34:50.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.571+0000 7efeed400640 1 --2- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] conn(0x7efed0074ae0 0x7efed0076f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.572+0000 7efeed400640 1 --2- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] conn(0x7efed0074ae0 0x7efed0076f00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.574+0000 7efee6000640 1 -- 172.21.15.163:0/584687622 <== osd.0 v2:172.21.15.163:6810/3625964404 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efed00775b0 con 0x7efed0074ae0 2024-04-01T16:34:50.589 INFO:teuthology.orchestra.run.smithi163.stdout:64424509452 2024-04-01T16:34:50.589 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-01T16:34:50.597 INFO:teuthology.orchestra.run.smithi163.stdout:60129542155 2024-04-01T16:34:50.598 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-01T16:34:50.602 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.599+0000 7efef4c00640 1 -- 172.21.15.163:0/584687622 --> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efef00c7070 con 0x7efed0074ae0 2024-04-01T16:34:50.602 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.600+0000 7efee6000640 1 -- 172.21.15.163:0/584687622 <== osd.0 v2:172.21.15.163:6810/3625964404 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efedc0011b0 con 0x7efed0074ae0 2024-04-01T16:34:50.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.600+0000 7efef4c00640 1 -- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] conn(0x7efed0074ae0 msgr2=0x7efed0076f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.600+0000 7efef4c00640 1 --2- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] conn(0x7efed0074ae0 0x7efed0076f00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.600+0000 7efef4c00640 1 -- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efed006c940 msgr2=0x7efed006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.600+0000 7efef4c00640 1 --2- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7efed006c940 0x7efed006ee00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efee0001560 tx=0x7efee0007990 comp rx=0 tx=0).stop 2024-04-01T16:34:50.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.600+0000 7efef4c00640 1 -- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efef0154c60 msgr2=0x7efef01f09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.600+0000 7efef4c00640 1 --2- 172.21.15.163:0/584687622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efef0154c60 0x7efef01f09b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efee8009e50 tx=0x7efee8004a40 comp rx=0 tx=0).stop 2024-04-01T16:34:50.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.601+0000 7efeee800640 1 -- 172.21.15.163:0/584687622 reap_dead start 2024-04-01T16:34:50.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.601+0000 7efef4c00640 1 -- 172.21.15.163:0/584687622 shutdown_connections 2024-04-01T16:34:50.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.601+0000 7efef4c00640 1 -- 172.21.15.163:0/584687622 >> 172.21.15.163:0/584687622 conn(0x7efef0067460 msgr2=0x7efef0151f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.601+0000 7efef4c00640 1 -- 172.21.15.163:0/584687622 shutdown_connections 2024-04-01T16:34:50.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.601+0000 7efef4c00640 1 -- 172.21.15.163:0/584687622 wait complete. 2024-04-01T16:34:50.622 INFO:teuthology.orchestra.run.smithi163.stdout:64424509450 2024-04-01T16:34:50.623 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-01T16:34:50.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.704+0000 7f0176200640 1 Processor -- start 2024-04-01T16:34:50.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.704+0000 7f0176200640 1 -- start start 2024-04-01T16:34:50.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.706+0000 7fa721000640 1 Processor -- start 2024-04-01T16:34:50.707 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.707+0000 7f0176200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01700b4ba0 0x7f017015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.708 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.707+0000 7f0176200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01700cacf0 con 0x7f0170154af0 2024-04-01T16:34:50.708 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.707+0000 7f0176200640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01700cafd0 con 0x7f017006d050 2024-04-01T16:34:50.708 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.707+0000 7f0176200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f017015b8f0 con 0x7f01700b4ba0 2024-04-01T16:34:50.708 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.707+0000 7fa721000640 1 -- start start 2024-04-01T16:34:50.708 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.708+0000 7f016f400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f0170154af0 0x7f017006c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50242/0 (socket says 172.21.15.163:50242) 2024-04-01T16:34:50.708 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.708+0000 7f016f400640 1 -- 172.21.15.163:0/1759685641 learned_addr learned my addr 172.21.15.163:0/1759685641 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:50.709 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.709+0000 7fa721000640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa71c0c1da0 0x7fa71c0c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.709 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.709+0000 7fa721000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c15f270 0x7fa71c15f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.709+0000 7fa721000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa71c162080 con 0x7fa71c0735e0 2024-04-01T16:34:50.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.709+0000 7f016fe00640 1 --2- 172.21.15.163:0/1759685641 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01700b4ba0 0x7f017015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.709+0000 7fa721000640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa71c163020 con 0x7fa71c0c1da0 2024-04-01T16:34:50.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.709+0000 7fa721000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa71c06f740 con 0x7fa71c15f270 2024-04-01T16:34:50.713 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.712+0000 7f016e000640 1 -- 172.21.15.163:0/1759685641 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2461661249 0 0) 0x7f01700cacf0 con 0x7f0170154af0 2024-04-01T16:34:50.713 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.712+0000 7f016e000640 1 -- 172.21.15.163:0/1759685641 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0154003520 con 0x7f0170154af0 2024-04-01T16:34:50.713 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.713+0000 7fa713e00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fa71c0735e0 0x7fa71c071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50246/0 (socket says 172.21.15.163:50246) 2024-04-01T16:34:50.714 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.713+0000 7fa713e00640 1 -- 172.21.15.163:0/1414187936 learned_addr learned my addr 172.21.15.163:0/1414187936 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:50.714 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.714+0000 7fa71a800640 1 --2- 172.21.15.163:0/1414187936 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c15f270 0x7fa71c15f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.719 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.718+0000 7f016fe00640 1 -- 172.21.15.163:0/1759685641 >> v1:172.21.15.189:6789/0 conn(0x7f017006d050 legacy=0x7f01700b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.719 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.718+0000 7f016fe00640 1 -- 172.21.15.163:0/1759685641 >> v1:172.21.15.163:6789/0 conn(0x7f0170154af0 legacy=0x7f017006c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.719 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.718+0000 7f016fe00640 1 -- 172.21.15.163:0/1759685641 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01700cb2b0 con 0x7f01700b4ba0 2024-04-01T16:34:50.727 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.727+0000 7fa719400640 1 -- 172.21.15.163:0/1414187936 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4119878863 0 0) 0x7fa704001110 con 0x7fa71c0735e0 2024-04-01T16:34:50.727 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.727+0000 7fa719400640 1 -- 172.21.15.163:0/1414187936 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa700003520 con 0x7fa71c0735e0 2024-04-01T16:34:50.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.729+0000 7fa71a800640 1 -- 172.21.15.163:0/1414187936 >> v2:172.21.15.189:3300/0 conn(0x7fa71c0c1da0 msgr2=0x7fa71c0c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:50.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.729+0000 7fa71a800640 1 --2- 172.21.15.163:0/1414187936 >> v2:172.21.15.189:3300/0 conn(0x7fa71c0c1da0 0x7fa71c0c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.729+0000 7fa71a800640 1 -- 172.21.15.163:0/1414187936 >> v1:172.21.15.163:6789/0 conn(0x7fa71c0735e0 legacy=0x7fa71c071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.729+0000 7fa71a800640 1 -- 172.21.15.163:0/1414187936 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71c15ea90 con 0x7fa71c15f270 2024-04-01T16:34:50.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.731+0000 7f016fe00640 1 --2- 172.21.15.163:0/1759685641 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01700b4ba0 0x7f017015b3b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0168009dc0 tx=0x7f016802be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e587170df9dc919f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.735+0000 7fa71a800640 1 --2- 172.21.15.163:0/1414187936 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c15f270 0x7fa71c15f6e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa714009d90 tx=0x7fa71402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ff6f47b9ca6c52 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.743 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.743+0000 7f016e000640 1 -- 172.21.15.163:0/1759685641 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168039070 con 0x7f01700b4ba0 2024-04-01T16:34:50.758 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.758+0000 7f016e000640 1 -- 172.21.15.163:0/1759685641 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016802cc30 con 0x7f01700b4ba0 2024-04-01T16:34:50.758 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.758+0000 7f016e000640 1 -- 172.21.15.163:0/1759685641 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168034440 con 0x7f01700b4ba0 2024-04-01T16:34:50.759 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.758+0000 7fa719400640 1 -- 172.21.15.163:0/1414187936 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714039070 con 0x7fa71c15f270 2024-04-01T16:34:50.759 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.758+0000 7fa719400640 1 -- 172.21.15.163:0/1414187936 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71402cc80 con 0x7fa71c15f270 2024-04-01T16:34:50.759 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.758+0000 7fa719400640 1 -- 172.21.15.163:0/1414187936 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714034660 con 0x7fa71c15f270 2024-04-01T16:34:50.759 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.759+0000 7f0176200640 1 -- 172.21.15.163:0/1759685641 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01700b4ba0 msgr2=0x7f017015b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.759+0000 7f0176200640 1 --2- 172.21.15.163:0/1759685641 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01700b4ba0 0x7f017015b3b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0168009dc0 tx=0x7f016802be80 comp rx=0 tx=0).stop 2024-04-01T16:34:50.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.759+0000 7f0176200640 1 -- 172.21.15.163:0/1759685641 shutdown_connections 2024-04-01T16:34:50.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.759+0000 7f0176200640 1 --2- 172.21.15.163:0/1759685641 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01700b4ba0 0x7f017015b3b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.759+0000 7f0176200640 1 -- 172.21.15.163:0/1759685641 >> 172.21.15.163:0/1759685641 conn(0x7f01700cffa0 msgr2=0x7f01700d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.759+0000 7f0176200640 1 -- 172.21.15.163:0/1759685641 shutdown_connections 2024-04-01T16:34:50.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.759+0000 7fa721000640 1 -- 172.21.15.163:0/1414187936 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c15f270 msgr2=0x7fa71c15f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.759+0000 7fa721000640 1 --2- 172.21.15.163:0/1414187936 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c15f270 0x7fa71c15f6e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa714009d90 tx=0x7fa71402bed0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.759+0000 7f0176200640 1 -- 172.21.15.163:0/1759685641 wait complete. 2024-04-01T16:34:50.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.761+0000 7fa721000640 1 -- 172.21.15.163:0/1414187936 shutdown_connections 2024-04-01T16:34:50.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.761+0000 7fa721000640 1 --2- 172.21.15.163:0/1414187936 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c15f270 0x7fa71c15f6e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.761+0000 7fa721000640 1 --2- 172.21.15.163:0/1414187936 >> v2:172.21.15.189:3300/0 conn(0x7fa71c0c1da0 0x7fa71c0c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.761+0000 7fa721000640 1 -- 172.21.15.163:0/1414187936 >> 172.21.15.163:0/1414187936 conn(0x7fa71c0cbe20 msgr2=0x7fa71c0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:50.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.761+0000 7fa721000640 1 -- 172.21.15.163:0/1414187936 shutdown_connections 2024-04-01T16:34:50.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.761+0000 7fa721000640 1 -- 172.21.15.163:0/1414187936 wait complete. 2024-04-01T16:34:50.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.762+0000 7f0176200640 1 Processor -- start 2024-04-01T16:34:50.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.763+0000 7f0176200640 1 -- start start 2024-04-01T16:34:50.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.763+0000 7fa721000640 1 Processor -- start 2024-04-01T16:34:50.764 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.764+0000 7fa721000640 1 -- start start 2024-04-01T16:34:50.765 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.765+0000 7f0176200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f017006d050 0x7f01700c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.765 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.765+0000 7f0176200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01700b4ba0 0x7f01701587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.766 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.765+0000 7fa721000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa71c0735e0 0x7fa71c14f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.766 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.765+0000 7fa721000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c0c1da0 0x7fa71c158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.766 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.765+0000 7f0176200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0170154af0 0x7f01701f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.766 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.766+0000 7f0176200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f01700cbb50 con 0x7f017006d050 2024-04-01T16:34:50.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.766+0000 7fa721000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c15f270 0x7fa71c158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.766+0000 7fa721000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c06fc70 con 0x7fa71c0c1da0 2024-04-01T16:34:50.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.766+0000 7fa721000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c06f990 con 0x7fa71c0735e0 2024-04-01T16:34:50.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.766+0000 7fa721000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa71c06ff50 con 0x7fa71c15f270 2024-04-01T16:34:50.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.766+0000 7f0176200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f01700cb870 con 0x7f0170154af0 2024-04-01T16:34:50.768 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.766+0000 7f0176200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f01700ca920 con 0x7f01700b4ba0 2024-04-01T16:34:50.768 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.766+0000 7f016f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f017006d050 0x7f01700c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.768 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.767+0000 7f016f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f017006d050 0x7f01700c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48268/0 (socket says 172.21.15.163:48268) 2024-04-01T16:34:50.768 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.767+0000 7f016f400640 1 -- 172.21.15.163:0/2520556005 learned_addr learned my addr 172.21.15.163:0/2520556005 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.768 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.768+0000 7f016ea00640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01700b4ba0 0x7f01701587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.768 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.768+0000 7fa713e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c0c1da0 0x7fa71c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.769 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.768+0000 7fa71a800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c15f270 0x7fa71c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.769 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.768+0000 7f3381c00640 1 Processor -- start 2024-04-01T16:34:50.769 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.768+0000 7f3381c00640 1 -- start start 2024-04-01T16:34:50.769 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.769+0000 7fa713e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c0c1da0 0x7fa71c158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:48270/0 (socket says 172.21.15.163:48270) 2024-04-01T16:34:50.769 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.769+0000 7fa713e00640 1 -- 172.21.15.163:0/1056512777 learned_addr learned my addr 172.21.15.163:0/1056512777 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:50.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.770+0000 7f3381c00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f337c0c2180 0x7f337c16a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.770+0000 7f3381c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c162080 con 0x7f337c0735e0 2024-04-01T16:34:50.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.770+0000 7f3381c00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c15ea90 con 0x7f337c0c1da0 2024-04-01T16:34:50.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.770+0000 7f3381c00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f337c163020 con 0x7f337c0c2180 2024-04-01T16:34:50.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.773+0000 7f016f400640 1 -- 172.21.15.163:0/2520556005 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01700b4ba0 msgr2=0x7f01701587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.773+0000 7f016f400640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01700b4ba0 0x7f01701587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.773+0000 7f016f400640 1 -- 172.21.15.163:0/2520556005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0170154af0 msgr2=0x7f01701f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.773+0000 7f016f400640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0170154af0 0x7f01701f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.773+0000 7f016f400640 1 -- 172.21.15.163:0/2520556005 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01700c8b10 con 0x7f017006d050 2024-04-01T16:34:50.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.777+0000 7fa71a800640 1 -- 172.21.15.163:0/1056512777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa71c0735e0 msgr2=0x7fa71c14f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.777+0000 7fa71a800640 1 --2- 172.21.15.163:0/1056512777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa71c0735e0 0x7fa71c14f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.777+0000 7fa71a800640 1 -- 172.21.15.163:0/1056512777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c0c1da0 msgr2=0x7fa71c158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:50.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.777+0000 7fa71a800640 1 --2- 172.21.15.163:0/1056512777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c0c1da0 0x7fa71c158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:50.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.777+0000 7fa71a800640 1 -- 172.21.15.163:0/1056512777 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71c14fba0 con 0x7fa71c15f270 2024-04-01T16:34:50.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.779+0000 7f016f400640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f017006d050 0x7f01700c9500 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f015800c390 tx=0x7f015800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.783 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.783+0000 7f337a000640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f337c0735e0 0x7f337c15f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50250/0 (socket says 172.21.15.163:50250) 2024-04-01T16:34:50.783 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.783+0000 7f337a000640 1 -- 172.21.15.163:0/1439852682 learned_addr learned my addr 172.21.15.163:0/1439852682 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:50.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.787+0000 7f0167400640 1 -- 172.21.15.163:0/2520556005 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158017070 con 0x7f017006d050 2024-04-01T16:34:50.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.787+0000 7f0167400640 1 -- 172.21.15.163:0/2520556005 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0158005ce0 con 0x7f017006d050 2024-04-01T16:34:50.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.787+0000 7f0167400640 1 -- 172.21.15.163:0/2520556005 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01580072f0 con 0x7f017006d050 2024-04-01T16:34:50.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.788+0000 7f0176200640 1 -- 172.21.15.163:0/2520556005 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01700c7d50 con 0x7f017006d050 2024-04-01T16:34:50.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.788+0000 7f0176200640 1 -- 172.21.15.163:0/2520556005 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01700c8310 con 0x7f017006d050 2024-04-01T16:34:50.790 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.789+0000 7f0176200640 1 -- 172.21.15.163:0/2520556005 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01700756d0 con 0x7f017006d050 2024-04-01T16:34:50.792 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.792+0000 7f1326400640 1 Processor -- start 2024-04-01T16:34:50.793 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.792+0000 7f1326400640 1 -- start start 2024-04-01T16:34:50.794 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.794+0000 7f1326400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f13200c8160 0x7f132015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.794 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.794+0000 7f1326400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f132015b040 con 0x7f1320151700 2024-04-01T16:34:50.794 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.794+0000 7f1326400640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f132015b320 con 0x7f1320070100 2024-04-01T16:34:50.794 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.794+0000 7f1326400640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f13200c3060 con 0x7f13200c8160 2024-04-01T16:34:50.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.795+0000 7fa71a800640 1 --2- 172.21.15.163:0/1056512777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c15f270 0x7fa71c158540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa714033000 tx=0x7fa714004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.803 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.803+0000 7fa712000640 1 -- 172.21.15.163:0/1056512777 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714044020 con 0x7fa71c15f270 2024-04-01T16:34:50.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.803+0000 7fa712000640 1 -- 172.21.15.163:0/1056512777 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71403f470 con 0x7fa71c15f270 2024-04-01T16:34:50.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.803+0000 7fa712000640 1 -- 172.21.15.163:0/1056512777 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714039040 con 0x7fa71c15f270 2024-04-01T16:34:50.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.803+0000 7fa721000640 1 -- 172.21.15.163:0/1056512777 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa71c1e9870 con 0x7fa71c15f270 2024-04-01T16:34:50.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.803+0000 7fa721000640 1 -- 172.21.15.163:0/1056512777 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa71c1f8ee0 con 0x7fa71c15f270 2024-04-01T16:34:50.805 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.805+0000 7fa721000640 1 -- 172.21.15.163:0/1056512777 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa71c15f680 con 0x7fa71c15f270 2024-04-01T16:34:50.833 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.832+0000 7f6a82e00640 1 Processor -- start 2024-04-01T16:34:50.833 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.833+0000 7f6a82e00640 1 -- start start 2024-04-01T16:34:50.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.834+0000 7f6a82e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6a7c0735e0 0x7f6a7c0c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.834+0000 7f6a82e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a7c162080 con 0x7f6a7c0c1da0 2024-04-01T16:34:50.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.834+0000 7f6a82e00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a7c15ea90 con 0x7f6a7c15f270 2024-04-01T16:34:50.835 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.834+0000 7f6a82e00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6a7c163020 con 0x7f6a7c0735e0 2024-04-01T16:34:50.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.843+0000 7f429d800640 1 Processor -- start 2024-04-01T16:34:50.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.843+0000 7f429d800640 1 -- start start 2024-04-01T16:34:50.845 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.844+0000 7f429d800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4298151700 0x7f429815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.845 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.844+0000 7f429d800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4298070100 0x7f42980c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.845 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.844+0000 7f429d800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f429815b040 con 0x7f42980c8160 2024-04-01T16:34:50.845 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.844+0000 7f429d800640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f42980c3060 con 0x7f4298151700 2024-04-01T16:34:50.845 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.844+0000 7f429d800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f429815b8e0 con 0x7f4298070100 2024-04-01T16:34:50.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.892+0000 7f7731600640 1 Processor -- start 2024-04-01T16:34:50.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.892+0000 7f7731600640 1 -- start start 2024-04-01T16:34:50.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.893+0000 7f7731600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f772c0cc7f0 0x7f772c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.893+0000 7f7731600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f772c0ca760 0x7f772c15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.893+0000 7f7731600640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f772c0cad10 con 0x7f772c15bac0 2024-04-01T16:34:50.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.893+0000 7f7731600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f772c15d9c0 con 0x7f772c0cc7f0 2024-04-01T16:34:50.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.893+0000 7f7731600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f772c15b610 con 0x7f772c0ca760 2024-04-01T16:34:50.932 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.932+0000 7fc6baa00640 1 -- 172.21.15.163:0/4160619302 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc6bc005d10 con 0x7fc6c4154f00 2024-04-01T16:34:50.933 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.933+0000 7fc6baa00640 1 --2- 172.21.15.163:0/4160619302 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc6a406c970 0x7fc6a406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:50.934 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.933+0000 7fc6c2800640 1 --2- 172.21.15.163:0/4160619302 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc6a406c970 0x7fc6a406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:50.934 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.934+0000 7fc6c2800640 1 --2- 172.21.15.163:0/4160619302 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc6a406c970 0x7fc6a406ee30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc6b40018b0 tx=0x7fc6b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:50.942 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:50.942+0000 7fc6baa00640 1 -- 172.21.15.163:0/4160619302 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7fc6bc0589f0 con 0x7fc6c4154f00 2024-04-01T16:34:51.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.000+0000 7fc6baa00640 1 -- 172.21.15.163:0/4160619302 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc6c408cfe0 con 0x7fc6c4154f00 2024-04-01T16:34:51.034 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.034+0000 7f131fe00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f13200c8160 0x7f132015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.034+0000 7f337b400640 1 --2- 172.21.15.163:0/1439852682 >> v2:172.21.15.189:3300/0 conn(0x7f337c0c2180 0x7f337c16a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.036+0000 7f131fe00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f13200c8160 0x7f132015aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:38354/0 (socket says 172.21.15.163:38354) 2024-04-01T16:34:51.037 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.036+0000 7f131fe00640 1 -- 172.21.15.163:0/2662048273 learned_addr learned my addr 172.21.15.163:0/2662048273 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:51.040 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.040+0000 7f131fe00640 1 -- 172.21.15.163:0/2662048273 >> v1:172.21.15.189:6789/0 conn(0x7f1320070100 legacy=0x7f13200c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:51.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.040+0000 7f131fe00640 1 -- 172.21.15.163:0/2662048273 >> v1:172.21.15.163:6789/0 conn(0x7f1320151700 legacy=0x7f13200c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:51.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.040+0000 7f131fe00640 1 -- 172.21.15.163:0/2662048273 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132015b600 con 0x7f13200c8160 2024-04-01T16:34:51.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.043+0000 7f4296a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4298151700 0x7f429815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.044+0000 7f4296a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f4298151700 0x7f429815aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:46590/0 (socket says 172.21.15.163:46590) 2024-04-01T16:34:51.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.044+0000 7f4296a00640 1 -- 172.21.15.163:0/705501210 learned_addr learned my addr 172.21.15.163:0/705501210 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:51.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.047+0000 7f337b400640 1 -- 172.21.15.163:0/1439852682 >> v1:172.21.15.189:6789/0 conn(0x7f337c0c1da0 legacy=0x7f337c071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:51.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.047+0000 7f337b400640 1 -- 172.21.15.163:0/1439852682 >> v1:172.21.15.163:6789/0 conn(0x7f337c0735e0 legacy=0x7f337c15f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.047+0000 7f337b400640 1 -- 172.21.15.163:0/1439852682 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c0725f0 con 0x7f337c0c2180 2024-04-01T16:34:51.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.054+0000 7f4296a00640 1 -- 172.21.15.163:0/705501210 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4298070100 msgr2=0x7f42980c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:51.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.054+0000 7f4296a00640 1 --2- 172.21.15.163:0/705501210 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4298070100 0x7f42980c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.054+0000 7f4296a00640 1 -- 172.21.15.163:0/705501210 >> v1:172.21.15.189:6789/0 conn(0x7f42980c8160 legacy=0x7f42980c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:51.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.054+0000 7f4296a00640 1 -- 172.21.15.163:0/705501210 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429815b320 con 0x7f4298151700 2024-04-01T16:34:51.060 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.059+0000 7f131fe00640 1 --2- 172.21.15.163:0/2662048273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13200c8160 0x7f132015aa00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f131800d150 tx=0x7f131802e0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=718d44ce1d0d0a44 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.061 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.061+0000 7f337b400640 1 --2- 172.21.15.163:0/1439852682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f337c0c2180 0x7f337c16a420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3374009d90 tx=0x7f337402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70ef33478c642541 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.064 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.064+0000 7f4296a00640 1 --2- 172.21.15.163:0/705501210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4298151700 0x7f429815aa00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4288009870 tx=0x7f428802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=266cf84d5e8fd7f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.066 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.066+0000 7f6a7b400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6a7c0735e0 0x7f6a7c0c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.077+0000 7f6a7b400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6a7c0735e0 0x7f6a7c0c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:46576/0 (socket says 172.21.15.163:46576) 2024-04-01T16:34:51.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.077+0000 7f6a7b400640 1 -- 172.21.15.163:0/2511108241 learned_addr learned my addr 172.21.15.163:0/2511108241 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:51.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.082+0000 7f4295600640 1 -- 172.21.15.163:0/705501210 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288035020 con 0x7f4298151700 2024-04-01T16:34:51.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.082+0000 7f4295600640 1 -- 172.21.15.163:0/705501210 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4288031640 con 0x7f4298151700 2024-04-01T16:34:51.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.082+0000 7f4295600640 1 -- 172.21.15.163:0/705501210 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428802d040 con 0x7f4298151700 2024-04-01T16:34:51.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.082+0000 7f772b400640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f772c15bac0 0x7f772c06d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:45368/0 (socket says 172.21.15.163:45368) 2024-04-01T16:34:51.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.082+0000 7f772b400640 1 -- 172.21.15.163:0/1563484052 learned_addr learned my addr 172.21.15.163:0/1563484052 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:51.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.083+0000 7f429d800640 1 -- 172.21.15.163:0/705501210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4298151700 msgr2=0x7f429815aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.083+0000 7f429d800640 1 --2- 172.21.15.163:0/705501210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4298151700 0x7f429815aa00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4288009870 tx=0x7f428802b8f0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.083+0000 7f429d800640 1 -- 172.21.15.163:0/705501210 shutdown_connections 2024-04-01T16:34:51.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.083+0000 7f429d800640 1 --2- 172.21.15.163:0/705501210 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4298070100 0x7f42980c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.083+0000 7f429d800640 1 --2- 172.21.15.163:0/705501210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4298151700 0x7f429815aa00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.083+0000 7f429d800640 1 -- 172.21.15.163:0/705501210 >> 172.21.15.163:0/705501210 conn(0x7f42980cbe20 msgr2=0x7f42980cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:51.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.083+0000 7f429d800640 1 -- 172.21.15.163:0/705501210 shutdown_connections 2024-04-01T16:34:51.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.083+0000 7f429d800640 1 -- 172.21.15.163:0/705501210 wait complete. 2024-04-01T16:34:51.088 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.087+0000 7f429d800640 1 Processor -- start 2024-04-01T16:34:51.088 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.088+0000 7f429d800640 1 -- start start 2024-04-01T16:34:51.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.089+0000 7f429d800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4298070100 0x7f429814e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.089+0000 7f429d800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42980c8160 0x7f4298159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.089+0000 7f429d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4298151700 0x7f429815a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.089+0000 7f429d800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f42980c7020 con 0x7f4298070100 2024-04-01T16:34:51.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.090+0000 7f429d800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f42980c7390 con 0x7f4298151700 2024-04-01T16:34:51.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.090+0000 7f429d800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4298151ae0 con 0x7f42980c8160 2024-04-01T16:34:51.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.098+0000 7f6a7b400640 1 -- 172.21.15.163:0/2511108241 >> v1:172.21.15.189:6789/0 conn(0x7f6a7c15f270 legacy=0x7f6a7c169410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:51.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.098+0000 7f6a7b400640 1 -- 172.21.15.163:0/2511108241 >> v1:172.21.15.163:6789/0 conn(0x7f6a7c0c1da0 legacy=0x7f6a7c071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:51.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.098+0000 7f6a7b400640 1 -- 172.21.15.163:0/2511108241 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7c0725f0 con 0x7f6a7c0735e0 2024-04-01T16:34:51.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.099+0000 7fa712000640 1 -- 172.21.15.163:0/1056512777 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa714047020 con 0x7fa71c15f270 2024-04-01T16:34:51.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.100+0000 7fa712000640 1 --2- 172.21.15.163:0/1056512777 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa6f806c8f0 0x7fa6f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.100+0000 7fa719e00640 1 --2- 172.21.15.163:0/1056512777 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa6f806c8f0 0x7fa6f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.101+0000 7f131e000640 1 -- 172.21.15.163:0/2662048273 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131802ea80 con 0x7f13200c8160 2024-04-01T16:34:51.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.101+0000 7f131e000640 1 -- 172.21.15.163:0/2662048273 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f131802ec20 con 0x7f13200c8160 2024-04-01T16:34:51.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.101+0000 7f131e000640 1 -- 172.21.15.163:0/2662048273 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318009600 con 0x7f13200c8160 2024-04-01T16:34:51.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.101+0000 7fa719e00640 1 --2- 172.21.15.163:0/1056512777 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa6f806c8f0 0x7fa6f806edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009670 tx=0x7fa70c006bf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.102+0000 7f1326400640 1 -- 172.21.15.163:0/2662048273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13200c8160 msgr2=0x7f132015aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.102+0000 7f1326400640 1 --2- 172.21.15.163:0/2662048273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13200c8160 0x7f132015aa00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f131800d150 tx=0x7f131802e0e0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.102+0000 7f1326400640 1 -- 172.21.15.163:0/2662048273 shutdown_connections 2024-04-01T16:34:51.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.102+0000 7f1326400640 1 --2- 172.21.15.163:0/2662048273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13200c8160 0x7f132015aa00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.102+0000 7f1326400640 1 -- 172.21.15.163:0/2662048273 >> 172.21.15.163:0/2662048273 conn(0x7f13200cbe20 msgr2=0x7f13200cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:51.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.102+0000 7f1326400640 1 -- 172.21.15.163:0/2662048273 shutdown_connections 2024-04-01T16:34:51.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.102+0000 7f1326400640 1 -- 172.21.15.163:0/2662048273 wait complete. 2024-04-01T16:34:51.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.103+0000 7f0167400640 1 -- 172.21.15.163:0/2520556005 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f015801a070 con 0x7f017006d050 2024-04-01T16:34:51.104 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.104+0000 7f0167400640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f014c06c970 0x7f014c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.104+0000 7f016ea00640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f014c06c970 0x7f014c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.105+0000 7f016ea00640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f014c06c970 0x7f014c06ee30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01701e8d60 tx=0x7f0160009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.105+0000 7f1326400640 1 Processor -- start 2024-04-01T16:34:51.106 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.105+0000 7f1326400640 1 -- start start 2024-04-01T16:34:51.106 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.106+0000 7fa712000640 1 -- 172.21.15.163:0/1056512777 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7fa71407aa10 con 0x7fa71c15f270 2024-04-01T16:34:51.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.107+0000 7f1326400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1320070100 0x7f13201523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.107+0000 7f1326400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13200c8160 0x7f1320153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.107+0000 7f1326400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1320151700 0x7f1320157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.107+0000 7f1326400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f13200c7390 con 0x7f1320151700 2024-04-01T16:34:51.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.107+0000 7f1326400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f132015b8e0 con 0x7f1320070100 2024-04-01T16:34:51.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.107+0000 7f1326400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1320151ae0 con 0x7f13200c8160 2024-04-01T16:34:51.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.116+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285902021 0 0) 0x7f772c0cad10 con 0x7f772c15bac0 2024-04-01T16:34:51.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.116+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7710003520 con 0x7f772c15bac0 2024-04-01T16:34:51.119 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.119+0000 7f0167400640 1 -- 172.21.15.163:0/2520556005 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f01580571d0 con 0x7f017006d050 2024-04-01T16:34:51.120 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.120+0000 7f0167400640 1 -- 172.21.15.163:0/2520556005 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0158021020 con 0x7f017006d050 2024-04-01T16:34:51.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.123+0000 7f6a7b400640 1 --2- 172.21.15.163:0/2511108241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a7c0735e0 0x7f6a7c0c2180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009870 tx=0x7f6a6802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=237f977f8d68b111 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.132 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.131+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1686297855 0 0) 0x7f7710003520 con 0x7f772c15bac0 2024-04-01T16:34:51.132 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.131+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f772c0ca760 msgr2=0x7f772c15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:51.132 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.131+0000 7f772aa00640 1 --2- 172.21.15.163:0/1563484052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f772c0ca760 0x7f772c15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.132 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.131+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 >> v2:172.21.15.163:3300/0 conn(0x7f772c0cc7f0 msgr2=0x7f772c0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:51.132 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.131+0000 7f772aa00640 1 --2- 172.21.15.163:0/1563484052 >> v2:172.21.15.163:3300/0 conn(0x7f772c0cc7f0 0x7f772c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.132 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.131+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772c06ca80 con 0x7f772c15bac0 2024-04-01T16:34:51.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.131+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7f7718001670 con 0x7f772c15bac0 2024-04-01T16:34:51.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.131+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 >> v1:172.21.15.189:6789/0 conn(0x7f772c15bac0 legacy=0x7f772c06d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.131+0000 7f772aa00640 1 --2- 172.21.15.163:0/1563484052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77100039e0 0x7f7710003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.131+0000 7f772aa00640 1 --2- 172.21.15.163:0/1563484052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f772c0ca760 0x7f7710004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.132+0000 7f772aa00640 1 --2- 172.21.15.163:0/1563484052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7710004e10 0x7f7710005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.132+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f772c15b610 con 0x7f7710004e10 2024-04-01T16:34:51.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.132+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f771000bcc0 con 0x7f77100039e0 2024-04-01T16:34:51.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.132+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f771000bec0 con 0x7f772c0ca760 2024-04-01T16:34:51.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.136+0000 7fa712000640 1 -- 172.21.15.163:0/1056512777 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa71c15f680 con 0x7fa71c15f270 2024-04-01T16:34:51.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.137+0000 7f3379600640 1 -- 172.21.15.163:0/1439852682 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374039070 con 0x7f337c0c2180 2024-04-01T16:34:51.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.137+0000 7f3379600640 1 -- 172.21.15.163:0/1439852682 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337402cc60 con 0x7f337c0c2180 2024-04-01T16:34:51.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.137+0000 7f3379600640 1 -- 172.21.15.163:0/1439852682 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374034660 con 0x7f337c0c2180 2024-04-01T16:34:51.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.139+0000 7f3381c00640 1 -- 172.21.15.163:0/1439852682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f337c0c2180 msgr2=0x7f337c16a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.139+0000 7f3381c00640 1 --2- 172.21.15.163:0/1439852682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f337c0c2180 0x7f337c16a420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3374009d90 tx=0x7f337402beb0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.139+0000 7f3381c00640 1 -- 172.21.15.163:0/1439852682 shutdown_connections 2024-04-01T16:34:51.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.139+0000 7f3381c00640 1 --2- 172.21.15.163:0/1439852682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f337c0c2180 0x7f337c16a420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.139+0000 7f3381c00640 1 -- 172.21.15.163:0/1439852682 >> 172.21.15.163:0/1439852682 conn(0x7f337c0cbe20 msgr2=0x7f337c0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:51.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.139+0000 7f3381c00640 1 -- 172.21.15.163:0/1439852682 shutdown_connections 2024-04-01T16:34:51.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.139+0000 7f3381c00640 1 -- 172.21.15.163:0/1439852682 wait complete. 2024-04-01T16:34:51.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.139+0000 7f131ea00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13200c8160 0x7f1320153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.141+0000 7f3381c00640 1 Processor -- start 2024-04-01T16:34:51.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.141+0000 7f3381c00640 1 -- start start 2024-04-01T16:34:51.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.141+0000 7f4296000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42980c8160 0x7f4298159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.142+0000 7f131ea00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13200c8160 0x7f1320153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:38136/0 (socket says 172.21.15.163:38136) 2024-04-01T16:34:51.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.142+0000 7f131ea00640 1 -- 172.21.15.163:0/585269829 learned_addr learned my addr 172.21.15.163:0/585269829 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:51.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.142+0000 7f131f400640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1320070100 0x7f13201523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.142+0000 7f3381c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f337c0735e0 0x7f337c155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.142+0000 7f3381c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f337c0c1da0 0x7f337c150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.142+0000 7f3381c00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f337c0c2180 0x7f337c1e8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.142+0000 7f3381c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f337c06fc70 con 0x7f337c0c1da0 2024-04-01T16:34:51.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.142+0000 7f3381c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f337c06f740 con 0x7f337c0735e0 2024-04-01T16:34:51.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.142+0000 7f3381c00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f337c06ff50 con 0x7f337c0c2180 2024-04-01T16:34:51.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.144+0000 7f4296a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4298070100 0x7f429814e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.144+0000 7f4296000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42980c8160 0x7f4298159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:38122/0 (socket says 172.21.15.163:38122) 2024-04-01T16:34:51.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.144+0000 7f4296000640 1 -- 172.21.15.163:0/3392648689 learned_addr learned my addr 172.21.15.163:0/3392648689 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:51.146 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.146+0000 7f772b400640 1 --2- 172.21.15.163:0/1563484052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f772c0ca760 0x7f7710004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.151 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.151+0000 7f131f400640 1 -- 172.21.15.163:0/585269829 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13200c8160 msgr2=0x7f1320153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.151 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.151+0000 7f131f400640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13200c8160 0x7f1320153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.151 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.151+0000 7f131f400640 1 -- 172.21.15.163:0/585269829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1320151700 msgr2=0x7f1320157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.151 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.151+0000 7f131f400640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1320151700 0x7f1320157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.151+0000 7f131f400640 1 -- 172.21.15.163:0/585269829 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132014e7d0 con 0x7f1320070100 2024-04-01T16:34:51.155 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.155+0000 7f131f400640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1320070100 0x7f13201523e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f131000c470 tx=0x7f131000c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.159 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.159+0000 7f4297400640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4298151700 0x7f429815a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.163+0000 7f337aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f337c0735e0 0x7f337c155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.164+0000 7f4296000640 1 -- 172.21.15.163:0/3392648689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4298151700 msgr2=0x7f429815a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.164+0000 7f4296000640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4298151700 0x7f429815a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.164+0000 7f4296000640 1 -- 172.21.15.163:0/3392648689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4298070100 msgr2=0x7f429814e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.164+0000 7f4296000640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4298070100 0x7f429814e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.164+0000 7f4296000640 1 -- 172.21.15.163:0/3392648689 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429814ffe0 con 0x7f42980c8160 2024-04-01T16:34:51.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.165+0000 7f6a7aa00640 1 -- 172.21.15.163:0/2511108241 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68035020 con 0x7f6a7c0735e0 2024-04-01T16:34:51.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.165+0000 7f6a7aa00640 1 -- 172.21.15.163:0/2511108241 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a68031870 con 0x7f6a7c0735e0 2024-04-01T16:34:51.166 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.165+0000 7f6a7aa00640 1 -- 172.21.15.163:0/2511108241 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68031c40 con 0x7f6a7c0735e0 2024-04-01T16:34:51.166 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.165+0000 7f337aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f337c0735e0 0x7f337c155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:46636/0 (socket says 172.21.15.163:46636) 2024-04-01T16:34:51.166 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.165+0000 7f337aa00640 1 -- 172.21.15.163:0/777202011 learned_addr learned my addr 172.21.15.163:0/777202011 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:51.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.166+0000 7f6a82e00640 1 -- 172.21.15.163:0/2511108241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a7c0735e0 msgr2=0x7f6a7c0c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.166+0000 7f6a82e00640 1 --2- 172.21.15.163:0/2511108241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a7c0735e0 0x7f6a7c0c2180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009870 tx=0x7f6a6802b910 comp rx=0 tx=0).stop 2024-04-01T16:34:51.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.166+0000 7f6a82e00640 1 -- 172.21.15.163:0/2511108241 shutdown_connections 2024-04-01T16:34:51.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.166+0000 7f6a82e00640 1 --2- 172.21.15.163:0/2511108241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a7c0735e0 0x7f6a7c0c2180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.166+0000 7f6a82e00640 1 -- 172.21.15.163:0/2511108241 >> 172.21.15.163:0/2511108241 conn(0x7f6a7c0cbe20 msgr2=0x7f6a7c0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:51.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.166+0000 7f6a82e00640 1 -- 172.21.15.163:0/2511108241 shutdown_connections 2024-04-01T16:34:51.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.166+0000 7f6a82e00640 1 -- 172.21.15.163:0/2511108241 wait complete. 2024-04-01T16:34:51.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.167+0000 7f772be00640 1 --2- 172.21.15.163:0/1563484052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77100039e0 0x7f7710003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.168+0000 7f6a82e00640 1 Processor -- start 2024-04-01T16:34:51.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.168+0000 7f6a82e00640 1 -- start start 2024-04-01T16:34:51.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.169+0000 7f6a82e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a7c0735e0 0x7f6a7c1608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.169+0000 7f1317400640 1 -- 172.21.15.163:0/585269829 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310017070 con 0x7f1320070100 2024-04-01T16:34:51.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.169+0000 7f1317400640 1 -- 172.21.15.163:0/585269829 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13100035f0 con 0x7f1320070100 2024-04-01T16:34:51.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.169+0000 7f1317400640 1 -- 172.21.15.163:0/585269829 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13100039e0 con 0x7f1320070100 2024-04-01T16:34:51.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.169+0000 7f6a82e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a7c0c1da0 0x7f6a7c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.169+0000 7f6a82e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a7c15f270 0x7f6a7c1f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.169+0000 7f6a82e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c06fc70 con 0x7f6a7c0c1da0 2024-04-01T16:34:51.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.169+0000 7f6a82e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c06f740 con 0x7f6a7c0735e0 2024-04-01T16:34:51.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.169+0000 7f6a82e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7c06ff50 con 0x7f6a7c15f270 2024-04-01T16:34:51.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.169+0000 7f1326400640 1 -- 172.21.15.163:0/585269829 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1320152a00 con 0x7f1320070100 2024-04-01T16:34:51.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.169+0000 7f1326400640 1 -- 172.21.15.163:0/585269829 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1320156da0 con 0x7f1320070100 2024-04-01T16:34:51.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.171+0000 7f1326400640 1 -- 172.21.15.163:0/585269829 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13200756d0 con 0x7f1320070100 2024-04-01T16:34:51.173 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.172+0000 7f772b400640 1 -- 172.21.15.163:0/1563484052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77100039e0 msgr2=0x7f7710003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:51.173 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.172+0000 7f772b400640 1 --2- 172.21.15.163:0/1563484052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77100039e0 0x7f7710003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.173 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.172+0000 7f772b400640 1 -- 172.21.15.163:0/1563484052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7710004e10 msgr2=0x7f7710005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:51.173 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.172+0000 7f772b400640 1 --2- 172.21.15.163:0/1563484052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7710004e10 0x7f7710005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.173 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.172+0000 7f772b400640 1 -- 172.21.15.163:0/1563484052 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7710003520 con 0x7f772c0ca760 2024-04-01T16:34:51.177 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.177+0000 7f337aa00640 1 -- 172.21.15.163:0/777202011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f337c0c2180 msgr2=0x7f337c1e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.177 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.177+0000 7f337aa00640 1 --2- 172.21.15.163:0/777202011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f337c0c2180 0x7f337c1e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.177 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.177+0000 7f337aa00640 1 -- 172.21.15.163:0/777202011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f337c0c1da0 msgr2=0x7f337c150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.177 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.177+0000 7f337aa00640 1 --2- 172.21.15.163:0/777202011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f337c0c1da0 0x7f337c150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.177 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.177+0000 7f337aa00640 1 -- 172.21.15.163:0/777202011 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c161c40 con 0x7f337c0735e0 2024-04-01T16:34:51.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.179+0000 7f4296000640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42980c8160 0x7f4298159bd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f428400b440 tx=0x7f428400b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.181 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.181+0000 7f772b400640 1 --2- 172.21.15.163:0/1563484052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f772c0ca760 0x7f7710004800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f771800c190 tx=0x7f7710005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a70f24a30a22b8ab server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.184+0000 7f337aa00640 1 --2- 172.21.15.163:0/777202011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f337c0735e0 0x7f337c155c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f336c00b440 tx=0x7f336c00b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.188+0000 7f6a7b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a7c0c1da0 0x7f6a7c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.190+0000 7f6a7b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a7c0c1da0 0x7f6a7c15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50434/0 (socket says 172.21.15.163:50434) 2024-04-01T16:34:51.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.190+0000 7f6a7b400640 1 -- 172.21.15.163:0/878305957 learned_addr learned my addr 172.21.15.163:0/878305957 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:51.196 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.195+0000 7f6a7b400640 1 -- 172.21.15.163:0/878305957 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a7c15f270 msgr2=0x7f6a7c1f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.196 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.195+0000 7f6a7b400640 1 --2- 172.21.15.163:0/878305957 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a7c15f270 0x7f6a7c1f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.196 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.195+0000 7f6a7b400640 1 -- 172.21.15.163:0/878305957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a7c0735e0 msgr2=0x7f6a7c1608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.196 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.195+0000 7f6a7b400640 1 --2- 172.21.15.163:0/878305957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a7c0735e0 0x7f6a7c1608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.196 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.195+0000 7f6a7b400640 1 -- 172.21.15.163:0/878305957 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7c1619b0 con 0x7f6a7c0c1da0 2024-04-01T16:34:51.203 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.203+0000 7f428ea00640 1 -- 172.21.15.163:0/3392648689 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4284015020 con 0x7f42980c8160 2024-04-01T16:34:51.203 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.203+0000 7f428ea00640 1 -- 172.21.15.163:0/3392648689 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4284011890 con 0x7f42980c8160 2024-04-01T16:34:51.203 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.203+0000 7f428ea00640 1 -- 172.21.15.163:0/3392648689 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4284011c80 con 0x7f42980c8160 2024-04-01T16:34:51.203 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.203+0000 7f429d800640 1 -- 172.21.15.163:0/3392648689 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42981f3b00 con 0x7f42980c8160 2024-04-01T16:34:51.203 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.203+0000 7f429d800640 1 -- 172.21.15.163:0/3392648689 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42981f40c0 con 0x7f42980c8160 2024-04-01T16:34:51.204 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.203+0000 7f6a7b400640 1 --2- 172.21.15.163:0/878305957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a7c0c1da0 0x7f6a7c15a400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a68000c00 tx=0x7f6a680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.205 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.205+0000 7f429d800640 1 -- 172.21.15.163:0/3392648689 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42980756d0 con 0x7f42980c8160 2024-04-01T16:34:51.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.215+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718007c60 con 0x7f772c0ca760 2024-04-01T16:34:51.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.215+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7718030070 con 0x7f772c0ca760 2024-04-01T16:34:51.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.215+0000 7f772aa00640 1 -- 172.21.15.163:0/1563484052 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718005df0 con 0x7f772c0ca760 2024-04-01T16:34:51.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.216+0000 7f7731600640 1 -- 172.21.15.163:0/1563484052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f772c0ca760 msgr2=0x7f7710004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.216+0000 7f7731600640 1 --2- 172.21.15.163:0/1563484052 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f772c0ca760 0x7f7710004800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f771800c190 tx=0x7f7710005830 comp rx=0 tx=0).stop 2024-04-01T16:34:51.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.216+0000 7f7730c00640 1 -- 172.21.15.163:0/1563484052 reap_dead start 2024-04-01T16:34:51.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.216+0000 7f7731600640 1 -- 172.21.15.163:0/1563484052 shutdown_connections 2024-04-01T16:34:51.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.216+0000 7f7731600640 1 -- 172.21.15.163:0/1563484052 >> 172.21.15.163:0/1563484052 conn(0x7f772c0b1910 msgr2=0x7f772c0b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:51.217 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.216+0000 7f7731600640 1 -- 172.21.15.163:0/1563484052 shutdown_connections 2024-04-01T16:34:51.217 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.216+0000 7f7731600640 1 -- 172.21.15.163:0/1563484052 wait complete. 2024-04-01T16:34:51.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.218+0000 7f7731600640 1 Processor -- start 2024-04-01T16:34:51.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.218+0000 7f7731600640 1 -- start start 2024-04-01T16:34:51.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.219+0000 7f7731600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f772c0ca760 0x7f772c0b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.219+0000 7f7731600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f772c151320 0x7f772c14f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.219+0000 7f7731600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f772c151df0 0x7f772c14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.219+0000 7f7731600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f772c06d040 con 0x7f772c151320 2024-04-01T16:34:51.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.219+0000 7f7731600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f772c0caff0 con 0x7f772c0ca760 2024-04-01T16:34:51.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.219+0000 7f7731600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f772c06d320 con 0x7f772c151df0 2024-04-01T16:34:51.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.227+0000 7f772b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f772c151320 0x7f772c14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.229+0000 7f6a73e00640 1 -- 172.21.15.163:0/878305957 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6803ad60 con 0x7f6a7c0c1da0 2024-04-01T16:34:51.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.229+0000 7f6a73e00640 1 -- 172.21.15.163:0/878305957 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a680443f0 con 0x7f6a7c0c1da0 2024-04-01T16:34:51.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.229+0000 7f6a73e00640 1 -- 172.21.15.163:0/878305957 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a680447e0 con 0x7f6a7c0c1da0 2024-04-01T16:34:51.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.229+0000 7f6a82e00640 1 -- 172.21.15.163:0/878305957 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7c161c70 con 0x7f6a7c0c1da0 2024-04-01T16:34:51.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.230+0000 7f6a82e00640 1 -- 172.21.15.163:0/878305957 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a7c1600d0 con 0x7f6a7c0c1da0 2024-04-01T16:34:51.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.230+0000 7f772b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f772c151320 0x7f772c14f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50450/0 (socket says 172.21.15.163:50450) 2024-04-01T16:34:51.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.230+0000 7f772b400640 1 -- 172.21.15.163:0/172291484 learned_addr learned my addr 172.21.15.163:0/172291484 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:51.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.231+0000 7f6a82e00640 1 -- 172.21.15.163:0/878305957 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a7c0756d0 con 0x7f6a7c0c1da0 2024-04-01T16:34:51.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.254+0000 7fc6c9400640 1 -- 172.21.15.163:0/4160619302 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc6c40ca640 con 0x7fc6c4154f00 2024-04-01T16:34:51.394 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.393+0000 7f0176200640 1 -- 172.21.15.163:0/2520556005 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f017006d6f0 con 0x7f017006d050 2024-04-01T16:34:51.413 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.412+0000 7fa721000640 1 -- 172.21.15.163:0/1056512777 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa71c0756d0 con 0x7fa71c15f270 2024-04-01T16:34:51.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.479+0000 7f3372a00640 1 -- 172.21.15.163:0/777202011 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c015020 con 0x7f337c0735e0 2024-04-01T16:34:51.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.480+0000 7f3372a00640 1 -- 172.21.15.163:0/777202011 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c0118b0 con 0x7f337c0735e0 2024-04-01T16:34:51.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.480+0000 7f3372a00640 1 -- 172.21.15.163:0/777202011 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c011ca0 con 0x7f337c0735e0 2024-04-01T16:34:51.481 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.480+0000 7f3381c00640 1 -- 172.21.15.163:0/777202011 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337c1ea150 con 0x7f337c0735e0 2024-04-01T16:34:51.481 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.480+0000 7f3381c00640 1 -- 172.21.15.163:0/777202011 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337c160f00 con 0x7f337c0735e0 2024-04-01T16:34:51.481 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.480+0000 7f772b400640 1 -- 172.21.15.163:0/172291484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f772c151df0 msgr2=0x7f772c14fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.481 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.480+0000 7f772b400640 1 --2- 172.21.15.163:0/172291484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f772c151df0 0x7f772c14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.480+0000 7f772b400640 1 -- 172.21.15.163:0/172291484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f772c0ca760 msgr2=0x7f772c0b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.480+0000 7f772b400640 1 --2- 172.21.15.163:0/172291484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f772c0ca760 0x7f772c0b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.481+0000 7f772b400640 1 -- 172.21.15.163:0/172291484 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772c151940 con 0x7f772c151320 2024-04-01T16:34:51.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.482+0000 7f3381c00640 1 -- 172.21.15.163:0/777202011 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f337c0756d0 con 0x7f337c0735e0 2024-04-01T16:34:51.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.508+0000 7f1317400640 1 -- 172.21.15.163:0/585269829 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1310003b80 con 0x7f1320070100 2024-04-01T16:34:51.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.509+0000 7f1317400640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f130006c8f0 0x7f130006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.509+0000 7f131ea00640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f130006c8f0 0x7f130006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.510+0000 7f131ea00640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f130006c8f0 0x7f130006edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f13200727a0 tx=0x7f130c0090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.512 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.512+0000 7f1317400640 1 -- 172.21.15.163:0/585269829 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f1310056e00 con 0x7f1320070100 2024-04-01T16:34:51.521 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.521+0000 7f772b400640 1 --2- 172.21.15.163:0/172291484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f772c151320 0x7f772c14f770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f771800c190 tx=0x7f7718001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.525 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.525+0000 7f6a73e00640 1 -- 172.21.15.163:0/878305957 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a6804b060 con 0x7f6a7c0c1da0 2024-04-01T16:34:51.527 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.527+0000 7f6a73e00640 1 --2- 172.21.15.163:0/878305957 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6a5c06c940 0x7f6a5c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.527+0000 7f6a7be00640 1 --2- 172.21.15.163:0/878305957 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6a5c06c940 0x7f6a5c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.529+0000 7f6a7be00640 1 --2- 172.21.15.163:0/878305957 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6a5c06c940 0x7f6a5c06ee00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009650 tx=0x7f6a6c006ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.532 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.532+0000 7f1317400640 1 -- 172.21.15.163:0/585269829 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1310058d60 con 0x7f1320070100 2024-04-01T16:34:51.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.560+0000 7f6a73e00640 1 -- 172.21.15.163:0/878305957 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f6a68079fb0 con 0x7f6a7c0c1da0 2024-04-01T16:34:51.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.560+0000 7f6a73e00640 1 -- 172.21.15.163:0/878305957 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6a6803f070 con 0x7f6a7c0c1da0 2024-04-01T16:34:51.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.574+0000 7f428ea00640 1 -- 172.21.15.163:0/3392648689 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4284018020 con 0x7f42980c8160 2024-04-01T16:34:51.576 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.576+0000 7f428ea00640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f427806c940 0x7f427806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.577 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.577+0000 7f4296a00640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f427806c940 0x7f427806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.578 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.578+0000 7f4296a00640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f427806c940 0x7f427806ee00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4288036000 tx=0x7f428803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.581+0000 7f7723e00640 1 -- 172.21.15.163:0/172291484 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718007c60 con 0x7f772c151320 2024-04-01T16:34:51.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.581+0000 7f7723e00640 1 -- 172.21.15.163:0/172291484 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7718045070 con 0x7f772c151320 2024-04-01T16:34:51.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.581+0000 7f7723e00640 1 -- 172.21.15.163:0/172291484 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718004c10 con 0x7f772c151320 2024-04-01T16:34:51.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.581+0000 7f7731600640 1 -- 172.21.15.163:0/172291484 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772c0b4de0 con 0x7f772c151320 2024-04-01T16:34:51.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.582+0000 7f7731600640 1 -- 172.21.15.163:0/172291484 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f772c0b5430 con 0x7f772c151320 2024-04-01T16:34:51.583 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.582+0000 7f428ea00640 1 -- 172.21.15.163:0/3392648689 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f4284058000 con 0x7f42980c8160 2024-04-01T16:34:51.583 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.583+0000 7f0167400640 1 -- 172.21.15.163:0/2520556005 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0158059130 con 0x7f017006d050 2024-04-01T16:34:51.584 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.583+0000 7f7731600640 1 -- 172.21.15.163:0/172291484 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f772c0756d0 con 0x7f772c151320 2024-04-01T16:34:51.584 INFO:teuthology.orchestra.run.smithi163.stdout:60129542157 2024-04-01T16:34:51.587 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.586+0000 7f0176200640 1 -- 172.21.15.163:0/2520556005 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f014c06c970 msgr2=0x7f014c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.587 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.586+0000 7f0176200640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f014c06c970 0x7f014c06ee30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01701e8d60 tx=0x7f0160009040 comp rx=0 tx=0).stop 2024-04-01T16:34:51.587 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.586+0000 7f0176200640 1 -- 172.21.15.163:0/2520556005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f017006d050 msgr2=0x7f01700c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.587 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.586+0000 7f0176200640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f017006d050 0x7f01700c9500 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f015800c390 tx=0x7f015800c850 comp rx=0 tx=0).stop 2024-04-01T16:34:51.587 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.586+0000 7f0176200640 1 -- 172.21.15.163:0/2520556005 shutdown_connections 2024-04-01T16:34:51.587 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.586+0000 7f0176200640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f014c06c970 0x7f014c06ee30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.587 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.586+0000 7f0176200640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0170154af0 0x7f01701f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.587 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.586+0000 7f0176200640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f01700b4ba0 0x7f01701587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.587 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.586+0000 7f0176200640 1 --2- 172.21.15.163:0/2520556005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f017006d050 0x7f01700c9500 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.588 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.586+0000 7f0176200640 1 -- 172.21.15.163:0/2520556005 >> 172.21.15.163:0/2520556005 conn(0x7f01700cffa0 msgr2=0x7f01700cf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:51.588 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.586+0000 7f0176200640 1 -- 172.21.15.163:0/2520556005 shutdown_connections 2024-04-01T16:34:51.588 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.586+0000 7f0176200640 1 -- 172.21.15.163:0/2520556005 wait complete. 2024-04-01T16:34:51.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542157 for osd.1 2024-04-01T16:34:51.606 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.605+0000 7f428ea00640 1 -- 172.21.15.163:0/3392648689 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f428401f020 con 0x7f42980c8160 2024-04-01T16:34:51.606 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.606+0000 7fa712000640 1 -- 172.21.15.163:0/1056512777 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa71404e030 con 0x7fa71c15f270 2024-04-01T16:34:51.607 INFO:teuthology.orchestra.run.smithi163.stdout:64424509451 2024-04-01T16:34:51.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.610+0000 7fa721000640 1 -- 172.21.15.163:0/1056512777 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa6f806c8f0 msgr2=0x7fa6f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.610+0000 7fa721000640 1 --2- 172.21.15.163:0/1056512777 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa6f806c8f0 0x7fa6f806edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009670 tx=0x7fa70c006bf0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.610+0000 7fa721000640 1 -- 172.21.15.163:0/1056512777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c15f270 msgr2=0x7fa71c158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.610+0000 7fa721000640 1 --2- 172.21.15.163:0/1056512777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c15f270 0x7fa71c158540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa714033000 tx=0x7fa714004a40 comp rx=0 tx=0).stop 2024-04-01T16:34:51.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.610+0000 7fa721000640 1 -- 172.21.15.163:0/1056512777 shutdown_connections 2024-04-01T16:34:51.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.610+0000 7fa721000640 1 --2- 172.21.15.163:0/1056512777 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa6f806c8f0 0x7fa6f806edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.610+0000 7fa721000640 1 --2- 172.21.15.163:0/1056512777 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa71c15f270 0x7fa71c158540 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.610+0000 7fa721000640 1 --2- 172.21.15.163:0/1056512777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa71c0c1da0 0x7fa71c158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.610+0000 7fa721000640 1 --2- 172.21.15.163:0/1056512777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa71c0735e0 0x7fa71c14f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.610+0000 7fa721000640 1 -- 172.21.15.163:0/1056512777 >> 172.21.15.163:0/1056512777 conn(0x7fa71c0cbe20 msgr2=0x7fa71c15e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:51.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.610+0000 7fa721000640 1 -- 172.21.15.163:0/1056512777 shutdown_connections 2024-04-01T16:34:51.612 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.610+0000 7fa721000640 1 -- 172.21.15.163:0/1056512777 wait complete. 2024-04-01T16:34:51.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.4 2024-04-01T16:34:51.757 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.757+0000 7f1326400640 1 -- 172.21.15.163:0/585269829 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f13200739e0 con 0x7f1320070100 2024-04-01T16:34:51.768 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.768+0000 7f6a82e00640 1 -- 172.21.15.163:0/878305957 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6a7c072880 con 0x7f6a7c0c1da0 2024-04-01T16:34:51.844 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.843+0000 7f429d800640 1 -- 172.21.15.163:0/3392648689 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f42980739e0 con 0x7f42980c8160 2024-04-01T16:34:51.853 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.852+0000 7f428ea00640 1 -- 172.21.15.163:0/3392648689 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f429814ffe0 con 0x7f42980c8160 2024-04-01T16:34:51.853 INFO:teuthology.orchestra.run.smithi163.stdout:60129542154 2024-04-01T16:34:51.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.854+0000 7fc6baa00640 1 -- 172.21.15.163:0/4160619302 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc6c40ca640 con 0x7fc6c4154f00 2024-04-01T16:34:51.854 INFO:teuthology.orchestra.run.smithi163.stdout:64424509453 2024-04-01T16:34:51.855 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.855+0000 7f429d800640 1 -- 172.21.15.163:0/3392648689 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f427806c940 msgr2=0x7f427806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.855 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.855+0000 7f429d800640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f427806c940 0x7f427806ee00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4288036000 tx=0x7f428803c040 comp rx=0 tx=0).stop 2024-04-01T16:34:51.855 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.855+0000 7f429d800640 1 -- 172.21.15.163:0/3392648689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42980c8160 msgr2=0x7f4298159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.855+0000 7f429d800640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42980c8160 0x7f4298159bd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f428400b440 tx=0x7f428400b900 comp rx=0 tx=0).stop 2024-04-01T16:34:51.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.855+0000 7f429d800640 1 -- 172.21.15.163:0/3392648689 shutdown_connections 2024-04-01T16:34:51.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.855+0000 7f429d800640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f427806c940 0x7f427806ee00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.855+0000 7f429d800640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4298151700 0x7f429815a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.855+0000 7f429d800640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42980c8160 0x7f4298159bd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.855+0000 7f429d800640 1 --2- 172.21.15.163:0/3392648689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4298070100 0x7f429814e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.855+0000 7f429d800640 1 -- 172.21.15.163:0/3392648689 >> 172.21.15.163:0/3392648689 conn(0x7f42980cbe20 msgr2=0x7f42980cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:51.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.855+0000 7f429d800640 1 -- 172.21.15.163:0/3392648689 shutdown_connections 2024-04-01T16:34:51.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.855+0000 7f429d800640 1 -- 172.21.15.163:0/3392648689 wait complete. 2024-04-01T16:34:51.857 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7fc6c9400640 1 -- 172.21.15.163:0/4160619302 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc6a406c970 msgr2=0x7fc6a406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.858 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7fc6c9400640 1 --2- 172.21.15.163:0/4160619302 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc6a406c970 0x7fc6a406ee30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc6b40018b0 tx=0x7fc6b4009040 comp rx=0 tx=0).stop 2024-04-01T16:34:51.858 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7fc6c9400640 1 -- 172.21.15.163:0/4160619302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4154f00 msgr2=0x7fc6c41f7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.858 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7fc6c9400640 1 --2- 172.21.15.163:0/4160619302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4154f00 0x7fc6c41f7ff0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00eb70 tx=0x7fc6bc00c490 comp rx=0 tx=0).stop 2024-04-01T16:34:51.858 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7fc6c9400640 1 -- 172.21.15.163:0/4160619302 shutdown_connections 2024-04-01T16:34:51.858 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7fc6c9400640 1 --2- 172.21.15.163:0/4160619302 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc6a406c970 0x7fc6a406ee30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.858 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7fc6c9400640 1 --2- 172.21.15.163:0/4160619302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6c4154f00 0x7fc6c41f7ff0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.858 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7fc6c9400640 1 --2- 172.21.15.163:0/4160619302 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc6c40cc260 0x7fc6c415e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.858 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7fc6c9400640 1 --2- 172.21.15.163:0/4160619302 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc6c406d500 0x7fc6c406f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.858 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7fc6c9400640 1 -- 172.21.15.163:0/4160619302 >> 172.21.15.163:0/4160619302 conn(0x7fc6c40d01d0 msgr2=0x7fc6c40c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:51.858 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7fc6c9400640 1 -- 172.21.15.163:0/4160619302 shutdown_connections 2024-04-01T16:34:51.858 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7fc6c9400640 1 -- 172.21.15.163:0/4160619302 wait complete. 2024-04-01T16:34:51.859 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.857+0000 7f3372a00640 1 -- 172.21.15.163:0/777202011 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f336c018020 con 0x7f337c0735e0 2024-04-01T16:34:51.859 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.858+0000 7f3372a00640 1 --2- 172.21.15.163:0/777202011 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f335c06c940 0x7f335c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.859 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.859+0000 7f337a000640 1 --2- 172.21.15.163:0/777202011 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f335c06c940 0x7f335c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.859 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.859+0000 7f337a000640 1 --2- 172.21.15.163:0/777202011 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f335c06c940 0x7f335c06ee00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f337c15d6c0 tx=0x7f3368007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.864 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.864+0000 7f3372a00640 1 -- 172.21.15.163:0/777202011 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f336c0580a0 con 0x7f337c0735e0 2024-04-01T16:34:51.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.3 2024-04-01T16:34:51.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509453 for osd.2 2024-04-01T16:34:51.882 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.882+0000 7f3372a00640 1 -- 172.21.15.163:0/777202011 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f336c01f020 con 0x7f337c0735e0 2024-04-01T16:34:51.905 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.905+0000 7f1317400640 1 -- 172.21.15.163:0/585269829 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f131005d060 con 0x7f1320070100 2024-04-01T16:34:51.906 INFO:teuthology.orchestra.run.smithi163.stdout:60129542156 2024-04-01T16:34:51.907 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.907+0000 7f7723e00640 1 -- 172.21.15.163:0/172291484 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7718007070 con 0x7f772c151320 2024-04-01T16:34:51.908 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f7723e00640 1 --2- 172.21.15.163:0/172291484 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f770c06c970 0x7f770c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:51.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f1326400640 1 -- 172.21.15.163:0/585269829 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f130006c8f0 msgr2=0x7f130006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f1326400640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f130006c8f0 0x7f130006edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f13200727a0 tx=0x7f130c0090e0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f1326400640 1 -- 172.21.15.163:0/585269829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1320070100 msgr2=0x7f13201523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:51.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f1326400640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1320070100 0x7f13201523e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f131000c470 tx=0x7f131000c870 comp rx=0 tx=0).stop 2024-04-01T16:34:51.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f1326400640 1 -- 172.21.15.163:0/585269829 shutdown_connections 2024-04-01T16:34:51.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f1326400640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f130006c8f0 0x7f130006edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f1326400640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1320151700 0x7f1320157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f1326400640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f13200c8160 0x7f1320153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f1326400640 1 --2- 172.21.15.163:0/585269829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1320070100 0x7f13201523e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:51.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f1326400640 1 -- 172.21.15.163:0/585269829 >> 172.21.15.163:0/585269829 conn(0x7f13200cbe20 msgr2=0x7f132015a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:51.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f1326400640 1 -- 172.21.15.163:0/585269829 shutdown_connections 2024-04-01T16:34:51.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f1326400640 1 -- 172.21.15.163:0/585269829 wait complete. 2024-04-01T16:34:51.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.908+0000 7f772be00640 1 --2- 172.21.15.163:0/172291484 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f770c06c970 0x7f770c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:51.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.909+0000 7f772be00640 1 --2- 172.21.15.163:0/172291484 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f770c06c970 0x7f770c06ee30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f771c006dd0 tx=0x7f771c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:51.931 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.931+0000 7f7723e00640 1 -- 172.21.15.163:0/172291484 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f7718079ea0 con 0x7f772c151320 2024-04-01T16:34:51.931 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:51.931+0000 7f7723e00640 1 -- 172.21.15.163:0/172291484 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f771807c500 con 0x7f772c151320 2024-04-01T16:34:51.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542156 for osd.6 2024-04-01T16:34:52.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.008+0000 7f6a73e00640 1 -- 172.21.15.163:0/878305957 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6a7c162080 con 0x7f6a7c0c1da0 2024-04-01T16:34:52.009 INFO:teuthology.orchestra.run.smithi163.stdout:64424509451 2024-04-01T16:34:52.012 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.011+0000 7f6a82e00640 1 -- 172.21.15.163:0/878305957 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6a5c06c940 msgr2=0x7f6a5c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:52.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.011+0000 7f6a82e00640 1 --2- 172.21.15.163:0/878305957 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6a5c06c940 0x7f6a5c06ee00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009650 tx=0x7f6a6c006ba0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.011+0000 7f6a82e00640 1 -- 172.21.15.163:0/878305957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a7c0c1da0 msgr2=0x7f6a7c15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:52.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.011+0000 7f6a82e00640 1 --2- 172.21.15.163:0/878305957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a7c0c1da0 0x7f6a7c15a400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a68000c00 tx=0x7f6a680046c0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.012+0000 7f6a82e00640 1 -- 172.21.15.163:0/878305957 shutdown_connections 2024-04-01T16:34:52.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.012+0000 7f6a82e00640 1 --2- 172.21.15.163:0/878305957 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6a5c06c940 0x7f6a5c06ee00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.012+0000 7f6a82e00640 1 --2- 172.21.15.163:0/878305957 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6a7c15f270 0x7f6a7c1f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.012+0000 7f6a82e00640 1 --2- 172.21.15.163:0/878305957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a7c0c1da0 0x7f6a7c15a400 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.012+0000 7f6a82e00640 1 --2- 172.21.15.163:0/878305957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a7c0735e0 0x7f6a7c1608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.012+0000 7f6a82e00640 1 -- 172.21.15.163:0/878305957 >> 172.21.15.163:0/878305957 conn(0x7f6a7c0cbe20 msgr2=0x7f6a7c071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:52.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.012+0000 7f6a82e00640 1 -- 172.21.15.163:0/878305957 shutdown_connections 2024-04-01T16:34:52.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.012+0000 7f6a82e00640 1 -- 172.21.15.163:0/878305957 wait complete. 2024-04-01T16:34:52.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.7 2024-04-01T16:34:52.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.094+0000 7f3381c00640 1 -- 172.21.15.163:0/777202011 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f337c072880 con 0x7f337c0735e0 2024-04-01T16:34:52.104 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.103+0000 7f3372a00640 1 -- 172.21.15.163:0/777202011 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f336c00d040 con 0x7f337c0735e0 2024-04-01T16:34:52.104 INFO:teuthology.orchestra.run.smithi163.stdout:64424509450 2024-04-01T16:34:52.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.106+0000 7f3381c00640 1 -- 172.21.15.163:0/777202011 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f335c06c940 msgr2=0x7f335c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:52.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.106+0000 7f3381c00640 1 --2- 172.21.15.163:0/777202011 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f335c06c940 0x7f335c06ee00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f337c15d6c0 tx=0x7f3368007a40 comp rx=0 tx=0).stop 2024-04-01T16:34:52.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.106+0000 7f3381c00640 1 -- 172.21.15.163:0/777202011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f337c0735e0 msgr2=0x7f337c155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:52.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.106+0000 7f3381c00640 1 --2- 172.21.15.163:0/777202011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f337c0735e0 0x7f337c155c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f336c00b440 tx=0x7f336c00b900 comp rx=0 tx=0).stop 2024-04-01T16:34:52.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.106+0000 7f3381c00640 1 -- 172.21.15.163:0/777202011 shutdown_connections 2024-04-01T16:34:52.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.106+0000 7f3381c00640 1 --2- 172.21.15.163:0/777202011 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f335c06c940 0x7f335c06ee00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.106+0000 7f3381c00640 1 --2- 172.21.15.163:0/777202011 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f337c0c2180 0x7f337c1e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.106+0000 7f3381c00640 1 --2- 172.21.15.163:0/777202011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f337c0c1da0 0x7f337c150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.106+0000 7f3381c00640 1 --2- 172.21.15.163:0/777202011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f337c0735e0 0x7f337c155c20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.108 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.106+0000 7f3381c00640 1 -- 172.21.15.163:0/777202011 >> 172.21.15.163:0/777202011 conn(0x7f337c0cbe20 msgr2=0x7f337c15cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:52.108 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.106+0000 7f3381c00640 1 -- 172.21.15.163:0/777202011 shutdown_connections 2024-04-01T16:34:52.108 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.106+0000 7f3381c00640 1 -- 172.21.15.163:0/777202011 wait complete. 2024-04-01T16:34:52.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2024-04-01T16:34:52.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.158+0000 7f7731600640 1 -- 172.21.15.163:0/172291484 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f772c06e3e0 con 0x7f772c151320 2024-04-01T16:34:52.244 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.243+0000 7f7723e00640 1 -- 172.21.15.163:0/172291484 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f771807be00 con 0x7f772c151320 2024-04-01T16:34:52.245 INFO:teuthology.orchestra.run.smithi163.stdout:64424509449 2024-04-01T16:34:52.247 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.247+0000 7f7731600640 1 -- 172.21.15.163:0/172291484 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f770c06c970 msgr2=0x7f770c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:52.247 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.247+0000 7f7731600640 1 --2- 172.21.15.163:0/172291484 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f770c06c970 0x7f770c06ee30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f771c006dd0 tx=0x7f771c008040 comp rx=0 tx=0).stop 2024-04-01T16:34:52.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.247+0000 7f7731600640 1 -- 172.21.15.163:0/172291484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f772c151320 msgr2=0x7f772c14f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:52.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.247+0000 7f7731600640 1 --2- 172.21.15.163:0/172291484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f772c151320 0x7f772c14f770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f771800c190 tx=0x7f7718001970 comp rx=0 tx=0).stop 2024-04-01T16:34:52.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.247+0000 7f7731600640 1 -- 172.21.15.163:0/172291484 shutdown_connections 2024-04-01T16:34:52.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.247+0000 7f7731600640 1 --2- 172.21.15.163:0/172291484 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f770c06c970 0x7f770c06ee30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.247+0000 7f7731600640 1 --2- 172.21.15.163:0/172291484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f772c151df0 0x7f772c14fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.247+0000 7f7731600640 1 --2- 172.21.15.163:0/172291484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f772c151320 0x7f772c14f770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.247+0000 7f7731600640 1 --2- 172.21.15.163:0/172291484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f772c0ca760 0x7f772c0b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.247+0000 7f7731600640 1 -- 172.21.15.163:0/172291484 >> 172.21.15.163:0/172291484 conn(0x7f772c0b1910 msgr2=0x7f772c0b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:52.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.247+0000 7f7731600640 1 -- 172.21.15.163:0/172291484 shutdown_connections 2024-04-01T16:34:52.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.247+0000 7f7731600640 1 -- 172.21.15.163:0/172291484 wait complete. 2024-04-01T16:34:52.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2024-04-01T16:34:52.606 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-01T16:34:52.637 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-01T16:34:52.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.804+0000 7f9803600640 1 Processor -- start 2024-04-01T16:34:52.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.804+0000 7f9803600640 1 -- start start 2024-04-01T16:34:52.806 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.806+0000 7f9803600640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f97fc154b90 0x7f97fc0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.806 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.806+0000 7f9803600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f97fc15e660 0x7f97fc0ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.806 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.806+0000 7f9803600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97fc0ce900 0x7f97fc15bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.807 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.806+0000 7f9803600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc06c560 con 0x7f97fc15e660 2024-04-01T16:34:52.807 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.806+0000 7f9803600640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc06c820 con 0x7f97fc154b90 2024-04-01T16:34:52.807 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.806+0000 7f9803600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc06cb00 con 0x7f97fc0ce900 2024-04-01T16:34:52.807 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.807+0000 7f97f3e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f97fc15e660 0x7f97fc0ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:52.807 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.807+0000 7f9800c00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f97fc154b90 0x7f97fc0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:52.807 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.807+0000 7f97f3e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f97fc15e660 0x7f97fc0ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50452/0 (socket says 172.21.15.163:50452) 2024-04-01T16:34:52.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.807+0000 7f97f3e00640 1 -- 172.21.15.163:0/4057529375 learned_addr learned my addr 172.21.15.163:0/4057529375 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:52.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.808+0000 7f9801600640 1 --2- 172.21.15.163:0/4057529375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97fc0ce900 0x7f97fc15bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:52.810 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.809+0000 7f97f3e00640 1 -- 172.21.15.163:0/4057529375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97fc0ce900 msgr2=0x7f97fc15bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:52.810 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.809+0000 7f97f3e00640 1 --2- 172.21.15.163:0/4057529375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97fc0ce900 0x7f97fc15bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.810 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.809+0000 7f97f3e00640 1 -- 172.21.15.163:0/4057529375 >> v2:172.21.15.189:3300/0 conn(0x7f97fc154b90 msgr2=0x7f97fc0710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:52.810 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.809+0000 7f97f3e00640 1 --2- 172.21.15.163:0/4057529375 >> v2:172.21.15.189:3300/0 conn(0x7f97fc154b90 0x7f97fc0710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.810 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.810+0000 7f97f3e00640 1 -- 172.21.15.163:0/4057529375 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc06cde0 con 0x7f97fc15e660 2024-04-01T16:34:52.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.812+0000 7f97f3e00640 1 --2- 172.21.15.163:0/4057529375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97fc15e660 0x7f97fc0ce3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f97fc070fc0 tx=0x7f97e402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca6b1c2d527f379 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:52.815 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.814+0000 7f97fbe00640 1 -- 172.21.15.163:0/4057529375 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4034070 con 0x7f97fc15e660 2024-04-01T16:34:52.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.816+0000 7f97fbe00640 1 -- 172.21.15.163:0/4057529375 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e4030860 con 0x7f97fc15e660 2024-04-01T16:34:52.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.816+0000 7f97fbe00640 1 -- 172.21.15.163:0/4057529375 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4030c30 con 0x7f97fc15e660 2024-04-01T16:34:52.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.817+0000 7f9803600640 1 -- 172.21.15.163:0/4057529375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97fc15e660 msgr2=0x7f97fc0ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:52.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.817+0000 7f9803600640 1 --2- 172.21.15.163:0/4057529375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97fc15e660 0x7f97fc0ce3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f97fc070fc0 tx=0x7f97e402b9a0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.817+0000 7f9803600640 1 -- 172.21.15.163:0/4057529375 shutdown_connections 2024-04-01T16:34:52.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.817+0000 7f9803600640 1 --2- 172.21.15.163:0/4057529375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97fc15e660 0x7f97fc0ce3c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.817+0000 7f9803600640 1 --2- 172.21.15.163:0/4057529375 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97fc0ce900 0x7f97fc15bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.817+0000 7f9803600640 1 --2- 172.21.15.163:0/4057529375 >> v2:172.21.15.189:3300/0 conn(0x7f97fc154b90 0x7f97fc0710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.817+0000 7f9803600640 1 -- 172.21.15.163:0/4057529375 >> 172.21.15.163:0/4057529375 conn(0x7f97fc0676a0 msgr2=0x7f97fc067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:52.819 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.817+0000 7f9803600640 1 -- 172.21.15.163:0/4057529375 shutdown_connections 2024-04-01T16:34:52.819 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.818+0000 7f9803600640 1 -- 172.21.15.163:0/4057529375 wait complete. 2024-04-01T16:34:52.820 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.819+0000 7f9803600640 1 Processor -- start 2024-04-01T16:34:52.820 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.820+0000 7f9803600640 1 -- start start 2024-04-01T16:34:52.821 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.820+0000 7f9803600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97fc0ce900 0x7f97fc142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.821 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.821+0000 7f9803600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97fc154b90 0x7f97fc1504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.821 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.821+0000 7f9803600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97fc15e660 0x7f97fc150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.821 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.821+0000 7f9803600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc15ea80 con 0x7f97fc154b90 2024-04-01T16:34:52.821 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.821+0000 7f9803600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc06d3a0 con 0x7f97fc15e660 2024-04-01T16:34:52.821 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.821+0000 7f9803600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc15c4e0 con 0x7f97fc0ce900 2024-04-01T16:34:52.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.821+0000 7f97f3e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97fc154b90 0x7f97fc1504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:52.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.822+0000 7f97f3e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97fc154b90 0x7f97fc1504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50456/0 (socket says 172.21.15.163:50456) 2024-04-01T16:34:52.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.822+0000 7f97f3e00640 1 -- 172.21.15.163:0/2960535930 learned_addr learned my addr 172.21.15.163:0/2960535930 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:52.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.822+0000 7f9801600640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97fc15e660 0x7f97fc150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:52.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.823+0000 7f9800c00640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97fc0ce900 0x7f97fc142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:52.826 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.825+0000 7f97f3e00640 1 -- 172.21.15.163:0/2960535930 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97fc0ce900 msgr2=0x7f97fc142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:52.826 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.825+0000 7f97f3e00640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97fc0ce900 0x7f97fc142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.826 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.825+0000 7f97f3e00640 1 -- 172.21.15.163:0/2960535930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97fc15e660 msgr2=0x7f97fc150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:52.826 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.825+0000 7f97f3e00640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97fc15e660 0x7f97fc150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.826 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.825+0000 7f97f3e00640 1 -- 172.21.15.163:0/2960535930 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc1f1310 con 0x7f97fc154b90 2024-04-01T16:34:52.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.828+0000 7f97f3e00640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97fc154b90 0x7f97fc1504f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f97e4000c00 tx=0x7f97e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:52.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.833+0000 7f97f9600640 1 -- 172.21.15.163:0/2960535930 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4034040 con 0x7f97fc154b90 2024-04-01T16:34:52.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.833+0000 7f97f9600640 1 -- 172.21.15.163:0/2960535930 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e403ad20 con 0x7f97fc154b90 2024-04-01T16:34:52.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.833+0000 7f97f9600640 1 -- 172.21.15.163:0/2960535930 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4044610 con 0x7f97fc154b90 2024-04-01T16:34:52.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.833+0000 7f9803600640 1 -- 172.21.15.163:0/2960535930 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc0cd8d0 con 0x7f97fc154b90 2024-04-01T16:34:52.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.833+0000 7f9803600640 1 -- 172.21.15.163:0/2960535930 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc1f1030 con 0x7f97fc154b90 2024-04-01T16:34:52.835 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.834+0000 7f9803600640 1 -- 172.21.15.163:0/2960535930 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc06e7e0 con 0x7f97fc154b90 2024-04-01T16:34:52.860 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.860+0000 7f97f9600640 1 -- 172.21.15.163:0/2960535930 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f97e4037070 con 0x7f97fc154b90 2024-04-01T16:34:52.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.860+0000 7f97f9600640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f97d806c940 0x7f97d806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.861+0000 7f9800c00640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f97d806c940 0x7f97d806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:52.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.861+0000 7f0133e00640 1 Processor -- start 2024-04-01T16:34:52.862 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.861+0000 7f0133e00640 1 -- start start 2024-04-01T16:34:52.862 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.861+0000 7f9800c00640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f97d806c940 0x7f97d806ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009ac0 tx=0x7f97ec009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:52.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.862+0000 7f0133e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f01340cc7f0 0x7f01340ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.862+0000 7f0133e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013415bac0 0x7f013415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.862+0000 7f0133e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01340cad10 con 0x7f01340ca760 2024-04-01T16:34:52.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.863+0000 7f0133e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f013415d9c0 con 0x7f01340cc7f0 2024-04-01T16:34:52.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.863+0000 7f0133e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f013415b610 con 0x7f013415bac0 2024-04-01T16:34:52.865 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.864+0000 7f0132000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013415bac0 0x7f013415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:52.865 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.865+0000 7f0132000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013415bac0 0x7f013415b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:38228/0 (socket says 172.21.15.163:38228) 2024-04-01T16:34:52.865 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.865+0000 7f0132000640 1 -- 172.21.15.163:0/1071715998 learned_addr learned my addr 172.21.15.163:0/1071715998 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:52.872 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.871+0000 7f0132000640 1 -- 172.21.15.163:0/1071715998 >> v2:172.21.15.163:3300/0 conn(0x7f01340cc7f0 msgr2=0x7f01340ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:52.872 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.871+0000 7f0132000640 1 --2- 172.21.15.163:0/1071715998 >> v2:172.21.15.163:3300/0 conn(0x7f01340cc7f0 0x7f01340ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.872 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.871+0000 7f0132000640 1 -- 172.21.15.163:0/1071715998 >> v1:172.21.15.163:6789/0 conn(0x7f01340ca760 legacy=0x7f013406d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:52.872 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.871+0000 7f0132000640 1 -- 172.21.15.163:0/1071715998 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013406ca80 con 0x7f013415bac0 2024-04-01T16:34:52.874 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-01T16:34:52.876 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-01T16:34:52.879 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.876+0000 7f0132000640 1 --2- 172.21.15.163:0/1071715998 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013415bac0 0x7f013415b0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0120009870 tx=0x7f012002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9592ea916a82a787 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:52.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.888+0000 7f0131600640 1 -- 172.21.15.163:0/1071715998 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0120035020 con 0x7f013415bac0 2024-04-01T16:34:52.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.888+0000 7f0131600640 1 -- 172.21.15.163:0/1071715998 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0120031640 con 0x7f013415bac0 2024-04-01T16:34:52.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.888+0000 7f0131600640 1 -- 172.21.15.163:0/1071715998 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012002d040 con 0x7f013415bac0 2024-04-01T16:34:52.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.889+0000 7f0133e00640 1 -- 172.21.15.163:0/1071715998 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013415bac0 msgr2=0x7f013415b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:52.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.889+0000 7f0133e00640 1 --2- 172.21.15.163:0/1071715998 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013415bac0 0x7f013415b0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0120009870 tx=0x7f012002b8f0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.889+0000 7f0133e00640 1 -- 172.21.15.163:0/1071715998 shutdown_connections 2024-04-01T16:34:52.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.889+0000 7f0133e00640 1 --2- 172.21.15.163:0/1071715998 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013415bac0 0x7f013415b0d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.889+0000 7f0133e00640 1 --2- 172.21.15.163:0/1071715998 >> v2:172.21.15.163:3300/0 conn(0x7f01340cc7f0 0x7f01340ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.889+0000 7f0133e00640 1 -- 172.21.15.163:0/1071715998 >> 172.21.15.163:0/1071715998 conn(0x7f01340b1910 msgr2=0x7f01340b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:52.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.889+0000 7f0133e00640 1 -- 172.21.15.163:0/1071715998 shutdown_connections 2024-04-01T16:34:52.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.889+0000 7f0133e00640 1 -- 172.21.15.163:0/1071715998 wait complete. 2024-04-01T16:34:52.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.892+0000 7f0133e00640 1 Processor -- start 2024-04-01T16:34:52.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.892+0000 7f0133e00640 1 -- start start 2024-04-01T16:34:52.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.894+0000 7f0133e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01340ca760 0x7f0134157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.894+0000 7f0133e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01340cc7f0 0x7f013414fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.894+0000 7f0133e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013415bac0 0x7f01341502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.894+0000 7f0133e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f013406d040 con 0x7f01340cc7f0 2024-04-01T16:34:52.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.894+0000 7f0133e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f01340caff0 con 0x7f01340ca760 2024-04-01T16:34:52.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.894+0000 7f0133e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f013406d320 con 0x7f013415bac0 2024-04-01T16:34:52.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.895+0000 7f0132a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01340ca760 0x7f0134157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:52.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.895+0000 7f0132a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01340ca760 0x7f0134157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:46680/0 (socket says 172.21.15.163:46680) 2024-04-01T16:34:52.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.895+0000 7f0132a00640 1 -- 172.21.15.163:0/986019148 learned_addr learned my addr 172.21.15.163:0/986019148 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:52.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.896+0000 7f0133400640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013415bac0 0x7f01341502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:52.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.901+0000 7f0132a00640 1 -- 172.21.15.163:0/986019148 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013415bac0 msgr2=0x7f01341502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:52.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.901+0000 7f0132a00640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013415bac0 0x7f01341502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.901+0000 7f0132a00640 1 -- 172.21.15.163:0/986019148 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01340cc7f0 msgr2=0x7f013414fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:52.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.901+0000 7f0132a00640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01340cc7f0 0x7f013414fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:52.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.901+0000 7f0132a00640 1 -- 172.21.15.163:0/986019148 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0134157100 con 0x7f01340ca760 2024-04-01T16:34:52.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.905+0000 7f0132a00640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01340ca760 0x7f0134157b20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f012400b4d0 tx=0x7f012400b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.912+0000 7f012aa00640 1 -- 172.21.15.163:0/986019148 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124014070 con 0x7f01340ca760 2024-04-01T16:34:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.912+0000 7f012aa00640 1 -- 172.21.15.163:0/986019148 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0124010870 con 0x7f01340ca760 2024-04-01T16:34:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.912+0000 7f012aa00640 1 -- 172.21.15.163:0/986019148 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124010c60 con 0x7f01340ca760 2024-04-01T16:34:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.912+0000 7f0133e00640 1 -- 172.21.15.163:0/986019148 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01341573e0 con 0x7f01340ca760 2024-04-01T16:34:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.912+0000 7f0133e00640 1 -- 172.21.15.163:0/986019148 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0134153a40 con 0x7f01340ca760 2024-04-01T16:34:52.914 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.914+0000 7f0133e00640 1 -- 172.21.15.163:0/986019148 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01340756d0 con 0x7f01340ca760 2024-04-01T16:34:52.935 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-01T16:34:52.969 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.969+0000 7f012aa00640 1 -- 172.21.15.163:0/986019148 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0124017070 con 0x7f01340ca760 2024-04-01T16:34:52.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.971+0000 7f012aa00640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f011406c940 0x7f011406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:52.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.971+0000 7f0132000640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f011406c940 0x7f011406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:52.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:52.972+0000 7f0132000640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f011406c940 0x7f011406ee00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0120009870 tx=0x7f0120030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.038 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-01T16:34:53.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.054+0000 7fe81f400640 1 Processor -- start 2024-04-01T16:34:53.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.055+0000 7fe81f400640 1 -- start start 2024-04-01T16:34:53.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.056+0000 7fe81f400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 0x7fe8180c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.056+0000 7fe81f400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe8180735e0 0x7fe818071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.056+0000 7fe81f400640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe818162080 con 0x7fe818072420 2024-04-01T16:34:53.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.056+0000 7fe81f400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fe818163020 con 0x7fe8180735e0 2024-04-01T16:34:53.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.056+0000 7fe81f400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe81806f740 con 0x7fe8180c1da0 2024-04-01T16:34:53.059 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.058+0000 7fe81ca00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 0x7fe8180c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.059 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.059+0000 7fe81ca00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 0x7fe8180c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:38240/0 (socket says 172.21.15.163:38240) 2024-04-01T16:34:53.059 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.059+0000 7fe81ca00640 1 -- 172.21.15.163:0/1075572956 learned_addr learned my addr 172.21.15.163:0/1075572956 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:53.064 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.063+0000 7f0534000640 1 Processor -- start 2024-04-01T16:34:53.064 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.063+0000 7f0534000640 1 -- start start 2024-04-01T16:34:53.064 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.064+0000 7fe81ca00640 1 -- 172.21.15.163:0/1075572956 >> v2:172.21.15.163:3300/0 conn(0x7fe8180735e0 msgr2=0x7fe818071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:53.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.064+0000 7fe81ca00640 1 --2- 172.21.15.163:0/1075572956 >> v2:172.21.15.163:3300/0 conn(0x7fe8180735e0 0x7fe818071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.064+0000 7fe81ca00640 1 -- 172.21.15.163:0/1075572956 >> v1:172.21.15.189:6789/0 conn(0x7fe818072420 legacy=0x7fe81815f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:53.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.064+0000 7fe81ca00640 1 -- 172.21.15.163:0/1075572956 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81815ea90 con 0x7fe8180c1da0 2024-04-01T16:34:53.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.065+0000 7f0534000640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f052c154af0 0x7f052c15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.065+0000 7f0534000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f052c06d050 0x7f052c06c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.065+0000 7f0534000640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f052c0cacf0 con 0x7f052c06c950 2024-04-01T16:34:53.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.065+0000 7f0534000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f052c15b8f0 con 0x7f052c06d050 2024-04-01T16:34:53.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.065+0000 7f0534000640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f052c0cafd0 con 0x7f052c154af0 2024-04-01T16:34:53.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.075+0000 7fe81ca00640 1 --2- 172.21.15.163:0/1075572956 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 0x7fe8180c2180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009870 tx=0x7fe80c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=757553bafdc4a5c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.085 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.084+0000 7fe817400640 1 -- 172.21.15.163:0/1075572956 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c035020 con 0x7fe8180c1da0 2024-04-01T16:34:53.085 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.084+0000 7fe817400640 1 -- 172.21.15.163:0/1075572956 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80c031640 con 0x7fe8180c1da0 2024-04-01T16:34:53.085 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.084+0000 7fe817400640 1 -- 172.21.15.163:0/1075572956 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c02d040 con 0x7fe8180c1da0 2024-04-01T16:34:53.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.085+0000 7fe81f400640 1 -- 172.21.15.163:0/1075572956 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 msgr2=0x7fe8180c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.085+0000 7fe81f400640 1 --2- 172.21.15.163:0/1075572956 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 0x7fe8180c2180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009870 tx=0x7fe80c02b8f0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.085+0000 7fe81f400640 1 -- 172.21.15.163:0/1075572956 shutdown_connections 2024-04-01T16:34:53.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.085+0000 7fe81f400640 1 --2- 172.21.15.163:0/1075572956 >> v2:172.21.15.163:3300/0 conn(0x7fe8180735e0 0x7fe818071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.085+0000 7fe81f400640 1 --2- 172.21.15.163:0/1075572956 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 0x7fe8180c2180 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.085+0000 7fe81f400640 1 -- 172.21.15.163:0/1075572956 >> 172.21.15.163:0/1075572956 conn(0x7fe8180cbe20 msgr2=0x7fe8180cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:53.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.085+0000 7fe81f400640 1 -- 172.21.15.163:0/1075572956 shutdown_connections 2024-04-01T16:34:53.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.085+0000 7fe81f400640 1 -- 172.21.15.163:0/1075572956 wait complete. 2024-04-01T16:34:53.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.087+0000 7fe81f400640 1 Processor -- start 2024-04-01T16:34:53.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.087+0000 7fe81f400640 1 -- start start 2024-04-01T16:34:53.088 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.088+0000 7fe81f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe818072420 0x7fe8181f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.088+0000 7fe81f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8180735e0 0x7fe81814f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.088+0000 7fe81f400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 0x7fe8181e8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.088+0000 7fe81f400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe81806ff50 con 0x7fe818072420 2024-04-01T16:34:53.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.088+0000 7fe81f400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe81806fc70 con 0x7fe8180735e0 2024-04-01T16:34:53.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.088+0000 7fe81f400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe818070230 con 0x7fe8180c1da0 2024-04-01T16:34:53.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.090+0000 7fe81d400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 0x7fe8181e8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.091 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.091+0000 7fe81d400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 0x7fe8181e8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:38256/0 (socket says 172.21.15.163:38256) 2024-04-01T16:34:53.091 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.091+0000 7fe81d400640 1 -- 172.21.15.163:0/3031929252 learned_addr learned my addr 172.21.15.163:0/3031929252 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:53.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.100+0000 7fe81d400640 1 -- 172.21.15.163:0/3031929252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8180735e0 msgr2=0x7fe81814f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.100+0000 7fe81d400640 1 --2- 172.21.15.163:0/3031929252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8180735e0 0x7fe81814f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.100+0000 7fe81d400640 1 -- 172.21.15.163:0/3031929252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe818072420 msgr2=0x7fe8181f8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.100+0000 7fe81d400640 1 --2- 172.21.15.163:0/3031929252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe818072420 0x7fe8181f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.100+0000 7fe81d400640 1 -- 172.21.15.163:0/3031929252 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8181f4bf0 con 0x7fe8180c1da0 2024-04-01T16:34:53.106 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.105+0000 7fe81d400640 1 --2- 172.21.15.163:0/3031929252 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 0x7fe8181e8000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe81000ba10 tx=0x7fe81000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.109+0000 7f5c36600640 1 Processor -- start 2024-04-01T16:34:53.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.109+0000 7f5c36600640 1 -- start start 2024-04-01T16:34:53.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.110+0000 7f5c36600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5c30154af0 0x7f5c3015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.110+0000 7f5c36600640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5c3006d050 0x7f5c3006c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.110+0000 7f5c36600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c3006c950 0x7f5c300b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.110+0000 7f5c36600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f5c3015b8f0 con 0x7f5c30154af0 2024-04-01T16:34:53.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.110+0000 7f5c36600640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5c300cacf0 con 0x7f5c3006d050 2024-04-01T16:34:53.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.110+0000 7f5c36600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5c300cafd0 con 0x7f5c3006c950 2024-04-01T16:34:53.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.116+0000 7fe814c00640 1 -- 172.21.15.163:0/3031929252 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810019070 con 0x7fe8180c1da0 2024-04-01T16:34:53.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.116+0000 7fe814c00640 1 -- 172.21.15.163:0/3031929252 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81000cba0 con 0x7fe8180c1da0 2024-04-01T16:34:53.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.116+0000 7fe814c00640 1 -- 172.21.15.163:0/3031929252 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810014440 con 0x7fe8180c1da0 2024-04-01T16:34:53.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.116+0000 7fe81f400640 1 -- 172.21.15.163:0/3031929252 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8181eacf0 con 0x7fe8180c1da0 2024-04-01T16:34:53.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.117+0000 7fe81f400640 1 -- 172.21.15.163:0/3031929252 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8181f5140 con 0x7fe8180c1da0 2024-04-01T16:34:53.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.117+0000 7f5c2fe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c3006c950 0x7f5c300b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.118+0000 7fe81f400640 1 -- 172.21.15.163:0/3031929252 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8180756d0 con 0x7fe8180c1da0 2024-04-01T16:34:53.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.118+0000 7f5c2fe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c3006c950 0x7f5c300b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:38260/0 (socket says 172.21.15.163:38260) 2024-04-01T16:34:53.119 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.118+0000 7f5c2fe00640 1 -- 172.21.15.163:0/4269188605 learned_addr learned my addr 172.21.15.163:0/4269188605 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:53.126 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-01T16:34:53.149 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.149+0000 7f97f9600640 1 -- 172.21.15.163:0/2960535930 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5825+0+0 (secure 0 0 0) 0x7f97e407a0e0 con 0x7f97fc154b90 2024-04-01T16:34:53.149 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.149+0000 7f97f9600640 1 -- 172.21.15.163:0/2960535930 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f97e403f070 con 0x7f97fc154b90 2024-04-01T16:34:53.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.169+0000 7f0530c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f052c06d050 0x7f052c06c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.170+0000 7f0530c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f052c06d050 0x7f052c06c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50478/0 (socket says 172.21.15.163:50478) 2024-04-01T16:34:53.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.170+0000 7f0530c00640 1 -- 172.21.15.163:0/1159225200 learned_addr learned my addr 172.21.15.163:0/1159225200 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:53.173 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.173+0000 7f0530c00640 1 -- 172.21.15.163:0/1159225200 >> v2:172.21.15.189:3300/0 conn(0x7f052c154af0 msgr2=0x7f052c15b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:53.174 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.173+0000 7f0530c00640 1 --2- 172.21.15.163:0/1159225200 >> v2:172.21.15.189:3300/0 conn(0x7f052c154af0 0x7f052c15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.174 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.173+0000 7f0530c00640 1 -- 172.21.15.163:0/1159225200 >> v1:172.21.15.189:6789/0 conn(0x7f052c06c950 legacy=0x7f052c0b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:53.174 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.173+0000 7f0530c00640 1 -- 172.21.15.163:0/1159225200 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052c0cb2b0 con 0x7f052c06d050 2024-04-01T16:34:53.176 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.175+0000 7f5c2fe00640 1 -- 172.21.15.163:0/4269188605 >> v2:172.21.15.189:3300/0 conn(0x7f5c3006d050 msgr2=0x7f5c3006c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:53.176 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.175+0000 7f5c2fe00640 1 --2- 172.21.15.163:0/4269188605 >> v2:172.21.15.189:3300/0 conn(0x7f5c3006d050 0x7f5c3006c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.176 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.175+0000 7f5c2fe00640 1 -- 172.21.15.163:0/4269188605 >> v2:172.21.15.163:3300/0 conn(0x7f5c30154af0 msgr2=0x7f5c3015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:53.176 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.175+0000 7f5c2fe00640 1 --2- 172.21.15.163:0/4269188605 >> v2:172.21.15.163:3300/0 conn(0x7f5c30154af0 0x7f5c3015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.176 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.175+0000 7f5c2fe00640 1 -- 172.21.15.163:0/4269188605 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c300cb2b0 con 0x7f5c3006c950 2024-04-01T16:34:53.178 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.177+0000 7fe814c00640 1 -- 172.21.15.163:0/3031929252 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe81001c070 con 0x7fe8180c1da0 2024-04-01T16:34:53.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.179+0000 7fe814c00640 1 --2- 172.21.15.163:0/3031929252 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe7f806c940 0x7fe7f806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.179+0000 7fe81ca00640 1 --2- 172.21.15.163:0/3031929252 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe7f806c940 0x7fe7f806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.180 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.180+0000 7fe81ca00640 1 --2- 172.21.15.163:0/3031929252 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe7f806c940 0x7fe7f806ee00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe80c036000 tx=0x7fe80c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.181 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.181+0000 7f0530c00640 1 --2- 172.21.15.163:0/1159225200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f052c06d050 0x7f052c06c410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0518009870 tx=0x7f051802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9cbaa818d3a437 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.189+0000 7f052be00640 1 -- 172.21.15.163:0/1159225200 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518035020 con 0x7f052c06d050 2024-04-01T16:34:53.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.189+0000 7f052be00640 1 -- 172.21.15.163:0/1159225200 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0518031870 con 0x7f052c06d050 2024-04-01T16:34:53.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.189+0000 7f052be00640 1 -- 172.21.15.163:0/1159225200 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518031c40 con 0x7f052c06d050 2024-04-01T16:34:53.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.190+0000 7f0534000640 1 -- 172.21.15.163:0/1159225200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f052c06d050 msgr2=0x7f052c06c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.191 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.190+0000 7f0534000640 1 --2- 172.21.15.163:0/1159225200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f052c06d050 0x7f052c06c410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0518009870 tx=0x7f051802b910 comp rx=0 tx=0).stop 2024-04-01T16:34:53.191 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.191+0000 7f0534000640 1 -- 172.21.15.163:0/1159225200 shutdown_connections 2024-04-01T16:34:53.191 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.191+0000 7f0534000640 1 --2- 172.21.15.163:0/1159225200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f052c06d050 0x7f052c06c410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.191 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.191+0000 7f0534000640 1 --2- 172.21.15.163:0/1159225200 >> v2:172.21.15.189:3300/0 conn(0x7f052c154af0 0x7f052c15b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.191 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.191+0000 7f0534000640 1 -- 172.21.15.163:0/1159225200 >> 172.21.15.163:0/1159225200 conn(0x7f052c0cffa0 msgr2=0x7f052c0d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:53.192 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.191+0000 7f0534000640 1 -- 172.21.15.163:0/1159225200 shutdown_connections 2024-04-01T16:34:53.192 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.191+0000 7f0534000640 1 -- 172.21.15.163:0/1159225200 wait complete. 2024-04-01T16:34:53.193 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.193+0000 7f0534000640 1 Processor -- start 2024-04-01T16:34:53.193 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.193+0000 7f0534000640 1 -- start start 2024-04-01T16:34:53.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.194+0000 7f0534000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f052c06c950 0x7f052c1532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.194+0000 7f0534000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f052c06d050 0x7f052c1f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.194+0000 7f0534000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f052c154af0 0x7f052c1f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.194+0000 7f0534000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f052c0cbb50 con 0x7f052c06d050 2024-04-01T16:34:53.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.194+0000 7f0534000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f052c0cb870 con 0x7f052c154af0 2024-04-01T16:34:53.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.194+0000 7f0534000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f052c0ca920 con 0x7f052c06c950 2024-04-01T16:34:53.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.219+0000 7f0530c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f052c06d050 0x7f052c1f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.220+0000 7f0530c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f052c06d050 0x7f052c1f10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50500/0 (socket says 172.21.15.163:50500) 2024-04-01T16:34:53.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.220+0000 7f0530c00640 1 -- 172.21.15.163:0/973593028 learned_addr learned my addr 172.21.15.163:0/973593028 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:53.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.225+0000 7f0530c00640 1 -- 172.21.15.163:0/973593028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f052c06c950 msgr2=0x7f052c1532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.226 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.225+0000 7f0530c00640 1 --2- 172.21.15.163:0/973593028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f052c06c950 0x7f052c1532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.226 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.225+0000 7f0530c00640 1 -- 172.21.15.163:0/973593028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f052c154af0 msgr2=0x7f052c1f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.226 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.225+0000 7f0530c00640 1 --2- 172.21.15.163:0/973593028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f052c154af0 0x7f052c1f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.226 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.225+0000 7f0530c00640 1 -- 172.21.15.163:0/973593028 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052c1f05e0 con 0x7f052c06d050 2024-04-01T16:34:53.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.229+0000 7f0530c00640 1 --2- 172.21.15.163:0/973593028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f052c06d050 0x7f052c1f10a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0518009870 tx=0x7f05180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.231+0000 7f278b200640 1 Processor -- start 2024-04-01T16:34:53.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.231+0000 7f278b200640 1 -- start start 2024-04-01T16:34:53.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.232+0000 7f278b200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f278415b120 0x7f27840c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.232+0000 7f278b200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278406c560 con 0x7f27840ce690 2024-04-01T16:34:53.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.232+0000 7f278b200640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2784071730 con 0x7f27840cea70 2024-04-01T16:34:53.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.232+0000 7f278b200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f278406c820 con 0x7f278415b120 2024-04-01T16:34:53.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.237+0000 7f0529600640 1 -- 172.21.15.163:0/973593028 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051803ad60 con 0x7f052c06d050 2024-04-01T16:34:53.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.237+0000 7f0529600640 1 -- 172.21.15.163:0/973593028 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05180443f0 con 0x7f052c06d050 2024-04-01T16:34:53.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.237+0000 7f0534000640 1 -- 172.21.15.163:0/973593028 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052c150b60 con 0x7f052c06d050 2024-04-01T16:34:53.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.237+0000 7f0529600640 1 -- 172.21.15.163:0/973593028 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05180447e0 con 0x7f052c06d050 2024-04-01T16:34:53.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.237+0000 7f0534000640 1 -- 172.21.15.163:0/973593028 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f052c151120 con 0x7f052c06d050 2024-04-01T16:34:53.238 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.238+0000 7f2783e00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f27840ce690 0x7f2784071020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:42724/0 (socket says 172.21.15.163:42724) 2024-04-01T16:34:53.238 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.238+0000 7f2783e00640 1 -- 172.21.15.163:0/4294086748 learned_addr learned my addr 172.21.15.163:0/4294086748 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:53.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.238+0000 7f0534000640 1 -- 172.21.15.163:0/973593028 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f052c0756d0 con 0x7f052c06d050 2024-04-01T16:34:53.273 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-01T16:34:53.291 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.290+0000 7f012aa00640 1 -- 172.21.15.163:0/986019148 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5825+0+0 (secure 0 0 0) 0x7f0124057b90 con 0x7f01340ca760 2024-04-01T16:34:53.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.312+0000 7f02d5800640 1 Processor -- start 2024-04-01T16:34:53.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.312+0000 7f02d5800640 1 -- start start 2024-04-01T16:34:53.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.313+0000 7f02d5800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f02d015bac0 0x7f02d00ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.313+0000 7f02d5800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d00ca760 0x7f02d015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.313+0000 7f02d5800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d00cad10 con 0x7f02d00cc7f0 2024-04-01T16:34:53.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.313+0000 7f02d5800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f02d015d9c0 con 0x7f02d015bac0 2024-04-01T16:34:53.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.313+0000 7f02d5800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f02d015b610 con 0x7f02d00ca760 2024-04-01T16:34:53.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.328+0000 7f012aa00640 1 -- 172.21.15.163:0/986019148 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0124059af0 con 0x7f01340ca760 2024-04-01T16:34:53.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.348+0000 7f2789200640 1 --2- 172.21.15.163:0/4294086748 >> v2:172.21.15.189:3300/0 conn(0x7f278415b120 0x7f27840c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.356 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.356+0000 7f02cfe00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f02d00cc7f0 0x7f02d006d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:45402/0 (socket says 172.21.15.163:45402) 2024-04-01T16:34:53.356 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.356+0000 7f02cfe00640 1 -- 172.21.15.163:0/2235835191 learned_addr learned my addr 172.21.15.163:0/2235835191 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:53.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.360+0000 7f2789200640 1 -- 172.21.15.163:0/4294086748 >> v1:172.21.15.189:6789/0 conn(0x7f27840cea70 legacy=0x7f2784154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:53.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.360+0000 7f2789200640 1 -- 172.21.15.163:0/4294086748 >> v1:172.21.15.163:6789/0 conn(0x7f27840ce690 legacy=0x7f2784071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.360+0000 7f2789200640 1 -- 172.21.15.163:0/4294086748 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278406cb00 con 0x7f278415b120 2024-04-01T16:34:53.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.373+0000 7f2789200640 1 --2- 172.21.15.163:0/4294086748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f278415b120 0x7f27840c34a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f277c009d90 tx=0x7f277c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=641887667c62460c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.376 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.375+0000 7f9803600640 1 -- 172.21.15.163:0/2960535930 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f97fc0756d0 con 0x7f97fc154b90 2024-04-01T16:34:53.382 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.381+0000 7f2782a00640 1 -- 172.21.15.163:0/4294086748 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c039070 con 0x7f278415b120 2024-04-01T16:34:53.382 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.382+0000 7f2782a00640 1 -- 172.21.15.163:0/4294086748 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c02cc60 con 0x7f278415b120 2024-04-01T16:34:53.382 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.382+0000 7f2782a00640 1 -- 172.21.15.163:0/4294086748 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c034660 con 0x7f278415b120 2024-04-01T16:34:53.383 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.383+0000 7f278b200640 1 -- 172.21.15.163:0/4294086748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f278415b120 msgr2=0x7f27840c34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.383 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.383+0000 7f278b200640 1 --2- 172.21.15.163:0/4294086748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f278415b120 0x7f27840c34a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f277c009d90 tx=0x7f277c02beb0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.383 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.383+0000 7f278b200640 1 -- 172.21.15.163:0/4294086748 shutdown_connections 2024-04-01T16:34:53.383 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.383+0000 7f278b200640 1 --2- 172.21.15.163:0/4294086748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f278415b120 0x7f27840c34a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.383 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.383+0000 7f278b200640 1 -- 172.21.15.163:0/4294086748 >> 172.21.15.163:0/4294086748 conn(0x7f27840676a0 msgr2=0x7f2784067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:53.383 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.383+0000 7f278b200640 1 -- 172.21.15.163:0/4294086748 shutdown_connections 2024-04-01T16:34:53.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.383+0000 7f278b200640 1 -- 172.21.15.163:0/4294086748 wait complete. 2024-04-01T16:34:53.386 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.385+0000 7f278b200640 1 Processor -- start 2024-04-01T16:34:53.386 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.386+0000 7f278b200640 1 -- start start 2024-04-01T16:34:53.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.387+0000 7f278b200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27840ce690 0x7f27840af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.387+0000 7f278b200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27840cea70 0x7f27840caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.387+0000 7f278b200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f278415b120 0x7f27841f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.387+0000 7f278b200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f278415b590 con 0x7f278415b120 2024-04-01T16:34:53.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.387+0000 7f278b200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f278406d0c0 con 0x7f27840ce690 2024-04-01T16:34:53.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.387+0000 7f278b200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2784154c80 con 0x7f27840cea70 2024-04-01T16:34:53.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.388+0000 7f2783e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27840ce690 0x7f27840af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.389+0000 7f2783e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27840ce690 0x7f27840af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:46720/0 (socket says 172.21.15.163:46720) 2024-04-01T16:34:53.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.389+0000 7f2783e00640 1 -- 172.21.15.163:0/452678825 learned_addr learned my addr 172.21.15.163:0/452678825 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:53.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.399+0000 7f2783e00640 1 -- 172.21.15.163:0/452678825 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27840cea70 msgr2=0x7f27840caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.399+0000 7f2783e00640 1 --2- 172.21.15.163:0/452678825 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27840cea70 0x7f27840caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.399+0000 7f2783e00640 1 -- 172.21.15.163:0/452678825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f278415b120 msgr2=0x7f27841f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.399+0000 7f2783e00640 1 --2- 172.21.15.163:0/452678825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f278415b120 0x7f27841f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.399+0000 7f2783e00640 1 -- 172.21.15.163:0/452678825 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278414e630 con 0x7f27840ce690 2024-04-01T16:34:53.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.405+0000 7f2783e00640 1 --2- 172.21.15.163:0/452678825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27840ce690 0x7f27840af140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f277400c400 tx=0x7f277400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.420+0000 7f277be00640 1 -- 172.21.15.163:0/452678825 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774017070 con 0x7f27840ce690 2024-04-01T16:34:53.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.420+0000 7f277be00640 1 -- 172.21.15.163:0/452678825 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2774005ce0 con 0x7f27840ce690 2024-04-01T16:34:53.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.420+0000 7f277be00640 1 -- 172.21.15.163:0/452678825 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27740072f0 con 0x7f27840ce690 2024-04-01T16:34:53.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.420+0000 7f278b200640 1 -- 172.21.15.163:0/452678825 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27841f0530 con 0x7f27840ce690 2024-04-01T16:34:53.421 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.420+0000 7f278b200640 1 -- 172.21.15.163:0/452678825 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27840b2870 con 0x7f27840ce690 2024-04-01T16:34:53.421 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.421+0000 7f278b200640 1 -- 172.21.15.163:0/452678825 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27840756d0 con 0x7f27840ce690 2024-04-01T16:34:53.448 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.447+0000 7f5a22a00640 1 Processor -- start 2024-04-01T16:34:53.448 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.447+0000 7f5a22a00640 1 -- start start 2024-04-01T16:34:53.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.449+0000 7f5a22a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a1c151700 0x7f5a1c15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.449+0000 7f5a22a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a1c15b040 con 0x7f5a1c0c8160 2024-04-01T16:34:53.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.449+0000 7f5a22a00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a1c15b320 con 0x7f5a1c070100 2024-04-01T16:34:53.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.449+0000 7f5a22a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1c0c3060 con 0x7f5a1c151700 2024-04-01T16:34:53.481 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.481+0000 7f277be00640 1 -- 172.21.15.163:0/452678825 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f277401a070 con 0x7f27840ce690 2024-04-01T16:34:53.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.482+0000 7f277be00640 1 --2- 172.21.15.163:0/452678825 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f276406c970 0x7f276406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.482+0000 7f2783400640 1 --2- 172.21.15.163:0/452678825 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f276406c970 0x7f276406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.483+0000 7f2783400640 1 --2- 172.21.15.163:0/452678825 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f276406c970 0x7f276406ee30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f27840cee80 tx=0x7f27700079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.503+0000 7fe814c00640 1 -- 172.21.15.163:0/3031929252 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5825+0+0 (secure 0 0 0) 0x7fe810057ae0 con 0x7fe8180c1da0 2024-04-01T16:34:53.519 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.519+0000 7f0529600640 1 -- 172.21.15.163:0/973593028 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f051804b060 con 0x7f052c06d050 2024-04-01T16:34:53.520 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.520+0000 7f0529600640 1 --2- 172.21.15.163:0/973593028 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f050c06c940 0x7f050c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.521 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.520+0000 7f0531600640 1 --2- 172.21.15.163:0/973593028 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f050c06c940 0x7f050c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.522 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.522+0000 7f0531600640 1 --2- 172.21.15.163:0/973593028 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f050c06c940 0x7f050c06ee00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0520009710 tx=0x7f0520006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.526 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.526+0000 7fe814c00640 1 -- 172.21.15.163:0/3031929252 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe810023020 con 0x7fe8180c1da0 2024-04-01T16:34:53.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.528+0000 7f5c2fe00640 1 --2- 172.21.15.163:0/4269188605 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c3006c950 0x7f5c300b4490 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c3008d900 tx=0x7f5c2802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a3bf49b4381aa9b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.535 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.535+0000 7f02d4e00640 1 --2- 172.21.15.163:0/2235835191 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d00ca760 0x7f02d015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.537 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.537+0000 7f0133e00640 1 -- 172.21.15.163:0/986019148 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f013406dba0 con 0x7f01340ca760 2024-04-01T16:34:53.544 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.543+0000 7f02d4e00640 1 -- 172.21.15.163:0/2235835191 >> v2:172.21.15.163:3300/0 conn(0x7f02d015bac0 msgr2=0x7f02d00ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:53.544 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.543+0000 7f02d4e00640 1 --2- 172.21.15.163:0/2235835191 >> v2:172.21.15.163:3300/0 conn(0x7f02d015bac0 0x7f02d00ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.544 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.543+0000 7f02d4e00640 1 -- 172.21.15.163:0/2235835191 >> v1:172.21.15.189:6789/0 conn(0x7f02d00cc7f0 legacy=0x7f02d006d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.544 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.543+0000 7f02d4e00640 1 -- 172.21.15.163:0/2235835191 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d006ca80 con 0x7f02d00ca760 2024-04-01T16:34:53.546 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.546+0000 7f0529600640 1 -- 172.21.15.163:0/973593028 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5825+0+0 (secure 0 0 0) 0x7f0518079f60 con 0x7f052c06d050 2024-04-01T16:34:53.547 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.547+0000 7f0529600640 1 -- 172.21.15.163:0/973593028 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f051803f070 con 0x7f052c06d050 2024-04-01T16:34:53.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.552+0000 7f5a1be00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a1c151700 0x7f5a1c15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.555 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.555+0000 7f02d4e00640 1 --2- 172.21.15.163:0/2235835191 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d00ca760 0x7f02d015b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009d90 tx=0x7f02c802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=633e7a77a8bc3b16 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.557 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.557+0000 7f5a1be00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a1c151700 0x7f5a1c15aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:38282/0 (socket says 172.21.15.163:38282) 2024-04-01T16:34:53.557 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.557+0000 7f5a1be00640 1 -- 172.21.15.163:0/2160965567 learned_addr learned my addr 172.21.15.163:0/2160965567 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:53.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.559+0000 7f5c2e000640 1 -- 172.21.15.163:0/4269188605 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2802ca80 con 0x7f5c3006c950 2024-04-01T16:34:53.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.559+0000 7f5c2e000640 1 -- 172.21.15.163:0/4269188605 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2802cc20 con 0x7f5c3006c950 2024-04-01T16:34:53.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.559+0000 7f5c2e000640 1 -- 172.21.15.163:0/4269188605 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c280343f0 con 0x7f5c3006c950 2024-04-01T16:34:53.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.560+0000 7f97f9600640 1 -- 172.21.15.163:0/2960535930 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f97e407c040 con 0x7f97fc154b90 2024-04-01T16:34:53.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.560+0000 7f5c36600640 1 -- 172.21.15.163:0/4269188605 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c3006c950 msgr2=0x7f5c300b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.560+0000 7f5c36600640 1 --2- 172.21.15.163:0/4269188605 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c3006c950 0x7f5c300b4490 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c3008d900 tx=0x7f5c2802bee0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.561 INFO:teuthology.orchestra.run.smithi163.stdout:60129542157 2024-04-01T16:34:53.562 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.560+0000 7f5c36600640 1 -- 172.21.15.163:0/4269188605 shutdown_connections 2024-04-01T16:34:53.562 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.560+0000 7f5c36600640 1 --2- 172.21.15.163:0/4269188605 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c3006c950 0x7f5c300b4490 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.562 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.560+0000 7f5c36600640 1 --2- 172.21.15.163:0/4269188605 >> v2:172.21.15.189:3300/0 conn(0x7f5c3006d050 0x7f5c3006c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.562 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.560+0000 7f5c36600640 1 --2- 172.21.15.163:0/4269188605 >> v2:172.21.15.163:3300/0 conn(0x7f5c30154af0 0x7f5c3015b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.562 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.560+0000 7f5c36600640 1 -- 172.21.15.163:0/4269188605 >> 172.21.15.163:0/4269188605 conn(0x7f5c300cffa0 msgr2=0x7f5c300d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:53.562 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.561+0000 7f5c36600640 1 -- 172.21.15.163:0/4269188605 shutdown_connections 2024-04-01T16:34:53.562 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.561+0000 7f5c36600640 1 -- 172.21.15.163:0/4269188605 wait complete. 2024-04-01T16:34:53.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.562+0000 7f5c36600640 1 Processor -- start 2024-04-01T16:34:53.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.563+0000 7f5c36600640 1 -- start start 2024-04-01T16:34:53.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.563+0000 7f9803600640 1 -- 172.21.15.163:0/2960535930 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f97d806c940 msgr2=0x7f97d806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f9803600640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f97d806c940 0x7f97d806ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009ac0 tx=0x7f97ec009190 comp rx=0 tx=0).stop 2024-04-01T16:34:53.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f9803600640 1 -- 172.21.15.163:0/2960535930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97fc154b90 msgr2=0x7f97fc1504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f9803600640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97fc154b90 0x7f97fc1504f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f97e4000c00 tx=0x7f97e40046c0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f9803600640 1 -- 172.21.15.163:0/2960535930 shutdown_connections 2024-04-01T16:34:53.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f9803600640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f97d806c940 0x7f97d806ee00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f9803600640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97fc15e660 0x7f97fc150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f9803600640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f97fc154b90 0x7f97fc1504f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f9803600640 1 --2- 172.21.15.163:0/2960535930 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f97fc0ce900 0x7f97fc142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f9803600640 1 -- 172.21.15.163:0/2960535930 >> 172.21.15.163:0/2960535930 conn(0x7f97fc0676a0 msgr2=0x7f97fc067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:53.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f5c36600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c3006c950 0x7f5c300c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f9803600640 1 -- 172.21.15.163:0/2960535930 shutdown_connections 2024-04-01T16:34:53.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f5c36600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c3006d050 0x7f5c300b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f9803600640 1 -- 172.21.15.163:0/2960535930 wait complete. 2024-04-01T16:34:53.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f5c36600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c30154af0 0x7f5c3014d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f5c36600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5c300cbb50 con 0x7f5c3006d050 2024-04-01T16:34:53.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f5c36600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5c300cb870 con 0x7f5c3006c950 2024-04-01T16:34:53.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f5c36600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5c300ca920 con 0x7f5c30154af0 2024-04-01T16:34:53.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.564+0000 7f02cea00640 1 -- 172.21.15.163:0/2235835191 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8039070 con 0x7f02d00ca760 2024-04-01T16:34:53.570 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.569+0000 7f5a1be00640 1 -- 172.21.15.163:0/2160965567 >> v1:172.21.15.189:6789/0 conn(0x7f5a1c070100 legacy=0x7f5a1c0c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:53.570 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.570+0000 7f5a1be00640 1 -- 172.21.15.163:0/2160965567 >> v1:172.21.15.163:6789/0 conn(0x7f5a1c0c8160 legacy=0x7f5a1c0c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.570 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.570+0000 7f5a1be00640 1 -- 172.21.15.163:0/2160965567 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1c15b600 con 0x7f5a1c151700 2024-04-01T16:34:53.578 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.578+0000 7f5c2ea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c3006d050 0x7f5c300b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.579 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.579+0000 7f02cea00640 1 -- 172.21.15.163:0/2235835191 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c802cbc0 con 0x7f02d00ca760 2024-04-01T16:34:53.579 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.579+0000 7f02cea00640 1 -- 172.21.15.163:0/2235835191 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8034440 con 0x7f02d00ca760 2024-04-01T16:34:53.580 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.580+0000 7f02d5800640 1 -- 172.21.15.163:0/2235835191 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d00ca760 msgr2=0x7f02d015b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.580 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.580+0000 7f02d5800640 1 --2- 172.21.15.163:0/2235835191 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d00ca760 0x7f02d015b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009d90 tx=0x7f02c802be10 comp rx=0 tx=0).stop 2024-04-01T16:34:53.580 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.580+0000 7f02d5800640 1 -- 172.21.15.163:0/2235835191 shutdown_connections 2024-04-01T16:34:53.581 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.580+0000 7f02d5800640 1 --2- 172.21.15.163:0/2235835191 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d00ca760 0x7f02d015b0d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.581 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.580+0000 7f02d5800640 1 --2- 172.21.15.163:0/2235835191 >> v2:172.21.15.163:3300/0 conn(0x7f02d015bac0 0x7f02d00ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.581 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.580+0000 7f02d5800640 1 -- 172.21.15.163:0/2235835191 >> 172.21.15.163:0/2235835191 conn(0x7f02d00b1910 msgr2=0x7f02d00b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:53.581 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.580+0000 7f02d5800640 1 -- 172.21.15.163:0/2235835191 shutdown_connections 2024-04-01T16:34:53.581 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.580+0000 7f02d5800640 1 -- 172.21.15.163:0/2235835191 wait complete. 2024-04-01T16:34:53.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.582+0000 7f02d5800640 1 Processor -- start 2024-04-01T16:34:53.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.582+0000 7f02d5800640 1 -- start start 2024-04-01T16:34:53.583 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.583+0000 7f02d5800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02d00ca760 0x7f02d0153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.583 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.583+0000 7f02d5800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02d00cc7f0 0x7f02d01f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.583 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.583+0000 7f02d5800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d015bac0 0x7f02d01f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.583 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.583+0000 7f02d5800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f02d006d040 con 0x7f02d00ca760 2024-04-01T16:34:53.584 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.583+0000 7f02d5800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02d00caff0 con 0x7f02d00cc7f0 2024-04-01T16:34:53.584 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.583+0000 7f02d5800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f02d006d320 con 0x7f02d015bac0 2024-04-01T16:34:53.585 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.585+0000 7f5a1be00640 1 --2- 172.21.15.163:0/2160965567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a1c151700 0x7f5a1c15aa00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00d180 tx=0x7f5a0c02e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51cd919956eefd61 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.586 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.586+0000 7f5c2ea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c3006d050 0x7f5c300b5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50528/0 (socket says 172.21.15.163:50528) 2024-04-01T16:34:53.586 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.586+0000 7f5c2ea00640 1 -- 172.21.15.163:0/2320851942 learned_addr learned my addr 172.21.15.163:0/2320851942 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:53.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542157 for osd.1 2024-04-01T16:34:53.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.595+0000 7f5a1b400640 1 -- 172.21.15.163:0/2160965567 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00b0d0 con 0x7f5a1c151700 2024-04-01T16:34:53.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.595+0000 7f5a1b400640 1 -- 172.21.15.163:0/2160965567 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0c00b270 con 0x7f5a1c151700 2024-04-01T16:34:53.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.595+0000 7f5a1b400640 1 -- 172.21.15.163:0/2160965567 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c009600 con 0x7f5a1c151700 2024-04-01T16:34:53.596 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.596+0000 7f5a22a00640 1 -- 172.21.15.163:0/2160965567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a1c151700 msgr2=0x7f5a1c15aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.596+0000 7f5a22a00640 1 --2- 172.21.15.163:0/2160965567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a1c151700 0x7f5a1c15aa00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00d180 tx=0x7f5a0c02e160 comp rx=0 tx=0).stop 2024-04-01T16:34:53.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.596+0000 7f5a22a00640 1 -- 172.21.15.163:0/2160965567 shutdown_connections 2024-04-01T16:34:53.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.596+0000 7f5a22a00640 1 --2- 172.21.15.163:0/2160965567 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a1c151700 0x7f5a1c15aa00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.596+0000 7f5a22a00640 1 -- 172.21.15.163:0/2160965567 >> 172.21.15.163:0/2160965567 conn(0x7f5a1c0cbe20 msgr2=0x7f5a1c0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:53.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.596+0000 7f5a22a00640 1 -- 172.21.15.163:0/2160965567 shutdown_connections 2024-04-01T16:34:53.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.596+0000 7f5a22a00640 1 -- 172.21.15.163:0/2160965567 wait complete. 2024-04-01T16:34:53.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.597+0000 7f5c2fe00640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c30154af0 0x7f5c3014d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.598+0000 7f5a22a00640 1 Processor -- start 2024-04-01T16:34:53.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.598+0000 7f5a22a00640 1 -- start start 2024-04-01T16:34:53.599 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.599+0000 7f5a22a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a1c070100 0x7f5a1c1ecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.599 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.599+0000 7f5a22a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c0c8160 0x7f5a1c147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.599 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.599+0000 7f5a22a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a1c151700 0x7f5a1c0c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:53.599 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.599+0000 7f5a22a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c0c7390 con 0x7f5a1c070100 2024-04-01T16:34:53.599 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.599+0000 7f5a22a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c15b8e0 con 0x7f5a1c0c8160 2024-04-01T16:34:53.600 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.599+0000 7f5a22a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1c151ae0 con 0x7f5a1c151700 2024-04-01T16:34:53.600 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.599+0000 7f02d4e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d015bac0 0x7f02d01f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.601 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.600+0000 7f02d4e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d015bac0 0x7f02d01f22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:38294/0 (socket says 172.21.15.163:38294) 2024-04-01T16:34:53.601 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.600+0000 7f02d4e00640 1 -- 172.21.15.163:0/2871006812 learned_addr learned my addr 172.21.15.163:0/2871006812 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.604+0000 7f5c2ea00640 1 -- 172.21.15.163:0/2320851942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c30154af0 msgr2=0x7f5c3014d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.604+0000 7f5c2ea00640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c30154af0 0x7f5c3014d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.604+0000 7f5c2ea00640 1 -- 172.21.15.163:0/2320851942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c3006c950 msgr2=0x7f5c300c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.605+0000 7f5c2ea00640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c3006c950 0x7f5c300c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.605 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.605+0000 7f5c2ea00640 1 -- 172.21.15.163:0/2320851942 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c300cf7c0 con 0x7f5c3006d050 2024-04-01T16:34:53.614 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.614+0000 7f5c2ea00640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c3006d050 0x7f5c300b5580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00b440 tx=0x7f5c1c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.614+0000 7f02cfe00640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02d00ca760 0x7f02d0153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.617+0000 7f02d4e00640 1 -- 172.21.15.163:0/2871006812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02d00cc7f0 msgr2=0x7f02d01f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.617+0000 7f02d4e00640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02d00cc7f0 0x7f02d01f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.617+0000 7f02d4e00640 1 -- 172.21.15.163:0/2871006812 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02d00ca760 msgr2=0x7f02d0153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.617+0000 7f02d4e00640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02d00ca760 0x7f02d0153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.617+0000 7f02d4e00640 1 -- 172.21.15.163:0/2871006812 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d00c64a0 con 0x7f02d015bac0 2024-04-01T16:34:53.625 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.625+0000 7f5a1be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a1c070100 0x7f5a1c1ecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:53.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.627+0000 7f5a1be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a1c070100 0x7f5a1c1ecbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50542/0 (socket says 172.21.15.163:50542) 2024-04-01T16:34:53.627 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.627+0000 7f5a1be00640 1 -- 172.21.15.163:0/4186206787 learned_addr learned my addr 172.21.15.163:0/4186206787 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:53.630 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.630+0000 7f02d4e00640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d015bac0 0x7f02d01f22b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009eb0 tx=0x7f02c8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.633 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.632+0000 7f5a1be00640 1 -- 172.21.15.163:0/4186206787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a1c151700 msgr2=0x7f5a1c0c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.633 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.632+0000 7f5a1be00640 1 --2- 172.21.15.163:0/4186206787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a1c151700 0x7f5a1c0c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.633 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.632+0000 7f5a1be00640 1 -- 172.21.15.163:0/4186206787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c0c8160 msgr2=0x7f5a1c147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.633 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.632+0000 7f5a1be00640 1 --2- 172.21.15.163:0/4186206787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c0c8160 0x7f5a1c147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.633 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.632+0000 7f5a1be00640 1 -- 172.21.15.163:0/4186206787 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1c14d980 con 0x7f5a1c070100 2024-04-01T16:34:53.686 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.686+0000 7f5a1be00640 1 --2- 172.21.15.163:0/4186206787 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a1c070100 0x7f5a1c1ecbd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00d2a0 tx=0x7f5a0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:53.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.709+0000 7f5c27400640 1 -- 172.21.15.163:0/2320851942 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c015020 con 0x7f5c3006d050 2024-04-01T16:34:53.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.709+0000 7f5c36600640 1 -- 172.21.15.163:0/2320851942 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c300cfaa0 con 0x7f5c3006d050 2024-04-01T16:34:53.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.710+0000 7f5c36600640 1 -- 172.21.15.163:0/2320851942 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c300ca3f0 con 0x7f5c3006d050 2024-04-01T16:34:53.711 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.711+0000 7f5c36600640 1 -- 172.21.15.163:0/2320851942 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c300756d0 con 0x7f5c3006d050 2024-04-01T16:34:53.714 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.713+0000 7f5c27400640 1 -- 172.21.15.163:0/2320851942 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1c011890 con 0x7f5c3006d050 2024-04-01T16:34:53.714 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.714+0000 7f5c27400640 1 -- 172.21.15.163:0/2320851942 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c011c60 con 0x7f5c3006d050 2024-04-01T16:34:53.716 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.716+0000 7f5a18c00640 1 -- 172.21.15.163:0/4186206787 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00b0d0 con 0x7f5a1c070100 2024-04-01T16:34:53.716 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.716+0000 7f5a18c00640 1 -- 172.21.15.163:0/4186206787 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0c045070 con 0x7f5a1c070100 2024-04-01T16:34:53.716 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.716+0000 7f5a18c00640 1 -- 172.21.15.163:0/4186206787 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00b720 con 0x7f5a1c070100 2024-04-01T16:34:53.716 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.716+0000 7f5a22a00640 1 -- 172.21.15.163:0/4186206787 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a1c14e330 con 0x7f5a1c070100 2024-04-01T16:34:53.717 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.716+0000 7f5a22a00640 1 -- 172.21.15.163:0/4186206787 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a1c14dc20 con 0x7f5a1c070100 2024-04-01T16:34:53.717 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.717+0000 7f5a22a00640 1 -- 172.21.15.163:0/4186206787 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1c0756d0 con 0x7f5a1c070100 2024-04-01T16:34:53.751 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.751+0000 7fe81f400640 1 -- 172.21.15.163:0/3031929252 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe8180cb390 con 0x7fe8180c1da0 2024-04-01T16:34:53.752 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.752+0000 7f02c7e00640 1 -- 172.21.15.163:0/2871006812 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8039050 con 0x7f02d015bac0 2024-04-01T16:34:53.752 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.752+0000 7f02d5800640 1 -- 172.21.15.163:0/2871006812 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d00c6720 con 0x7f02d015bac0 2024-04-01T16:34:53.752 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.752+0000 7f02d5800640 1 -- 172.21.15.163:0/2871006812 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d01f0c90 con 0x7f02d015bac0 2024-04-01T16:34:53.754 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.754+0000 7f02d5800640 1 -- 172.21.15.163:0/2871006812 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d01f1620 con 0x7f02d015bac0 2024-04-01T16:34:53.770 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.770+0000 7f02c7e00640 1 -- 172.21.15.163:0/2871006812 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c8045070 con 0x7f02d015bac0 2024-04-01T16:34:53.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.774+0000 7f0534000640 1 -- 172.21.15.163:0/973593028 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f052c068970 con 0x7f052c06d050 2024-04-01T16:34:53.799 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.799+0000 7f277be00640 1 -- 172.21.15.163:0/452678825 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5825+0+0 (secure 0 0 0) 0x7f27740570d0 con 0x7f27840ce690 2024-04-01T16:34:53.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.811+0000 7f02c7e00640 1 -- 172.21.15.163:0/2871006812 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c803e810 con 0x7f02d015bac0 2024-04-01T16:34:53.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.822+0000 7f277be00640 1 -- 172.21.15.163:0/452678825 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2774021020 con 0x7f27840ce690 2024-04-01T16:34:53.859 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.858+0000 7f012aa00640 1 -- 172.21.15.163:0/986019148 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f012405ddf0 con 0x7f01340ca760 2024-04-01T16:34:53.859 INFO:teuthology.orchestra.run.smithi163.stdout:64424509451 2024-04-01T16:34:53.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.862+0000 7f0133e00640 1 -- 172.21.15.163:0/986019148 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f011406c940 msgr2=0x7f011406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.862+0000 7f0133e00640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f011406c940 0x7f011406ee00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0120009870 tx=0x7f0120030000 comp rx=0 tx=0).stop 2024-04-01T16:34:53.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.862+0000 7f0133e00640 1 -- 172.21.15.163:0/986019148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01340ca760 msgr2=0x7f0134157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:53.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.862+0000 7f0133e00640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01340ca760 0x7f0134157b20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f012400b4d0 tx=0x7f012400b990 comp rx=0 tx=0).stop 2024-04-01T16:34:53.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.862+0000 7f0133e00640 1 -- 172.21.15.163:0/986019148 shutdown_connections 2024-04-01T16:34:53.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.862+0000 7f0133e00640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f011406c940 0x7f011406ee00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.862+0000 7f0133e00640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f013415bac0 0x7f01341502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.862+0000 7f0133e00640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01340cc7f0 0x7f013414fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.862+0000 7f0133e00640 1 --2- 172.21.15.163:0/986019148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01340ca760 0x7f0134157b20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:53.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.862+0000 7f0133e00640 1 -- 172.21.15.163:0/986019148 >> 172.21.15.163:0/986019148 conn(0x7f01340b1910 msgr2=0x7f01340b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:53.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.862+0000 7f0133e00640 1 -- 172.21.15.163:0/986019148 shutdown_connections 2024-04-01T16:34:53.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:53.862+0000 7f0133e00640 1 -- 172.21.15.163:0/986019148 wait complete. 2024-04-01T16:34:53.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.4 2024-04-01T16:34:54.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.016+0000 7f5c27400640 1 -- 172.21.15.163:0/2320851942 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c1c018020 con 0x7f5c3006d050 2024-04-01T16:34:54.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.017+0000 7f5c27400640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5c1006c8f0 0x7f5c1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:54.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.017+0000 7f5c2f400640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5c1006c8f0 0x7f5c1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:54.019 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.019+0000 7f5c2f400640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5c1006c8f0 0x7f5c1006edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009670 tx=0x7f5c20006bf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:54.052 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.052+0000 7f5c27400640 1 -- 172.21.15.163:0/2320851942 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5825+0+0 (secure 0 0 0) 0x7f5c1c011e00 con 0x7f5c3006d050 2024-04-01T16:34:54.053 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.052+0000 7f278b200640 1 -- 172.21.15.163:0/452678825 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f27840c87c0 con 0x7f27840ce690 2024-04-01T16:34:54.053 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.053+0000 7f5c27400640 1 -- 172.21.15.163:0/2320851942 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5c1c01f020 con 0x7f5c3006d050 2024-04-01T16:34:54.060 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.060+0000 7f277be00640 1 -- 172.21.15.163:0/452678825 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f278414e630 con 0x7f27840ce690 2024-04-01T16:34:54.060 INFO:teuthology.orchestra.run.smithi163.stdout:64424509451 2024-04-01T16:34:54.064 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.063+0000 7f278b200640 1 -- 172.21.15.163:0/452678825 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f276406c970 msgr2=0x7f276406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.063+0000 7f278b200640 1 --2- 172.21.15.163:0/452678825 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f276406c970 0x7f276406ee30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f27840cee80 tx=0x7f27700079b0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.063+0000 7f278b200640 1 -- 172.21.15.163:0/452678825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27840ce690 msgr2=0x7f27840af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.063+0000 7f278b200640 1 --2- 172.21.15.163:0/452678825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27840ce690 0x7f27840af140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f277400c400 tx=0x7f277400c8c0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.064+0000 7f278b200640 1 -- 172.21.15.163:0/452678825 shutdown_connections 2024-04-01T16:34:54.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.064+0000 7f278b200640 1 --2- 172.21.15.163:0/452678825 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f276406c970 0x7f276406ee30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.064+0000 7f278b200640 1 --2- 172.21.15.163:0/452678825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f278415b120 0x7f27841f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.064+0000 7f278b200640 1 --2- 172.21.15.163:0/452678825 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f27840cea70 0x7f27840caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.064+0000 7f278b200640 1 --2- 172.21.15.163:0/452678825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27840ce690 0x7f27840af140 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.064+0000 7f278b200640 1 -- 172.21.15.163:0/452678825 >> 172.21.15.163:0/452678825 conn(0x7f27840676a0 msgr2=0x7f278414a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:54.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.064+0000 7f278b200640 1 -- 172.21.15.163:0/452678825 shutdown_connections 2024-04-01T16:34:54.065 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.064+0000 7f278b200640 1 -- 172.21.15.163:0/452678825 wait complete. 2024-04-01T16:34:54.081 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.080+0000 7f02c7e00640 1 -- 172.21.15.163:0/2871006812 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02c803e9b0 con 0x7f02d015bac0 2024-04-01T16:34:54.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.082+0000 7f02c7e00640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f02b006c8f0 0x7f02b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:54.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.083+0000 7f02cfe00640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f02b006c8f0 0x7f02b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:54.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.084+0000 7f02cfe00640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f02b006c8f0 0x7f02b006edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005880 tx=0x7f02c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:54.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.7 2024-04-01T16:34:54.091 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.091+0000 7f02c7e00640 1 -- 172.21.15.163:0/2871006812 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5825+0+0 (secure 0 0 0) 0x7f02c807b290 con 0x7f02d015bac0 2024-04-01T16:34:54.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.112+0000 7f02c7e00640 1 -- 172.21.15.163:0/2871006812 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f02d00c64a0 con 0x7f02d015bac0 2024-04-01T16:34:54.114 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.113+0000 7fe814c00640 1 -- 172.21.15.163:0/3031929252 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe81005a140 con 0x7fe8180c1da0 2024-04-01T16:34:54.114 INFO:teuthology.orchestra.run.smithi163.stdout:60129542154 2024-04-01T16:34:54.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.116+0000 7fe81f400640 1 -- 172.21.15.163:0/3031929252 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe7f806c940 msgr2=0x7fe7f806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.116+0000 7fe81f400640 1 --2- 172.21.15.163:0/3031929252 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe7f806c940 0x7fe7f806ee00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe80c036000 tx=0x7fe80c030000 comp rx=0 tx=0).stop 2024-04-01T16:34:54.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.116+0000 7fe81f400640 1 -- 172.21.15.163:0/3031929252 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 msgr2=0x7fe8181e8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.116+0000 7fe81f400640 1 --2- 172.21.15.163:0/3031929252 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 0x7fe8181e8000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe81000ba10 tx=0x7fe81000bed0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.116+0000 7fe81f400640 1 -- 172.21.15.163:0/3031929252 shutdown_connections 2024-04-01T16:34:54.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.116+0000 7fe81f400640 1 --2- 172.21.15.163:0/3031929252 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe7f806c940 0x7fe7f806ee00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.116+0000 7fe81f400640 1 --2- 172.21.15.163:0/3031929252 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe8180c1da0 0x7fe8181e8000 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.116+0000 7fe81f400640 1 --2- 172.21.15.163:0/3031929252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8180735e0 0x7fe81814f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.116+0000 7fe81f400640 1 --2- 172.21.15.163:0/3031929252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe818072420 0x7fe8181f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.116+0000 7fe81f400640 1 -- 172.21.15.163:0/3031929252 >> 172.21.15.163:0/3031929252 conn(0x7fe8180cbe20 msgr2=0x7fe8180cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:54.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.116+0000 7fe81f400640 1 -- 172.21.15.163:0/3031929252 shutdown_connections 2024-04-01T16:34:54.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.116+0000 7fe81f400640 1 -- 172.21.15.163:0/3031929252 wait complete. 2024-04-01T16:34:54.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.3 2024-04-01T16:34:54.297 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.297+0000 7f5c36600640 1 -- 172.21.15.163:0/2320851942 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5c300b5fb0 con 0x7f5c3006d050 2024-04-01T16:34:54.342 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.342+0000 7f02d5800640 1 -- 172.21.15.163:0/2871006812 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f02d00756d0 con 0x7f02d015bac0 2024-04-01T16:34:54.344 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.344+0000 7f5a18c00640 1 -- 172.21.15.163:0/4186206787 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a0c02ed10 con 0x7f5a1c070100 2024-04-01T16:34:54.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.345+0000 7f5a18c00640 1 --2- 172.21.15.163:0/4186206787 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f59f806c940 0x7f59f806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:54.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.345+0000 7f5a13400640 1 --2- 172.21.15.163:0/4186206787 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f59f806c940 0x7f59f806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:54.346 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.346+0000 7f5a13400640 1 --2- 172.21.15.163:0/4186206787 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f59f806c940 0x7f59f806ee00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5a04006fd0 tx=0x7f5a04006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:54.351 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.351+0000 7f02c7e00640 1 -- 172.21.15.163:0/2871006812 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f02c807d8f0 con 0x7f02d015bac0 2024-04-01T16:34:54.351 INFO:teuthology.orchestra.run.smithi163.stdout:64424509450 2024-04-01T16:34:54.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.353+0000 7f02d5800640 1 -- 172.21.15.163:0/2871006812 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f02b006c8f0 msgr2=0x7f02b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.353+0000 7f02d5800640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f02b006c8f0 0x7f02b006edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005880 tx=0x7f02c0009040 comp rx=0 tx=0).stop 2024-04-01T16:34:54.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.353+0000 7f02d5800640 1 -- 172.21.15.163:0/2871006812 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d015bac0 msgr2=0x7f02d01f22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.353+0000 7f02d5800640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d015bac0 0x7f02d01f22b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009eb0 tx=0x7f02c8004a40 comp rx=0 tx=0).stop 2024-04-01T16:34:54.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.353+0000 7f02d5800640 1 -- 172.21.15.163:0/2871006812 shutdown_connections 2024-04-01T16:34:54.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.353+0000 7f02d5800640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f02b006c8f0 0x7f02b006edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.353+0000 7f02d5800640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f02d015bac0 0x7f02d01f22b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.353+0000 7f02d5800640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02d00cc7f0 0x7f02d01f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.353+0000 7f02d5800640 1 --2- 172.21.15.163:0/2871006812 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02d00ca760 0x7f02d0153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.353+0000 7f02d5800640 1 -- 172.21.15.163:0/2871006812 >> 172.21.15.163:0/2871006812 conn(0x7f02d00b1910 msgr2=0x7f02d0154460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:54.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.353+0000 7f02d5800640 1 -- 172.21.15.163:0/2871006812 shutdown_connections 2024-04-01T16:34:54.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.353+0000 7f02d5800640 1 -- 172.21.15.163:0/2871006812 wait complete. 2024-04-01T16:34:54.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.365+0000 7f5a18c00640 1 -- 172.21.15.163:0/4186206787 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5825+0+0 (secure 0 0 0) 0x7f5a0c07b370 con 0x7f5a1c070100 2024-04-01T16:34:54.366 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.365+0000 7f5a18c00640 1 -- 172.21.15.163:0/4186206787 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5a0c07d9d0 con 0x7f5a1c070100 2024-04-01T16:34:54.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2024-04-01T16:34:54.412 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.411+0000 7f0529600640 1 -- 172.21.15.163:0/973593028 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f051802f320 con 0x7f052c06d050 2024-04-01T16:34:54.412 INFO:teuthology.orchestra.run.smithi163.stdout:64424509453 2024-04-01T16:34:54.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.414+0000 7f0534000640 1 -- 172.21.15.163:0/973593028 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f050c06c940 msgr2=0x7f050c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.414+0000 7f0534000640 1 --2- 172.21.15.163:0/973593028 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f050c06c940 0x7f050c06ee00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0520009710 tx=0x7f0520006c90 comp rx=0 tx=0).stop 2024-04-01T16:34:54.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.414+0000 7f0534000640 1 -- 172.21.15.163:0/973593028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f052c06d050 msgr2=0x7f052c1f10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.414+0000 7f0534000640 1 --2- 172.21.15.163:0/973593028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f052c06d050 0x7f052c1f10a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0518009870 tx=0x7f05180046c0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.414+0000 7f0534000640 1 -- 172.21.15.163:0/973593028 shutdown_connections 2024-04-01T16:34:54.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.414+0000 7f0534000640 1 --2- 172.21.15.163:0/973593028 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f050c06c940 0x7f050c06ee00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.414+0000 7f0534000640 1 --2- 172.21.15.163:0/973593028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f052c154af0 0x7f052c1f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.414+0000 7f0534000640 1 --2- 172.21.15.163:0/973593028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f052c06d050 0x7f052c1f10a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.414+0000 7f0534000640 1 --2- 172.21.15.163:0/973593028 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f052c06c950 0x7f052c1532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.416 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.414+0000 7f0534000640 1 -- 172.21.15.163:0/973593028 >> 172.21.15.163:0/973593028 conn(0x7f052c0cffa0 msgr2=0x7f052c14fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:54.416 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.414+0000 7f0534000640 1 -- 172.21.15.163:0/973593028 shutdown_connections 2024-04-01T16:34:54.416 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.414+0000 7f0534000640 1 -- 172.21.15.163:0/973593028 wait complete. 2024-04-01T16:34:54.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509453 for osd.2 2024-04-01T16:34:54.467 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.466+0000 7f5c27400640 1 -- 172.21.15.163:0/2320851942 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5c1c00d040 con 0x7f5c3006d050 2024-04-01T16:34:54.467 INFO:teuthology.orchestra.run.smithi163.stdout:60129542156 2024-04-01T16:34:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.469+0000 7f5c36600640 1 -- 172.21.15.163:0/2320851942 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5c1006c8f0 msgr2=0x7f5c1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.469+0000 7f5c36600640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5c1006c8f0 0x7f5c1006edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009670 tx=0x7f5c20006bf0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.469+0000 7f5c36600640 1 -- 172.21.15.163:0/2320851942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c3006d050 msgr2=0x7f5c300b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.469+0000 7f5c36600640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c3006d050 0x7f5c300b5580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00b440 tx=0x7f5c1c00b900 comp rx=0 tx=0).stop 2024-04-01T16:34:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.469+0000 7f5c36600640 1 -- 172.21.15.163:0/2320851942 shutdown_connections 2024-04-01T16:34:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.469+0000 7f5c36600640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5c1006c8f0 0x7f5c1006edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.469+0000 7f5c36600640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5c30154af0 0x7f5c3014d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.469+0000 7f5c36600640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c3006d050 0x7f5c300b5580 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.469+0000 7f5c36600640 1 --2- 172.21.15.163:0/2320851942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c3006c950 0x7f5c300c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.471 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.469+0000 7f5c36600640 1 -- 172.21.15.163:0/2320851942 >> 172.21.15.163:0/2320851942 conn(0x7f5c300cffa0 msgr2=0x7f5c3014fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:54.471 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.469+0000 7f5c36600640 1 -- 172.21.15.163:0/2320851942 shutdown_connections 2024-04-01T16:34:54.471 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.469+0000 7f5c36600640 1 -- 172.21.15.163:0/2320851942 wait complete. 2024-04-01T16:34:54.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542156 for osd.6 2024-04-01T16:34:54.589 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-01T16:34:54.606 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.605+0000 7f5a22a00640 1 -- 172.21.15.163:0/4186206787 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5a1c0b1620 con 0x7f5a1c070100 2024-04-01T16:34:54.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.611+0000 7f5a18c00640 1 -- 172.21.15.163:0/4186206787 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5a0c07d2d0 con 0x7f5a1c070100 2024-04-01T16:34:54.611 INFO:teuthology.orchestra.run.smithi163.stdout:64424509451 2024-04-01T16:34:54.614 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.613+0000 7f5a22a00640 1 -- 172.21.15.163:0/4186206787 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f59f806c940 msgr2=0x7f59f806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.614 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.613+0000 7f5a22a00640 1 --2- 172.21.15.163:0/4186206787 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f59f806c940 0x7f59f806ee00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5a04006fd0 tx=0x7f5a04006bc0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.614 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.613+0000 7f5a22a00640 1 -- 172.21.15.163:0/4186206787 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a1c070100 msgr2=0x7f5a1c1ecbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.614 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.613+0000 7f5a22a00640 1 --2- 172.21.15.163:0/4186206787 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a1c070100 0x7f5a1c1ecbd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00d2a0 tx=0x7f5a0c004a40 comp rx=0 tx=0).stop 2024-04-01T16:34:54.614 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.614+0000 7f5a22a00640 1 -- 172.21.15.163:0/4186206787 shutdown_connections 2024-04-01T16:34:54.614 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.614+0000 7f5a22a00640 1 --2- 172.21.15.163:0/4186206787 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f59f806c940 0x7f59f806ee00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.614+0000 7f5a22a00640 1 --2- 172.21.15.163:0/4186206787 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5a1c151700 0x7f5a1c0c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.614+0000 7f5a22a00640 1 --2- 172.21.15.163:0/4186206787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a1c0c8160 0x7f5a1c147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.614+0000 7f5a22a00640 1 --2- 172.21.15.163:0/4186206787 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a1c070100 0x7f5a1c1ecbd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.614+0000 7f5a22a00640 1 -- 172.21.15.163:0/4186206787 >> 172.21.15.163:0/4186206787 conn(0x7f5a1c0cbe20 msgr2=0x7f5a1c14ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:54.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.614+0000 7f5a22a00640 1 -- 172.21.15.163:0/4186206787 shutdown_connections 2024-04-01T16:34:54.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.614+0000 7f5a22a00640 1 -- 172.21.15.163:0/4186206787 wait complete. 2024-04-01T16:34:54.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.0 2024-04-01T16:34:54.632 DEBUG:teuthology.parallel:result is None 2024-04-01T16:34:54.786 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.785+0000 7fd0e2a00640 1 Processor -- start 2024-04-01T16:34:54.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.785+0000 7fd0e2a00640 1 -- start start 2024-04-01T16:34:54.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.787+0000 7fd0e2a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd0dc0735e0 0x7fd0dc0c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:54.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.787+0000 7fd0e2a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0dc162080 con 0x7fd0dc15f270 2024-04-01T16:34:54.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.787+0000 7fd0e2a00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0dc15ea90 con 0x7fd0dc0c1da0 2024-04-01T16:34:54.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.787+0000 7fd0e2a00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd0dc163020 con 0x7fd0dc0735e0 2024-04-01T16:34:54.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.788+0000 7fd0dbe00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fd0dc0c1da0 0x7fd0dc071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:45426/0 (socket says 172.21.15.163:45426) 2024-04-01T16:34:54.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.788+0000 7fd0dbe00640 1 -- 172.21.15.163:0/808485484 learned_addr learned my addr 172.21.15.163:0/808485484 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:54.791 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.790+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1291516401 0 0) 0x7fd0d4001110 con 0x7fd0dc15f270 2024-04-01T16:34:54.791 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.790+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0bc003520 con 0x7fd0dc15f270 2024-04-01T16:34:54.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.794+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2836648390 0 0) 0x7fd0bc003520 con 0x7fd0dc15f270 2024-04-01T16:34:54.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.795+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 >> v2:172.21.15.189:3300/0 conn(0x7fd0dc0735e0 msgr2=0x7fd0dc0c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:54.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.795+0000 7fd0daa00640 1 --2- 172.21.15.163:0/808485484 >> v2:172.21.15.189:3300/0 conn(0x7fd0dc0735e0 0x7fd0dc0c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.795+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 >> v1:172.21.15.189:6789/0 conn(0x7fd0dc0c1da0 legacy=0x7fd0dc071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.795+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc0725f0 con 0x7fd0dc15f270 2024-04-01T16:34:54.796 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.795+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7fd0d4001840 con 0x7fd0dc15f270 2024-04-01T16:34:54.796 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.795+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 >> v1:172.21.15.163:6789/0 conn(0x7fd0dc15f270 legacy=0x7fd0dc169410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.796 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.795+0000 7fd0daa00640 1 --2- 172.21.15.163:0/808485484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0bc003a00 0x7fd0bc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:54.796 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.795+0000 7fd0daa00640 1 --2- 172.21.15.163:0/808485484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0bc004800 0x7fd0bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:54.796 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.795+0000 7fd0daa00640 1 --2- 172.21.15.163:0/808485484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0bc0053c0 0x7fd0bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:54.796 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.795+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc163020 con 0x7fd0bc003a00 2024-04-01T16:34:54.796 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.795+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc00c230 con 0x7fd0bc004800 2024-04-01T16:34:54.796 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.795+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd0bc00c430 con 0x7fd0bc0053c0 2024-04-01T16:34:54.797 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.796+0000 7fd0e0a00640 1 --2- 172.21.15.163:0/808485484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0bc0053c0 0x7fd0bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:54.798 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.798+0000 7fd0dbe00640 1 --2- 172.21.15.163:0/808485484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0bc003a00 0x7fd0bc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.804+0000 7fd0dbe00640 1 -- 172.21.15.163:0/808485484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0bc0053c0 msgr2=0x7fd0bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.804+0000 7fd0dbe00640 1 --2- 172.21.15.163:0/808485484 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0bc0053c0 0x7fd0bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.804+0000 7fd0dbe00640 1 -- 172.21.15.163:0/808485484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0bc004800 msgr2=0x7fd0bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.804+0000 7fd0db400640 1 --2- 172.21.15.163:0/808485484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0bc004800 0x7fd0bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.804+0000 7fd0dbe00640 1 --2- 172.21.15.163:0/808485484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0bc004800 0x7fd0bc004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.804+0000 7fd0dbe00640 1 -- 172.21.15.163:0/808485484 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0bc003520 con 0x7fd0bc003a00 2024-04-01T16:34:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.804+0000 7fd0e0a00640 1 -- 172.21.15.163:0/808485484 reap_dead start 2024-04-01T16:34:54.810 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.809+0000 7fd0dbe00640 1 --2- 172.21.15.163:0/808485484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0bc003a00 0x7fd0bc003e20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc001810 tx=0x7fd0bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb83ab5394bf5669 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:54.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.816+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc001460 con 0x7fd0bc003a00 2024-04-01T16:34:54.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.816+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0cc004aa0 con 0x7fd0bc003a00 2024-04-01T16:34:54.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.816+0000 7fd0daa00640 1 -- 172.21.15.163:0/808485484 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc004e50 con 0x7fd0bc003a00 2024-04-01T16:34:54.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.817+0000 7fd0e2a00640 1 -- 172.21.15.163:0/808485484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0bc003a00 msgr2=0x7fd0bc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.817+0000 7fd0e2a00640 1 --2- 172.21.15.163:0/808485484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0bc003a00 0x7fd0bc003e20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc001810 tx=0x7fd0bc005830 comp rx=0 tx=0).stop 2024-04-01T16:34:54.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.818+0000 7fd0e2a00640 1 -- 172.21.15.163:0/808485484 shutdown_connections 2024-04-01T16:34:54.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.818+0000 7fd0e2a00640 1 --2- 172.21.15.163:0/808485484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0bc003a00 0x7fd0bc003e20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.818+0000 7fd0e2a00640 1 -- 172.21.15.163:0/808485484 >> 172.21.15.163:0/808485484 conn(0x7fd0dc0cbe20 msgr2=0x7fd0dc0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:54.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.818+0000 7fd0e2a00640 1 -- 172.21.15.163:0/808485484 shutdown_connections 2024-04-01T16:34:54.819 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.818+0000 7fd0e2a00640 1 -- 172.21.15.163:0/808485484 wait complete. 2024-04-01T16:34:54.821 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.821+0000 7fd0e2a00640 1 Processor -- start 2024-04-01T16:34:54.821 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.821+0000 7fd0e2a00640 1 -- start start 2024-04-01T16:34:54.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.822+0000 7fd0e2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0bc003a00 0x7fd0dc06df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:54.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.822+0000 7fd0e2a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0dc1611c0 0x7fd0dc1e8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:54.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.822+0000 7fd0e2a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc161970 0x7fd0dc1e8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:54.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.822+0000 7fd0e2a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc06fc70 con 0x7fd0dc161970 2024-04-01T16:34:54.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.822+0000 7fd0e2a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc06f740 con 0x7fd0bc003a00 2024-04-01T16:34:54.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.822+0000 7fd0e2a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd0dc06ff50 con 0x7fd0dc1611c0 2024-04-01T16:34:54.824 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.823+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0bc003a00 0x7fd0dc06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:54.824 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.823+0000 7fd0e0a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc161970 0x7fd0dc1e8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:54.824 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.824+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0bc003a00 0x7fd0dc06df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:46768/0 (socket says 172.21.15.163:46768) 2024-04-01T16:34:54.824 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.824+0000 7fd0dbe00640 1 -- 172.21.15.163:0/3924267565 learned_addr learned my addr 172.21.15.163:0/3924267565 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:54.824 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.824+0000 7fd0db400640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0dc1611c0 0x7fd0dc1e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:54.829 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.829+0000 7fd0dbe00640 1 -- 172.21.15.163:0/3924267565 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0dc1611c0 msgr2=0x7fd0dc1e8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.829+0000 7fd0dbe00640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0dc1611c0 0x7fd0dc1e8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.829+0000 7fd0dbe00640 1 -- 172.21.15.163:0/3924267565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc161970 msgr2=0x7fd0dc1e8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:54.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.829+0000 7fd0dbe00640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc161970 0x7fd0dc1e8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:54.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.829+0000 7fd0dbe00640 1 -- 172.21.15.163:0/3924267565 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc1f83b0 con 0x7fd0bc003a00 2024-04-01T16:34:54.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.834+0000 7fd0dbe00640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0bc003a00 0x7fd0dc06df10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc001930 tx=0x7fd0cc001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:54.841 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.840+0000 7fd0d3e00640 1 -- 172.21.15.163:0/3924267565 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc045070 con 0x7fd0bc003a00 2024-04-01T16:34:54.841 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.840+0000 7fd0d3e00640 1 -- 172.21.15.163:0/3924267565 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0cc007270 con 0x7fd0bc003a00 2024-04-01T16:34:54.841 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.840+0000 7fd0d3e00640 1 -- 172.21.15.163:0/3924267565 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc007620 con 0x7fd0bc003a00 2024-04-01T16:34:54.841 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.841+0000 7fd0e2a00640 1 -- 172.21.15.163:0/3924267565 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc06e9e0 con 0x7fd0bc003a00 2024-04-01T16:34:54.841 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.841+0000 7fd0e2a00640 1 -- 172.21.15.163:0/3924267565 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0dc1f8950 con 0x7fd0bc003a00 2024-04-01T16:34:54.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:54.842+0000 7fd0e2a00640 1 -- 172.21.15.163:0/3924267565 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0dc162c20 con 0x7fd0bc003a00 2024-04-01T16:34:54.884 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-01T16:34:55.090 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-01T16:34:55.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.096+0000 7f78b7800640 1 Processor -- start 2024-04-01T16:34:55.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.096+0000 7f78b7800640 1 -- start start 2024-04-01T16:34:55.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.097+0000 7f78b7800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f78b0152830 0x7f78b0072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.097+0000 7f78b7800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b00c6b30 0x7f78b0072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.097+0000 7f78b7800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f78b0071ee0 0x7f78b015ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.097+0000 7f78b7800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f78b0152c10 con 0x7f78b0152830 2024-04-01T16:34:55.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.097+0000 7f78b7800640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f78b00737f0 con 0x7f78b0071ee0 2024-04-01T16:34:55.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.097+0000 7f78b7800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f78b00c72d0 con 0x7f78b00c6b30 2024-04-01T16:34:55.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.098+0000 7f78b4e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f78b0152830 0x7f78b0072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.099+0000 7f78afe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b00c6b30 0x7f78b0072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.099+0000 7f78b4e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f78b0152830 0x7f78b0072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50562/0 (socket says 172.21.15.163:50562) 2024-04-01T16:34:55.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.099+0000 7f78b4e00640 1 -- 172.21.15.163:0/3917293171 learned_addr learned my addr 172.21.15.163:0/3917293171 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:55.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.102+0000 7f78b4e00640 1 -- 172.21.15.163:0/3917293171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b00c6b30 msgr2=0x7f78b0072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:55.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.102+0000 7f78b4e00640 1 --2- 172.21.15.163:0/3917293171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b00c6b30 0x7f78b0072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.102+0000 7f78b4e00640 1 -- 172.21.15.163:0/3917293171 >> v2:172.21.15.189:3300/0 conn(0x7f78b0071ee0 msgr2=0x7f78b015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:55.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.102+0000 7f78b4e00640 1 --2- 172.21.15.163:0/3917293171 >> v2:172.21.15.189:3300/0 conn(0x7f78b0071ee0 0x7f78b015ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.102+0000 7f78b4e00640 1 -- 172.21.15.163:0/3917293171 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b00c75b0 con 0x7f78b0152830 2024-04-01T16:34:55.104 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.104+0000 7f78b4e00640 1 --2- 172.21.15.163:0/3917293171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78b0152830 0x7f78b0072900 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f78b006d650 tx=0x7f78a002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdfa83eebc09722 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.108+0000 7f78af400640 1 -- 172.21.15.163:0/3917293171 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a002ca70 con 0x7f78b0152830 2024-04-01T16:34:55.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.109+0000 7f78af400640 1 -- 172.21.15.163:0/3917293171 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a002cc10 con 0x7f78b0152830 2024-04-01T16:34:55.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.109+0000 7f78af400640 1 -- 172.21.15.163:0/3917293171 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a00343f0 con 0x7f78b0152830 2024-04-01T16:34:55.110 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.109+0000 7f78b7800640 1 -- 172.21.15.163:0/3917293171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78b0152830 msgr2=0x7f78b0072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.110 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.109+0000 7f78b7800640 1 --2- 172.21.15.163:0/3917293171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78b0152830 0x7f78b0072900 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f78b006d650 tx=0x7f78a002bed0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.110 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.110+0000 7f78b7800640 1 -- 172.21.15.163:0/3917293171 shutdown_connections 2024-04-01T16:34:55.110 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.110+0000 7f78b7800640 1 --2- 172.21.15.163:0/3917293171 >> v2:172.21.15.189:3300/0 conn(0x7f78b0071ee0 0x7f78b015ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.110 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.110+0000 7f78b7800640 1 --2- 172.21.15.163:0/3917293171 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b00c6b30 0x7f78b0072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.110 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.110+0000 7f78b7800640 1 --2- 172.21.15.163:0/3917293171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78b0152830 0x7f78b0072900 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.110+0000 7f78b7800640 1 -- 172.21.15.163:0/3917293171 >> 172.21.15.163:0/3917293171 conn(0x7f78b00cbe20 msgr2=0x7f78b00cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:55.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.110+0000 7f78b7800640 1 -- 172.21.15.163:0/3917293171 shutdown_connections 2024-04-01T16:34:55.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.110+0000 7f78b7800640 1 -- 172.21.15.163:0/3917293171 wait complete. 2024-04-01T16:34:55.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.112+0000 7f78b7800640 1 Processor -- start 2024-04-01T16:34:55.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.112+0000 7f78b7800640 1 -- start start 2024-04-01T16:34:55.114 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.113+0000 7f78b7800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78b0071ee0 0x7f78b01f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.114 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.113+0000 7f78b7800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b00c6b30 0x7f78b01536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.114 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.113+0000 7f78b7800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b0152830 0x7f78b006f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.114 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.113+0000 7f78b7800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f78b0073a90 con 0x7f78b0071ee0 2024-04-01T16:34:55.114 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.113+0000 7f78b7800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f78b00c7b70 con 0x7f78b0152830 2024-04-01T16:34:55.114 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.113+0000 7f78b7800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f78b00707f0 con 0x7f78b00c6b30 2024-04-01T16:34:55.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.114+0000 7f78b4e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78b0071ee0 0x7f78b01f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.114+0000 7f78afe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b00c6b30 0x7f78b01536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.114+0000 7f78b4e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78b0071ee0 0x7f78b01f0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50576/0 (socket says 172.21.15.163:50576) 2024-04-01T16:34:55.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.114+0000 7f78b4e00640 1 -- 172.21.15.163:0/3255957245 learned_addr learned my addr 172.21.15.163:0/3255957245 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:55.119 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.118+0000 7f78b4e00640 1 -- 172.21.15.163:0/3255957245 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b00c6b30 msgr2=0x7f78b01536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.119 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.118+0000 7f78b4e00640 1 --2- 172.21.15.163:0/3255957245 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b00c6b30 0x7f78b01536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.119 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.118+0000 7f78b4e00640 1 -- 172.21.15.163:0/3255957245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b0152830 msgr2=0x7f78b006f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.119 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.118+0000 7f78b4e00640 1 --2- 172.21.15.163:0/3255957245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b0152830 0x7f78b006f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.119 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.118+0000 7f78b4e00640 1 -- 172.21.15.163:0/3255957245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b01f0310 con 0x7f78b0071ee0 2024-04-01T16:34:55.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.121+0000 7f78b4e00640 1 --2- 172.21.15.163:0/3255957245 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78b0071ee0 0x7f78b01f0d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f78a0036040 tx=0x7f78a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.125+0000 7f78acc00640 1 -- 172.21.15.163:0/3255957245 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0043020 con 0x7f78b0071ee0 2024-04-01T16:34:55.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.125+0000 7f78acc00640 1 -- 172.21.15.163:0/3255957245 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a003e450 con 0x7f78b0071ee0 2024-04-01T16:34:55.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.125+0000 7f78acc00640 1 -- 172.21.15.163:0/3255957245 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a003e840 con 0x7f78b0071ee0 2024-04-01T16:34:55.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.125+0000 7f78b7800640 1 -- 172.21.15.163:0/3255957245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b0152f50 con 0x7f78b0071ee0 2024-04-01T16:34:55.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.126+0000 7f78b7800640 1 -- 172.21.15.163:0/3255957245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b01f0860 con 0x7f78b0071ee0 2024-04-01T16:34:55.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.127+0000 7f78b7800640 1 -- 172.21.15.163:0/3255957245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b00756d0 con 0x7f78b0071ee0 2024-04-01T16:34:55.134 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-01T16:34:55.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.152+0000 7f78acc00640 1 -- 172.21.15.163:0/3255957245 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78a0046020 con 0x7f78b0071ee0 2024-04-01T16:34:55.153 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.153+0000 7f78acc00640 1 --2- 172.21.15.163:0/3255957245 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f789006c8f0 0x7f789006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.153 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.153+0000 7f78afe00640 1 --2- 172.21.15.163:0/3255957245 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f789006c8f0 0x7f789006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.154+0000 7f78afe00640 1 --2- 172.21.15.163:0/3255957245 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f789006c8f0 0x7f789006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f78b00ca910 tx=0x7f789c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.216+0000 7fd0d3e00640 1 -- 172.21.15.163:0/3924267565 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0cc034480 con 0x7fd0bc003a00 2024-04-01T16:34:55.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.217+0000 7fd0d3e00640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd0b806c970 0x7fd0b806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.218+0000 7fd0db400640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd0b806c970 0x7fd0b806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.219+0000 7fd0db400640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd0b806c970 0x7fd0b806ee30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc14ffb0 tx=0x7fd0c4007560 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.223+0000 7fd0d3e00640 1 -- 172.21.15.163:0/3924267565 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fd0cc078ca0 con 0x7fd0bc003a00 2024-04-01T16:34:55.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.247+0000 7fd0d3e00640 1 -- 172.21.15.163:0/3924267565 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd0dc162c20 con 0x7fd0bc003a00 2024-04-01T16:34:55.278 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.278+0000 7fbcf9a00640 1 Processor -- start 2024-04-01T16:34:55.278 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.278+0000 7fbcf9a00640 1 -- start start 2024-04-01T16:34:55.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.279+0000 7fbcf9a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbcf40710c0 0x7fbcf40ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.279+0000 7fbcf9a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbcf40ce900 0x7fbcf415bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.279+0000 7fbcf9a00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf406c560 con 0x7fbcf4154b90 2024-04-01T16:34:55.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.279+0000 7fbcf9a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf40714e0 con 0x7fbcf40ce900 2024-04-01T16:34:55.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.279+0000 7fbcf9a00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf406c820 con 0x7fbcf40710c0 2024-04-01T16:34:55.281 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.281+0000 7fbcf2000640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fbcf40710c0 0x7fbcf40ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.282+0000 7fbcf2a00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fbcf4154b90 0x7fbcf415e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:45440/0 (socket says 172.21.15.163:45440) 2024-04-01T16:34:55.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.282+0000 7fbcf2a00640 1 -- 172.21.15.163:0/463707476 learned_addr learned my addr 172.21.15.163:0/463707476 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:55.289 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.289+0000 7fbcf2000640 1 -- 172.21.15.163:0/463707476 >> v2:172.21.15.163:3300/0 conn(0x7fbcf40ce900 msgr2=0x7fbcf415bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:55.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.289+0000 7fbcf2000640 1 --2- 172.21.15.163:0/463707476 >> v2:172.21.15.163:3300/0 conn(0x7fbcf40ce900 0x7fbcf415bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.289+0000 7fbcf2000640 1 -- 172.21.15.163:0/463707476 >> v1:172.21.15.189:6789/0 conn(0x7fbcf4154b90 legacy=0x7fbcf415e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.289+0000 7fbcf2000640 1 -- 172.21.15.163:0/463707476 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf406cb00 con 0x7fbcf40710c0 2024-04-01T16:34:55.301 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.301+0000 7fbcf2000640 1 --2- 172.21.15.163:0/463707476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcf40710c0 0x7fbcf40ce3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbcf408c2e0 tx=0x7fbce002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ae421e2234a2737 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.310+0000 7fbcf1600640 1 -- 172.21.15.163:0/463707476 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0034070 con 0x7fbcf40710c0 2024-04-01T16:34:55.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.310+0000 7fbcf1600640 1 -- 172.21.15.163:0/463707476 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce0030610 con 0x7fbcf40710c0 2024-04-01T16:34:55.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.310+0000 7fbcf1600640 1 -- 172.21.15.163:0/463707476 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce00309e0 con 0x7fbcf40710c0 2024-04-01T16:34:55.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.311+0000 7fbcf9a00640 1 -- 172.21.15.163:0/463707476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcf40710c0 msgr2=0x7fbcf40ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.311+0000 7fbcf9a00640 1 --2- 172.21.15.163:0/463707476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcf40710c0 0x7fbcf40ce3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbcf408c2e0 tx=0x7fbce002b960 comp rx=0 tx=0).stop 2024-04-01T16:34:55.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.311+0000 7fbcf9a00640 1 -- 172.21.15.163:0/463707476 shutdown_connections 2024-04-01T16:34:55.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.311+0000 7fbcf9a00640 1 --2- 172.21.15.163:0/463707476 >> v2:172.21.15.163:3300/0 conn(0x7fbcf40ce900 0x7fbcf415bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.311+0000 7fbcf9a00640 1 --2- 172.21.15.163:0/463707476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcf40710c0 0x7fbcf40ce3c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.311+0000 7fbcf9a00640 1 -- 172.21.15.163:0/463707476 >> 172.21.15.163:0/463707476 conn(0x7fbcf40676a0 msgr2=0x7fbcf4067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:55.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.311+0000 7fbcf9a00640 1 -- 172.21.15.163:0/463707476 shutdown_connections 2024-04-01T16:34:55.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.311+0000 7fbcf9a00640 1 -- 172.21.15.163:0/463707476 wait complete. 2024-04-01T16:34:55.313 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.313+0000 7fbcf9a00640 1 Processor -- start 2024-04-01T16:34:55.313 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.313+0000 7fbcf9a00640 1 -- start start 2024-04-01T16:34:55.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.314+0000 7fbcf9a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbcf40710c0 0x7fbcf41f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.314+0000 7fbcf9a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcf40ce900 0x7fbcf40c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.314+0000 7fbcf9a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcf4154b90 0x7fbcf414f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.314+0000 7fbcf9a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf406d3a0 con 0x7fbcf40710c0 2024-04-01T16:34:55.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.314+0000 7fbcf9a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf406d0c0 con 0x7fbcf4154b90 2024-04-01T16:34:55.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.314+0000 7fbcf9a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf415c4e0 con 0x7fbcf40ce900 2024-04-01T16:34:55.316 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.315+0000 7fa372800640 1 Processor -- start 2024-04-01T16:34:55.316 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.315+0000 7fbcf2000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcf40ce900 0x7fbcf40c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.316 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.315+0000 7fa372800640 1 -- start start 2024-04-01T16:34:55.317 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.316+0000 7fbcf3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcf4154b90 0x7fbcf414f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.317 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.316+0000 7fbcf2000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcf40ce900 0x7fbcf40c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:38350/0 (socket says 172.21.15.163:38350) 2024-04-01T16:34:55.317 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.316+0000 7fbcf2000640 1 -- 172.21.15.163:0/587538007 learned_addr learned my addr 172.21.15.163:0/587538007 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:55.317 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.317+0000 7fa372800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa36c154b90 0x7fa36c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.317 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.317+0000 7fa372800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c15e660 0x7fa36c0ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.318 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.317+0000 7fa372800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36c06c560 con 0x7fa36c0ce900 2024-04-01T16:34:55.318 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.317+0000 7fa372800640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa36c06c820 con 0x7fa36c154b90 2024-04-01T16:34:55.318 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.317+0000 7fa372800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa36c06cb00 con 0x7fa36c15e660 2024-04-01T16:34:55.319 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.319+0000 7fa36b400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa36c154b90 0x7fa36c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.321+0000 7fbcf2000640 1 -- 172.21.15.163:0/587538007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcf4154b90 msgr2=0x7fbcf414f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.321+0000 7fbcf2000640 1 --2- 172.21.15.163:0/587538007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcf4154b90 0x7fbcf414f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.321+0000 7fbcf2000640 1 -- 172.21.15.163:0/587538007 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbcf40710c0 msgr2=0x7fbcf41f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.321+0000 7fbcf2000640 1 --2- 172.21.15.163:0/587538007 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbcf40710c0 0x7fbcf41f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.321+0000 7fbcf2000640 1 -- 172.21.15.163:0/587538007 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf40c9b70 con 0x7fbcf40ce900 2024-04-01T16:34:55.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.329+0000 7fbcf2000640 1 --2- 172.21.15.163:0/587538007 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcf40ce900 0x7fbcf40c4910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbce002bf70 tx=0x7fbce00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.329 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.329+0000 7fa36aa00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c15e660 0x7fa36c0ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.330+0000 7fa36be00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fa36c0ce900 0x7fa36c15bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:45448/0 (socket says 172.21.15.163:45448) 2024-04-01T16:34:55.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.330+0000 7fa36be00640 1 -- 172.21.15.163:0/2308166223 learned_addr learned my addr 172.21.15.163:0/2308166223 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:55.343 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.343+0000 7fbceaa00640 1 -- 172.21.15.163:0/587538007 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0034040 con 0x7fbcf40ce900 2024-04-01T16:34:55.344 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.343+0000 7fbceaa00640 1 -- 172.21.15.163:0/587538007 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce0039a10 con 0x7fbcf40ce900 2024-04-01T16:34:55.344 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.343+0000 7fbceaa00640 1 -- 172.21.15.163:0/587538007 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0039de0 con 0x7fbcf40ce900 2024-04-01T16:34:55.344 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.343+0000 7fbcf9a00640 1 -- 172.21.15.163:0/587538007 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf40c9e10 con 0x7fbcf40ce900 2024-04-01T16:34:55.344 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.343+0000 7fbcf9a00640 1 -- 172.21.15.163:0/587538007 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf40ca3d0 con 0x7fbcf40ce900 2024-04-01T16:34:55.344 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.344+0000 7fbcf9a00640 1 -- 172.21.15.163:0/587538007 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf406e7e0 con 0x7fbcf40ce900 2024-04-01T16:34:55.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.345+0000 7fa36b400640 1 -- 172.21.15.163:0/2308166223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c15e660 msgr2=0x7fa36c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:55.346 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.345+0000 7fa36b400640 1 --2- 172.21.15.163:0/2308166223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c15e660 0x7fa36c0ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.346 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.345+0000 7fa36b400640 1 -- 172.21.15.163:0/2308166223 >> v1:172.21.15.189:6789/0 conn(0x7fa36c0ce900 legacy=0x7fa36c15bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.346 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.345+0000 7fa36b400640 1 -- 172.21.15.163:0/2308166223 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36c06cde0 con 0x7fa36c154b90 2024-04-01T16:34:55.359 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.359+0000 7fa36b400640 1 --2- 172.21.15.163:0/2308166223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c154b90 0x7fa36c0710c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0097a0 tx=0x7fa35c02b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a212f5848d2b802 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.372 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.371+0000 7fa36a000640 1 -- 172.21.15.163:0/2308166223 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c034070 con 0x7fa36c154b90 2024-04-01T16:34:55.372 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.371+0000 7fa36a000640 1 -- 172.21.15.163:0/2308166223 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35c030800 con 0x7fa36c154b90 2024-04-01T16:34:55.372 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.371+0000 7fa36a000640 1 -- 172.21.15.163:0/2308166223 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c030bd0 con 0x7fa36c154b90 2024-04-01T16:34:55.372 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-01T16:34:55.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.372+0000 7fa372800640 1 -- 172.21.15.163:0/2308166223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c154b90 msgr2=0x7fa36c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.372+0000 7fa372800640 1 --2- 172.21.15.163:0/2308166223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c154b90 0x7fa36c0710c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0097a0 tx=0x7fa35c02b940 comp rx=0 tx=0).stop 2024-04-01T16:34:55.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.372+0000 7fa372800640 1 -- 172.21.15.163:0/2308166223 shutdown_connections 2024-04-01T16:34:55.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.372+0000 7fa372800640 1 --2- 172.21.15.163:0/2308166223 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c15e660 0x7fa36c0ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.372+0000 7fa372800640 1 --2- 172.21.15.163:0/2308166223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c154b90 0x7fa36c0710c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.372+0000 7fa372800640 1 -- 172.21.15.163:0/2308166223 >> 172.21.15.163:0/2308166223 conn(0x7fa36c0676a0 msgr2=0x7fa36c067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:55.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.372+0000 7fa372800640 1 -- 172.21.15.163:0/2308166223 shutdown_connections 2024-04-01T16:34:55.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.373+0000 7fa372800640 1 -- 172.21.15.163:0/2308166223 wait complete. 2024-04-01T16:34:55.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.374+0000 7fa372800640 1 Processor -- start 2024-04-01T16:34:55.379 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.375+0000 7fa372800640 1 -- start start 2024-04-01T16:34:55.379 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.375+0000 7fa372800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c0ce900 0x7fa36c1e4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.379 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.375+0000 7fa372800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c154b90 0x7fa36c1e5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.379 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.375+0000 7fa372800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa36c15e660 0x7fa36c150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.379 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.375+0000 7fa372800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c15ea80 con 0x7fa36c15e660 2024-04-01T16:34:55.379 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.375+0000 7fa372800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c06d3a0 con 0x7fa36c154b90 2024-04-01T16:34:55.379 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.375+0000 7fa372800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa36c15c6b0 con 0x7fa36c0ce900 2024-04-01T16:34:55.379 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.377+0000 7fa36aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c154b90 0x7fa36c1e5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.378+0000 7fa36aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c154b90 0x7fa36c1e5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:46828/0 (socket says 172.21.15.163:46828) 2024-04-01T16:34:55.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.378+0000 7fa36aa00640 1 -- 172.21.15.163:0/591692057 learned_addr learned my addr 172.21.15.163:0/591692057 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:55.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.391+0000 7fa36aa00640 1 -- 172.21.15.163:0/591692057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c0ce900 msgr2=0x7fa36c1e4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.391+0000 7fa36aa00640 1 --2- 172.21.15.163:0/591692057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c0ce900 0x7fa36c1e4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.391+0000 7fa36aa00640 1 -- 172.21.15.163:0/591692057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa36c15e660 msgr2=0x7fa36c150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.391+0000 7fa36aa00640 1 --2- 172.21.15.163:0/591692057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa36c15e660 0x7fa36c150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.391+0000 7fa36aa00640 1 -- 172.21.15.163:0/591692057 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36c157f70 con 0x7fa36c154b90 2024-04-01T16:34:55.398 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.398+0000 7fa36aa00640 1 --2- 172.21.15.163:0/591692057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c154b90 0x7fa36c1e5790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa35800e870 tx=0x7fa35800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.409 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.409+0000 7fa363400640 1 -- 172.21.15.163:0/591692057 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa358017070 con 0x7fa36c154b90 2024-04-01T16:34:55.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.409+0000 7fa363400640 1 -- 172.21.15.163:0/591692057 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35800c940 con 0x7fa36c154b90 2024-04-01T16:34:55.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.409+0000 7fa363400640 1 -- 172.21.15.163:0/591692057 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35800cd30 con 0x7fa36c154b90 2024-04-01T16:34:55.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.409+0000 7fa372800640 1 -- 172.21.15.163:0/591692057 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa36c1555a0 con 0x7fa36c154b90 2024-04-01T16:34:55.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.409+0000 7fa372800640 1 -- 172.21.15.163:0/591692057 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa36c155860 con 0x7fa36c154b90 2024-04-01T16:34:55.411 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.411+0000 7fa372800640 1 -- 172.21.15.163:0/591692057 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa36c06e7e0 con 0x7fa36c154b90 2024-04-01T16:34:55.427 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.426+0000 7f78acc00640 1 -- 172.21.15.163:0/3255957245 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f78a007a7a0 con 0x7f78b0071ee0 2024-04-01T16:34:55.427 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.427+0000 7f78acc00640 1 -- 172.21.15.163:0/3255957245 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f78a004d030 con 0x7f78b0071ee0 2024-04-01T16:34:55.441 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-01T16:34:55.468 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.468+0000 7fa363400640 1 -- 172.21.15.163:0/591692057 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa35801a070 con 0x7fa36c154b90 2024-04-01T16:34:55.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.469+0000 7fa363400640 1 --2- 172.21.15.163:0/591692057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa34c06c970 0x7fa34c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.470+0000 7fa36b400640 1 --2- 172.21.15.163:0/591692057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa34c06c970 0x7fa34c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.471+0000 7fa36b400640 1 --2- 172.21.15.163:0/591692057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa34c06c970 0x7fa34c06ee30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa35c036000 tx=0x7fa35c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.485 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.484+0000 7fd0e2a00640 1 -- 172.21.15.163:0/3924267565 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd0dc0756d0 con 0x7fd0bc003a00 2024-04-01T16:34:55.489 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-01T16:34:55.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.560+0000 7f5f1a000640 1 Processor -- start 2024-04-01T16:34:55.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.560+0000 7f5f1a000640 1 -- start start 2024-04-01T16:34:55.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.563+0000 7f5f1a000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f1415c160 0x7f5f14163df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.563+0000 7f5f1a000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f140737f0 con 0x7f5f14152830 2024-04-01T16:34:55.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.564+0000 7f5f1a000640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f140c72d0 con 0x7f5f140c6b30 2024-04-01T16:34:55.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.564+0000 7f5f1a000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5f14152c10 con 0x7f5f1415c160 2024-04-01T16:34:55.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.565+0000 7f5f13400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f5f14152830 0x7f5f14072900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:42754/0 (socket says 172.21.15.163:42754) 2024-04-01T16:34:55.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.565+0000 7f5f13400640 1 -- 172.21.15.163:0/662493081 learned_addr learned my addr 172.21.15.163:0/662493081 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:55.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.568+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 929376761 0 0) 0x7f5f140737f0 con 0x7f5f14152830 2024-04-01T16:34:55.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.568+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ef8003520 con 0x7f5f14152830 2024-04-01T16:34:55.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3229232040 0 0) 0x7f5ef8003520 con 0x7f5f14152830 2024-04-01T16:34:55.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f1415c160 msgr2=0x7f5f14163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:55.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 --2- 172.21.15.163:0/662493081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f1415c160 0x7f5f14163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 >> v1:172.21.15.189:6789/0 conn(0x7f5f140c6b30 legacy=0x7f5f1415ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f140c75b0 con 0x7f5f14152830 2024-04-01T16:34:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7f5f04001670 con 0x7f5f14152830 2024-04-01T16:34:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 >> v1:172.21.15.163:6789/0 conn(0x7f5f14152830 legacy=0x7f5f14072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 --2- 172.21.15.163:0/662493081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ef80039e0 0x7f5ef8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 --2- 172.21.15.163:0/662493081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ef8004800 0x7f5ef8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 --2- 172.21.15.163:0/662493081 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ef8005210 0x7f5ef800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5f14152c10 con 0x7f5ef8005210 2024-04-01T16:34:55.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef8010450 con 0x7f5ef8004800 2024-04-01T16:34:55.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.572+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef8010650 con 0x7f5ef80039e0 2024-04-01T16:34:55.576 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.576+0000 7f5f13e00640 1 --2- 172.21.15.163:0/662493081 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ef8005210 0x7f5ef800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.580+0000 7f5f13e00640 1 -- 172.21.15.163:0/662493081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ef80039e0 msgr2=0x7f5ef8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:55.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.580+0000 7f5f13e00640 1 --2- 172.21.15.163:0/662493081 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ef80039e0 0x7f5ef8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.580+0000 7f5f13e00640 1 -- 172.21.15.163:0/662493081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ef8004800 msgr2=0x7f5ef8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:55.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.580+0000 7f5f13e00640 1 --2- 172.21.15.163:0/662493081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ef8004800 0x7f5ef8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.582 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.580+0000 7f5f13e00640 1 -- 172.21.15.163:0/662493081 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef8003520 con 0x7f5ef8005210 2024-04-01T16:34:55.584 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.584+0000 7f5f13e00640 1 --2- 172.21.15.163:0/662493081 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ef8005210 0x7f5ef800b9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009e40 tx=0x7f5ef8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ee69572ad2f677 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.590 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.590+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c039070 con 0x7f5ef8005210 2024-04-01T16:34:55.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.590+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0c006e50 con 0x7f5ef8005210 2024-04-01T16:34:55.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.590+0000 7f5f12000640 1 -- 172.21.15.163:0/662493081 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c009a10 con 0x7f5ef8005210 2024-04-01T16:34:55.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.591+0000 7f5f1a000640 1 -- 172.21.15.163:0/662493081 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ef8005210 msgr2=0x7f5ef800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.591+0000 7f5f1a000640 1 --2- 172.21.15.163:0/662493081 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ef8005210 0x7f5ef800b9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009e40 tx=0x7f5ef8005830 comp rx=0 tx=0).stop 2024-04-01T16:34:55.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.591+0000 7f5f13e00640 1 -- 172.21.15.163:0/662493081 reap_dead start 2024-04-01T16:34:55.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.592+0000 7f5f1a000640 1 -- 172.21.15.163:0/662493081 shutdown_connections 2024-04-01T16:34:55.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.592+0000 7f5f1a000640 1 -- 172.21.15.163:0/662493081 >> 172.21.15.163:0/662493081 conn(0x7f5f140cbe20 msgr2=0x7f5f140cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:55.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.592+0000 7f5f1a000640 1 -- 172.21.15.163:0/662493081 shutdown_connections 2024-04-01T16:34:55.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.592+0000 7f5f1a000640 1 -- 172.21.15.163:0/662493081 wait complete. 2024-04-01T16:34:55.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.594+0000 7f5f1a000640 1 Processor -- start 2024-04-01T16:34:55.596 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.595+0000 7f5f1a000640 1 -- start start 2024-04-01T16:34:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.596+0000 7f5f1a000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f1414c5a0 0x7f5f141471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.596+0000 7f5f1a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f1414c980 0x7f5f14147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.596+0000 7f5f1a000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f141583f0 0x7f5f1414df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.596+0000 7f5f1a000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5f14073a90 con 0x7f5f141583f0 2024-04-01T16:34:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.596+0000 7f5f1a000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5f140c7b70 con 0x7f5f1414c980 2024-04-01T16:34:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.596+0000 7f5f1a000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5f140707f0 con 0x7f5f1414c5a0 2024-04-01T16:34:55.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.597+0000 7f5f13e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f141583f0 0x7f5f1414df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.598+0000 7f5f13e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f141583f0 0x7f5f1414df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50628/0 (socket says 172.21.15.163:50628) 2024-04-01T16:34:55.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.598+0000 7f5f13e00640 1 -- 172.21.15.163:0/2979318565 learned_addr learned my addr 172.21.15.163:0/2979318565 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.604+0000 7f5f13e00640 1 -- 172.21.15.163:0/2979318565 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f1414c5a0 msgr2=0x7f5f141471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.604+0000 7f5f13e00640 1 --2- 172.21.15.163:0/2979318565 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f1414c5a0 0x7f5f141471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.604+0000 7f5f13e00640 1 -- 172.21.15.163:0/2979318565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f1414c980 msgr2=0x7f5f14147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.604+0000 7f5f13e00640 1 --2- 172.21.15.163:0/2979318565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f1414c980 0x7f5f14147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.604+0000 7f5f13e00640 1 -- 172.21.15.163:0/2979318565 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f141588e0 con 0x7f5f141583f0 2024-04-01T16:34:55.608 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.608+0000 7f5f13e00640 1 --2- 172.21.15.163:0/2979318565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f141583f0 0x7f5f1414df60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009f60 tx=0x7f5f0c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.614 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.615+0000 7f5f0b400640 1 -- 172.21.15.163:0/2979318565 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c039040 con 0x7f5f141583f0 2024-04-01T16:34:55.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.615+0000 7f5f0b400640 1 -- 172.21.15.163:0/2979318565 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0c046070 con 0x7f5f141583f0 2024-04-01T16:34:55.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.615+0000 7f5f0b400640 1 -- 172.21.15.163:0/2979318565 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c0092f0 con 0x7f5f141583f0 2024-04-01T16:34:55.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.615+0000 7f5f1a000640 1 -- 172.21.15.163:0/2979318565 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f14158ba0 con 0x7f5f141583f0 2024-04-01T16:34:55.615 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.615+0000 7f5f1a000640 1 -- 172.21.15.163:0/2979318565 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f1414d760 con 0x7f5f141583f0 2024-04-01T16:34:55.616 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.616+0000 7f5f1a000640 1 -- 172.21.15.163:0/2979318565 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f141590c0 con 0x7f5f141583f0 2024-04-01T16:34:55.636 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.635+0000 7fa33a600640 1 Processor -- start 2024-04-01T16:34:55.636 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.636+0000 7fa33a600640 1 -- start start 2024-04-01T16:34:55.637 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.637+0000 7fa33a600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa334070100 0x7fa33415aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.637 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.637+0000 7fa33a600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33415b040 con 0x7fa334151700 2024-04-01T16:34:55.637 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.637+0000 7fa33a600640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33415b320 con 0x7fa3340c8160 2024-04-01T16:34:55.637 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.637+0000 7fa33a600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fa3340c3060 con 0x7fa334070100 2024-04-01T16:34:55.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.689+0000 7fbceaa00640 1 -- 172.21.15.163:0/587538007 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbce0037070 con 0x7fbcf40ce900 2024-04-01T16:34:55.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.690+0000 7fbceaa00640 1 --2- 172.21.15.163:0/587538007 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fbcd406c970 0x7fbcd406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.690+0000 7fbceaa00640 1 -- 172.21.15.163:0/587538007 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fbce00adb60 con 0x7fbcf40ce900 2024-04-01T16:34:55.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.690+0000 7fbcf2a00640 1 --2- 172.21.15.163:0/587538007 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fbcd406c970 0x7fbcd406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.691+0000 7fbcf2a00640 1 --2- 172.21.15.163:0/587538007 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fbcd406c970 0x7fbcd406ee30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbce4000f60 tx=0x7fbce4007a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.696 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.695+0000 7fdee2800640 1 Processor -- start 2024-04-01T16:34:55.696 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.695+0000 7fdee2800640 1 -- start start 2024-04-01T16:34:55.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.696+0000 7fdee2800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdedc0c6d50 0x7fdedc071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.697+0000 7fdee2800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdedc072570 con 0x7fdedc154a60 2024-04-01T16:34:55.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.697+0000 7fdee2800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdedc0c2080 con 0x7fdedc072aa0 2024-04-01T16:34:55.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.697+0000 7fdee2800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fdedc0c2360 con 0x7fdedc0c6d50 2024-04-01T16:34:55.712 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.712+0000 7fbceaa00640 1 -- 172.21.15.163:0/587538007 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbce007b930 con 0x7fbcf40ce900 2024-04-01T16:34:55.714 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.714+0000 7f78b7800640 1 -- 172.21.15.163:0/3255957245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f78b01f0a30 con 0x7f78b0071ee0 2024-04-01T16:34:55.716 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.716+0000 7f5f0b400640 1 -- 172.21.15.163:0/2979318565 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f0c03f470 con 0x7f5f141583f0 2024-04-01T16:34:55.717 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.717+0000 7f5f0b400640 1 --2- 172.21.15.163:0/2979318565 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5ef406c940 0x7f5ef406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.717 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.717+0000 7f5f13400640 1 --2- 172.21.15.163:0/2979318565 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5ef406c940 0x7f5ef406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.718 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.718+0000 7f5f13400640 1 --2- 172.21.15.163:0/2979318565 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5ef406c940 0x7f5ef406ee00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f04001eb0 tx=0x7f5f04001600 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.777+0000 7fa363400640 1 -- 172.21.15.163:0/591692057 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fa358057f30 con 0x7fa36c154b90 2024-04-01T16:34:55.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.812+0000 7fa363400640 1 -- 172.21.15.163:0/591692057 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa35805a590 con 0x7fa36c154b90 2024-04-01T16:34:55.851 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.851+0000 7fa333e00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fa3340c8160 0x7fa3340c0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:45474/0 (socket says 172.21.15.163:45474) 2024-04-01T16:34:55.851 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.851+0000 7fa333e00640 1 -- 172.21.15.163:0/868831054 learned_addr learned my addr 172.21.15.163:0/868831054 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:55.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.862+0000 7fd0d3e00640 1 -- 172.21.15.163:0/3924267565 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd0cc04f020 con 0x7fd0bc003a00 2024-04-01T16:34:55.863 INFO:teuthology.orchestra.run.smithi163.stdout:60129542158 2024-04-01T16:34:55.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.866+0000 7fd0e2a00640 1 -- 172.21.15.163:0/3924267565 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd0b806c970 msgr2=0x7fd0b806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.866+0000 7fd0e2a00640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd0b806c970 0x7fd0b806ee30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc14ffb0 tx=0x7fd0c4007560 comp rx=0 tx=0).stop 2024-04-01T16:34:55.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.866+0000 7fd0e2a00640 1 -- 172.21.15.163:0/3924267565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0bc003a00 msgr2=0x7fd0dc06df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.866+0000 7fd0e2a00640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0bc003a00 0x7fd0dc06df10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc001930 tx=0x7fd0cc001120 comp rx=0 tx=0).stop 2024-04-01T16:34:55.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.866+0000 7fd0e2a00640 1 -- 172.21.15.163:0/3924267565 shutdown_connections 2024-04-01T16:34:55.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.866+0000 7fd0e2a00640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd0b806c970 0x7fd0b806ee30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.866+0000 7fd0e2a00640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc161970 0x7fd0dc1e8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.866+0000 7fd0e2a00640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd0dc1611c0 0x7fd0dc1e8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.866+0000 7fd0e2a00640 1 --2- 172.21.15.163:0/3924267565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd0bc003a00 0x7fd0dc06df10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.866+0000 7fd0e2a00640 1 -- 172.21.15.163:0/3924267565 >> 172.21.15.163:0/3924267565 conn(0x7fd0dc0cbe20 msgr2=0x7fd0dc15e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:55.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.866+0000 7fd0e2a00640 1 -- 172.21.15.163:0/3924267565 shutdown_connections 2024-04-01T16:34:55.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.866+0000 7fd0e2a00640 1 -- 172.21.15.163:0/3924267565 wait complete. 2024-04-01T16:34:55.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.868+0000 7fdedbe00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fdedc072aa0 0x7fdedc06dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:45482/0 (socket says 172.21.15.163:45482) 2024-04-01T16:34:55.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.868+0000 7fdedbe00640 1 -- 172.21.15.163:0/1601833376 learned_addr learned my addr 172.21.15.163:0/1601833376 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:55.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542158 for osd.1 2024-04-01T16:34:55.884 DEBUG:teuthology.parallel:result is None 2024-04-01T16:34:55.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.911+0000 7fbcf9a00640 1 -- 172.21.15.163:0/587538007 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fbcf40ca5d0 con 0x7fbcf40ce900 2024-04-01T16:34:55.921 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.920+0000 7fbceaa00640 1 -- 172.21.15.163:0/587538007 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbce007fc30 con 0x7fbcf40ce900 2024-04-01T16:34:55.921 INFO:teuthology.orchestra.run.smithi163.stdout:64424509453 2024-04-01T16:34:55.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.923+0000 7fbcf9a00640 1 -- 172.21.15.163:0/587538007 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fbcd406c970 msgr2=0x7fbcd406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.923+0000 7fbcf9a00640 1 --2- 172.21.15.163:0/587538007 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fbcd406c970 0x7fbcd406ee30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbce4000f60 tx=0x7fbce4007a80 comp rx=0 tx=0).stop 2024-04-01T16:34:55.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.923+0000 7fbcf9a00640 1 -- 172.21.15.163:0/587538007 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcf40ce900 msgr2=0x7fbcf40c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.923+0000 7fbcf9a00640 1 --2- 172.21.15.163:0/587538007 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcf40ce900 0x7fbcf40c4910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbce002bf70 tx=0x7fbce00046c0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.923+0000 7fbcf9a00640 1 -- 172.21.15.163:0/587538007 shutdown_connections 2024-04-01T16:34:55.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.923+0000 7fbcf9a00640 1 --2- 172.21.15.163:0/587538007 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fbcd406c970 0x7fbcd406ee30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.923+0000 7fbcf9a00640 1 --2- 172.21.15.163:0/587538007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbcf4154b90 0x7fbcf414f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.923+0000 7fbcf9a00640 1 --2- 172.21.15.163:0/587538007 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fbcf40ce900 0x7fbcf40c4910 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.923+0000 7fbcf9a00640 1 --2- 172.21.15.163:0/587538007 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbcf40710c0 0x7fbcf41f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.923+0000 7fbcf9a00640 1 -- 172.21.15.163:0/587538007 >> 172.21.15.163:0/587538007 conn(0x7fbcf40676a0 msgr2=0x7fbcf4148c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:55.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.923+0000 7fbcf9a00640 1 -- 172.21.15.163:0/587538007 shutdown_connections 2024-04-01T16:34:55.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.923+0000 7fbcf9a00640 1 -- 172.21.15.163:0/587538007 wait complete. 2024-04-01T16:34:55.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.941+0000 7f5f0b400640 1 -- 172.21.15.163:0/2979318565 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f5f0c07ad10 con 0x7f5f141583f0 2024-04-01T16:34:55.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.941+0000 7f5f0b400640 1 -- 172.21.15.163:0/2979318565 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5f141590c0 con 0x7f5f141583f0 2024-04-01T16:34:55.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.7 2024-04-01T16:34:55.945 DEBUG:teuthology.parallel:result is None 2024-04-01T16:34:55.950 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.950+0000 7f78acc00640 1 -- 172.21.15.163:0/3255957245 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f78a007ce00 con 0x7f78b0071ee0 2024-04-01T16:34:55.951 INFO:teuthology.orchestra.run.smithi163.stdout:64424509453 2024-04-01T16:34:55.951 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.950+0000 7fded2a00640 1 --2- 172.21.15.163:0/1601833376 >> v2:172.21.15.163:3300/0 conn(0x7fdedc0c6d50 0x7fdedc071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.953 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.952+0000 7f78b7800640 1 -- 172.21.15.163:0/3255957245 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f789006c8f0 msgr2=0x7f789006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.953 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.952+0000 7f78b7800640 1 --2- 172.21.15.163:0/3255957245 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f789006c8f0 0x7f789006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f78b00ca910 tx=0x7f789c009190 comp rx=0 tx=0).stop 2024-04-01T16:34:55.953 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.952+0000 7f78b7800640 1 -- 172.21.15.163:0/3255957245 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78b0071ee0 msgr2=0x7f78b01f0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.952+0000 7f78b7800640 1 --2- 172.21.15.163:0/3255957245 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78b0071ee0 0x7f78b01f0d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f78a0036040 tx=0x7f78a0004a40 comp rx=0 tx=0).stop 2024-04-01T16:34:55.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.953+0000 7f78b7800640 1 -- 172.21.15.163:0/3255957245 shutdown_connections 2024-04-01T16:34:55.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.953+0000 7f78b7800640 1 --2- 172.21.15.163:0/3255957245 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f789006c8f0 0x7f789006edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.953+0000 7f78b7800640 1 --2- 172.21.15.163:0/3255957245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b0152830 0x7f78b006f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.953+0000 7f78b7800640 1 --2- 172.21.15.163:0/3255957245 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f78b00c6b30 0x7f78b01536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.953+0000 7f78b7800640 1 --2- 172.21.15.163:0/3255957245 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78b0071ee0 0x7f78b01f0d80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.953+0000 7f78b7800640 1 -- 172.21.15.163:0/3255957245 >> 172.21.15.163:0/3255957245 conn(0x7f78b00cbe20 msgr2=0x7f78b014f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:55.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.953+0000 7f78b7800640 1 -- 172.21.15.163:0/3255957245 shutdown_connections 2024-04-01T16:34:55.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.953+0000 7f78b7800640 1 -- 172.21.15.163:0/3255957245 wait complete. 2024-04-01T16:34:55.965 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.965+0000 7fded2a00640 1 -- 172.21.15.163:0/1601833376 >> v1:172.21.15.189:6789/0 conn(0x7fdedc072aa0 legacy=0x7fdedc06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.965 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.965+0000 7fded2a00640 1 -- 172.21.15.163:0/1601833376 >> v1:172.21.15.163:6789/0 conn(0x7fdedc154a60 legacy=0x7fdedc073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:55.965 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.965+0000 7fded2a00640 1 -- 172.21.15.163:0/1601833376 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc0c2640 con 0x7fdedc0c6d50 2024-04-01T16:34:55.968 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.968+0000 7fa332a00640 1 --2- 172.21.15.163:0/868831054 >> v2:172.21.15.163:3300/0 conn(0x7fa334070100 0x7fa33415aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.972+0000 7fded2a00640 1 --2- 172.21.15.163:0/1601833376 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdedc0c6d50 0x7fdedc071ee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdec40097a0 tx=0x7fdec402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e21026319c60902 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.4 2024-04-01T16:34:55.974 DEBUG:teuthology.parallel:result is None 2024-04-01T16:34:55.981 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.981+0000 7fdedaa00640 1 -- 172.21.15.163:0/1601833376 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4034070 con 0x7fdedc0c6d50 2024-04-01T16:34:55.983 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.982+0000 7fa332a00640 1 -- 172.21.15.163:0/868831054 >> v1:172.21.15.189:6789/0 conn(0x7fa3340c8160 legacy=0x7fa3340c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.983 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.982+0000 7fa332a00640 1 -- 172.21.15.163:0/868831054 >> v1:172.21.15.163:6789/0 conn(0x7fa334151700 legacy=0x7fa3340c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.983 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.982+0000 7fa332a00640 1 -- 172.21.15.163:0/868831054 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33415b600 con 0x7fa334070100 2024-04-01T16:34:55.989 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.988+0000 7fa332a00640 1 --2- 172.21.15.163:0/868831054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa334070100 0x7fa33415aa00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa3200097a0 tx=0x7fa32002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74de77a91f8bd1f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:55.989 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.989+0000 7fdedaa00640 1 -- 172.21.15.163:0/1601833376 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec4030610 con 0x7fdedc0c6d50 2024-04-01T16:34:55.989 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.989+0000 7fdedaa00640 1 -- 172.21.15.163:0/1601833376 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec40309e0 con 0x7fdedc0c6d50 2024-04-01T16:34:55.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.990+0000 7fdee2800640 1 -- 172.21.15.163:0/1601833376 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdedc0c6d50 msgr2=0x7fdedc071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:55.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.990+0000 7fdee2800640 1 --2- 172.21.15.163:0/1601833376 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdedc0c6d50 0x7fdedc071ee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdec40097a0 tx=0x7fdec402b960 comp rx=0 tx=0).stop 2024-04-01T16:34:55.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.990+0000 7fdee2800640 1 -- 172.21.15.163:0/1601833376 shutdown_connections 2024-04-01T16:34:55.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.990+0000 7fdee2800640 1 --2- 172.21.15.163:0/1601833376 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdedc0c6d50 0x7fdedc071ee0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:55.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.990+0000 7fdee2800640 1 -- 172.21.15.163:0/1601833376 >> 172.21.15.163:0/1601833376 conn(0x7fdedc0cbe20 msgr2=0x7fdedc0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:55.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.990+0000 7fdee2800640 1 -- 172.21.15.163:0/1601833376 shutdown_connections 2024-04-01T16:34:55.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.990+0000 7fdee2800640 1 -- 172.21.15.163:0/1601833376 wait complete. 2024-04-01T16:34:55.993 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.992+0000 7fdee2800640 1 Processor -- start 2024-04-01T16:34:55.993 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.993+0000 7fdee2800640 1 -- start start 2024-04-01T16:34:55.995 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.994+0000 7fdee2800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdedc072aa0 0x7fdedc0c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.995 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.994+0000 7fdee2800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdedc0c6d50 0x7fdedc146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.995 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.994+0000 7fdee2800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdedc154a60 0x7fdedc146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:55.995 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.994+0000 7fdee2800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc073920 con 0x7fdedc154a60 2024-04-01T16:34:55.995 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.994+0000 7fdee2800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc0c1d80 con 0x7fdedc072aa0 2024-04-01T16:34:55.995 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.994+0000 7fdee2800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdedc073aa0 con 0x7fdedc0c6d50 2024-04-01T16:34:55.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.996+0000 7fdedb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdedc072aa0 0x7fdedc0c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.996+0000 7fded2a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdedc0c6d50 0x7fdedc146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:55.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.997+0000 7fdedb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdedc072aa0 0x7fdedc0c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:46866/0 (socket says 172.21.15.163:46866) 2024-04-01T16:34:55.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:55.997+0000 7fdedb400640 1 -- 172.21.15.163:0/3477172428 learned_addr learned my addr 172.21.15.163:0/3477172428 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:56.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.006+0000 7fdedbe00640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdedc154a60 0x7fdedc146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:56.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.006+0000 7fdedb400640 1 -- 172.21.15.163:0/3477172428 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdedc0c6d50 msgr2=0x7fdedc146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.006+0000 7fdedb400640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdedc0c6d50 0x7fdedc146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.006+0000 7fdedb400640 1 -- 172.21.15.163:0/3477172428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdedc154a60 msgr2=0x7fdedc146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.006+0000 7fdedb400640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdedc154a60 0x7fdedc146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.006+0000 7fdedb400640 1 -- 172.21.15.163:0/3477172428 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc1455b0 con 0x7fdedc072aa0 2024-04-01T16:34:56.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.013+0000 7fdedb400640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdedc072aa0 0x7fdedc0c8d20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00b440 tx=0x7fdecc00b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:56.023 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.023+0000 7fded3e00640 1 -- 172.21.15.163:0/3477172428 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc015020 con 0x7fdedc072aa0 2024-04-01T16:34:56.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.023+0000 7fded3e00640 1 -- 172.21.15.163:0/3477172428 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdecc0118b0 con 0x7fdedc072aa0 2024-04-01T16:34:56.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.023+0000 7fdee2800640 1 -- 172.21.15.163:0/3477172428 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdedc1e62f0 con 0x7fdedc072aa0 2024-04-01T16:34:56.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.023+0000 7fded3e00640 1 -- 172.21.15.163:0/3477172428 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc011ca0 con 0x7fdedc072aa0 2024-04-01T16:34:56.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.024+0000 7fdee2800640 1 -- 172.21.15.163:0/3477172428 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdedc145820 con 0x7fdedc072aa0 2024-04-01T16:34:56.026 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.025+0000 7fdee2800640 1 -- 172.21.15.163:0/3477172428 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdedc145c60 con 0x7fdedc072aa0 2024-04-01T16:34:56.064 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.064+0000 7fa372800640 1 -- 172.21.15.163:0/591692057 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa36c0756d0 con 0x7fa36c154b90 2024-04-01T16:34:56.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.085+0000 7fa332000640 1 -- 172.21.15.163:0/868831054 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320034070 con 0x7fa334070100 2024-04-01T16:34:56.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.085+0000 7fa332000640 1 -- 172.21.15.163:0/868831054 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa320030610 con 0x7fa334070100 2024-04-01T16:34:56.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.085+0000 7fa332000640 1 -- 172.21.15.163:0/868831054 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3200309e0 con 0x7fa334070100 2024-04-01T16:34:56.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.086+0000 7fa33a600640 1 -- 172.21.15.163:0/868831054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa334070100 msgr2=0x7fa33415aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.086+0000 7fa33a600640 1 --2- 172.21.15.163:0/868831054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa334070100 0x7fa33415aa00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa3200097a0 tx=0x7fa32002b960 comp rx=0 tx=0).stop 2024-04-01T16:34:56.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.086+0000 7fa33a600640 1 -- 172.21.15.163:0/868831054 shutdown_connections 2024-04-01T16:34:56.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.086+0000 7fa33a600640 1 --2- 172.21.15.163:0/868831054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa334070100 0x7fa33415aa00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.086+0000 7fa33a600640 1 -- 172.21.15.163:0/868831054 >> 172.21.15.163:0/868831054 conn(0x7fa3340cbe20 msgr2=0x7fa3340cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:56.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.086+0000 7fa33a600640 1 -- 172.21.15.163:0/868831054 shutdown_connections 2024-04-01T16:34:56.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.086+0000 7fa33a600640 1 -- 172.21.15.163:0/868831054 wait complete. 2024-04-01T16:34:56.088 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.088+0000 7fa33a600640 1 Processor -- start 2024-04-01T16:34:56.088 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.088+0000 7fa33a600640 1 -- start start 2024-04-01T16:34:56.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.089+0000 7fa33a600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa334070100 0x7fa3341f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:56.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.089+0000 7fa33a600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3340c8160 0x7fa3341f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:56.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.089+0000 7fa33a600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa334151700 0x7fa33414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:56.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.089+0000 7fa33a600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa3340c7390 con 0x7fa3340c8160 2024-04-01T16:34:56.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.089+0000 7fa33a600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa33415b8e0 con 0x7fa334070100 2024-04-01T16:34:56.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.089+0000 7fa33a600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa334151ae0 con 0x7fa334151700 2024-04-01T16:34:56.092 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.091+0000 7fa333e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa334151700 0x7fa33414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:56.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.095+0000 7fa332a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3340c8160 0x7fa3341f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:56.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.096+0000 7fa332a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3340c8160 0x7fa3341f31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50664/0 (socket says 172.21.15.163:50664) 2024-04-01T16:34:56.097 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.096+0000 7fa332a00640 1 -- 172.21.15.163:0/4154665951 learned_addr learned my addr 172.21.15.163:0/4154665951 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:56.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.102+0000 7fa332a00640 1 -- 172.21.15.163:0/4154665951 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa334151700 msgr2=0x7fa33414e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.102+0000 7fa332a00640 1 --2- 172.21.15.163:0/4154665951 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa334151700 0x7fa33414e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.102+0000 7fa332a00640 1 -- 172.21.15.163:0/4154665951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa334070100 msgr2=0x7fa3341f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.102+0000 7fa332a00640 1 --2- 172.21.15.163:0/4154665951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa334070100 0x7fa3341f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.102+0000 7fa332a00640 1 -- 172.21.15.163:0/4154665951 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3341f36e0 con 0x7fa3340c8160 2024-04-01T16:34:56.106 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.105+0000 7fa332a00640 1 --2- 172.21.15.163:0/4154665951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3340c8160 0x7fa3341f31a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa320009890 tx=0x7fa3200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:56.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.110+0000 7fa32b400640 1 -- 172.21.15.163:0/4154665951 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320034040 con 0x7fa3340c8160 2024-04-01T16:34:56.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.110+0000 7fa32b400640 1 -- 172.21.15.163:0/4154665951 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa32003ad30 con 0x7fa3340c8160 2024-04-01T16:34:56.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.110+0000 7fa32b400640 1 -- 172.21.15.163:0/4154665951 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320044630 con 0x7fa3340c8160 2024-04-01T16:34:56.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.110+0000 7fa33a600640 1 -- 172.21.15.163:0/4154665951 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3341f1e20 con 0x7fa3340c8160 2024-04-01T16:34:56.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.110+0000 7fa33a600640 1 -- 172.21.15.163:0/4154665951 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3341f23e0 con 0x7fa3340c8160 2024-04-01T16:34:56.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.111+0000 7fa33a600640 1 -- 172.21.15.163:0/4154665951 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3340756d0 con 0x7fa3340c8160 2024-04-01T16:34:56.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.190+0000 7f5f1a000640 1 -- 172.21.15.163:0/2979318565 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5f140c6950 con 0x7f5f141583f0 2024-04-01T16:34:56.406 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.406+0000 7fded3e00640 1 -- 172.21.15.163:0/3477172428 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdecc018020 con 0x7fdedc072aa0 2024-04-01T16:34:56.408 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.408+0000 7fded3e00640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdeb806c940 0x7fdeb806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:56.409 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.408+0000 7fded2a00640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdeb806c940 0x7fdeb806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:56.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.410+0000 7fded2a00640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdeb806c940 0x7fdeb806ee00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdec4036000 tx=0x7fdec403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:56.416 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.416+0000 7f5f0b400640 1 -- 172.21.15.163:0/2979318565 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f140c6950 con 0x7f5f141583f0 2024-04-01T16:34:56.417 INFO:teuthology.orchestra.run.smithi163.stdout:64424509452 2024-04-01T16:34:56.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.417+0000 7fded3e00640 1 -- 172.21.15.163:0/3477172428 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fdecc058000 con 0x7fdedc072aa0 2024-04-01T16:34:56.419 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.418+0000 7fa32b400640 1 -- 172.21.15.163:0/4154665951 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa32004b060 con 0x7fa3340c8160 2024-04-01T16:34:56.419 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.419+0000 7f5f1a000640 1 -- 172.21.15.163:0/2979318565 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5ef406c940 msgr2=0x7f5ef406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.419+0000 7f5f1a000640 1 --2- 172.21.15.163:0/2979318565 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5ef406c940 0x7f5ef406ee00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f04001eb0 tx=0x7f5f04001600 comp rx=0 tx=0).stop 2024-04-01T16:34:56.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.419+0000 7f5f1a000640 1 -- 172.21.15.163:0/2979318565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f141583f0 msgr2=0x7f5f1414df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.419+0000 7f5f1a000640 1 --2- 172.21.15.163:0/2979318565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f141583f0 0x7f5f1414df60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009f60 tx=0x7f5f0c004b50 comp rx=0 tx=0).stop 2024-04-01T16:34:56.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.419+0000 7f5f1a000640 1 -- 172.21.15.163:0/2979318565 shutdown_connections 2024-04-01T16:34:56.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.419+0000 7f5f1a000640 1 --2- 172.21.15.163:0/2979318565 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5ef406c940 0x7f5ef406ee00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.419+0000 7f5f1a000640 1 --2- 172.21.15.163:0/2979318565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f141583f0 0x7f5f1414df60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.419+0000 7f5f1a000640 1 --2- 172.21.15.163:0/2979318565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f1414c980 0x7f5f14147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.419+0000 7f5f1a000640 1 --2- 172.21.15.163:0/2979318565 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f1414c5a0 0x7f5f141471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.419+0000 7f5f1a000640 1 -- 172.21.15.163:0/2979318565 >> 172.21.15.163:0/2979318565 conn(0x7f5f140cbe20 msgr2=0x7f5f14151c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:56.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.419+0000 7f5f1a000640 1 -- 172.21.15.163:0/2979318565 shutdown_connections 2024-04-01T16:34:56.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.419+0000 7f5f1a000640 1 -- 172.21.15.163:0/2979318565 wait complete. 2024-04-01T16:34:56.421 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.421+0000 7fa32b400640 1 --2- 172.21.15.163:0/4154665951 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa31406c940 0x7fa31406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:56.422 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.422+0000 7fa333400640 1 --2- 172.21.15.163:0/4154665951 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa31406c940 0x7fa31406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:56.423 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.423+0000 7fa333400640 1 --2- 172.21.15.163:0/4154665951 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa31406c940 0x7fa31406ee00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa324000f60 tx=0x7fa3240079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:56.441 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.441+0000 7fa32b400640 1 -- 172.21.15.163:0/4154665951 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fa320037e20 con 0x7fa3340c8160 2024-04-01T16:34:56.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.5 2024-04-01T16:34:56.442 DEBUG:teuthology.parallel:result is None 2024-04-01T16:34:56.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.442+0000 7fa32b400640 1 -- 172.21.15.163:0/4154665951 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa32003f070 con 0x7fa3340c8160 2024-04-01T16:34:56.448 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.448+0000 7fa363400640 1 -- 172.21.15.163:0/591692057 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa358059e90 con 0x7fa36c154b90 2024-04-01T16:34:56.448 INFO:teuthology.orchestra.run.smithi163.stdout:60129542155 2024-04-01T16:34:56.450 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.450+0000 7fded3e00640 1 -- 172.21.15.163:0/3477172428 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fdecc01f020 con 0x7fdedc072aa0 2024-04-01T16:34:56.451 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.450+0000 7fa372800640 1 -- 172.21.15.163:0/591692057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa34c06c970 msgr2=0x7fa34c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.451 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.450+0000 7fa372800640 1 --2- 172.21.15.163:0/591692057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa34c06c970 0x7fa34c06ee30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa35c036000 tx=0x7fa35c030000 comp rx=0 tx=0).stop 2024-04-01T16:34:56.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.451+0000 7fa372800640 1 -- 172.21.15.163:0/591692057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c154b90 msgr2=0x7fa36c1e5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.451+0000 7fa372800640 1 --2- 172.21.15.163:0/591692057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c154b90 0x7fa36c1e5790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa35800e870 tx=0x7fa35800ed30 comp rx=0 tx=0).stop 2024-04-01T16:34:56.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.451+0000 7fa372800640 1 -- 172.21.15.163:0/591692057 shutdown_connections 2024-04-01T16:34:56.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.451+0000 7fa372800640 1 --2- 172.21.15.163:0/591692057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa34c06c970 0x7fa34c06ee30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.451+0000 7fa372800640 1 --2- 172.21.15.163:0/591692057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa36c15e660 0x7fa36c150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.451+0000 7fa372800640 1 --2- 172.21.15.163:0/591692057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa36c154b90 0x7fa36c1e5790 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.451+0000 7fa372800640 1 --2- 172.21.15.163:0/591692057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa36c0ce900 0x7fa36c1e4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.451+0000 7fa372800640 1 -- 172.21.15.163:0/591692057 >> 172.21.15.163:0/591692057 conn(0x7fa36c0676a0 msgr2=0x7fa36c1523b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:56.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.451+0000 7fa372800640 1 -- 172.21.15.163:0/591692057 shutdown_connections 2024-04-01T16:34:56.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.451+0000 7fa372800640 1 -- 172.21.15.163:0/591692057 wait complete. 2024-04-01T16:34:56.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.3 2024-04-01T16:34:56.479 DEBUG:teuthology.parallel:result is None 2024-04-01T16:34:56.645 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.644+0000 7fa33a600640 1 -- 172.21.15.163:0/4154665951 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa334072260 con 0x7fa3340c8160 2024-04-01T16:34:56.662 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.662+0000 7fdee2800640 1 -- 172.21.15.163:0/3477172428 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fdedc0756d0 con 0x7fdedc072aa0 2024-04-01T16:34:56.668 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.668+0000 7fded3e00640 1 -- 172.21.15.163:0/3477172428 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdecc00d040 con 0x7fdedc072aa0 2024-04-01T16:34:56.668 INFO:teuthology.orchestra.run.smithi163.stdout:60129542158 2024-04-01T16:34:56.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.670+0000 7fdee2800640 1 -- 172.21.15.163:0/3477172428 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdeb806c940 msgr2=0x7fdeb806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.670+0000 7fdee2800640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdeb806c940 0x7fdeb806ee00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdec4036000 tx=0x7fdec403b040 comp rx=0 tx=0).stop 2024-04-01T16:34:56.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.670+0000 7fdee2800640 1 -- 172.21.15.163:0/3477172428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdedc072aa0 msgr2=0x7fdedc0c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.670+0000 7fdee2800640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdedc072aa0 0x7fdedc0c8d20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00b440 tx=0x7fdecc00b900 comp rx=0 tx=0).stop 2024-04-01T16:34:56.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.670+0000 7fdee2800640 1 -- 172.21.15.163:0/3477172428 shutdown_connections 2024-04-01T16:34:56.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.670+0000 7fdee2800640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdeb806c940 0x7fdeb806ee00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.670+0000 7fdee2800640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdedc154a60 0x7fdedc146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.670+0000 7fdee2800640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdedc0c6d50 0x7fdedc146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.670+0000 7fdee2800640 1 --2- 172.21.15.163:0/3477172428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdedc072aa0 0x7fdedc0c8d20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.671 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.670+0000 7fdee2800640 1 -- 172.21.15.163:0/3477172428 >> 172.21.15.163:0/3477172428 conn(0x7fdedc0cbe20 msgr2=0x7fdedc14a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:56.672 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.670+0000 7fdee2800640 1 -- 172.21.15.163:0/3477172428 shutdown_connections 2024-04-01T16:34:56.672 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.670+0000 7fdee2800640 1 -- 172.21.15.163:0/3477172428 wait complete. 2024-04-01T16:34:56.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542158 for osd.6 2024-04-01T16:34:56.687 DEBUG:teuthology.parallel:result is None 2024-04-01T16:34:56.691 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.691+0000 7fa32b400640 1 -- 172.21.15.163:0/4154665951 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa32007c300 con 0x7fa3340c8160 2024-04-01T16:34:56.692 INFO:teuthology.orchestra.run.smithi163.stdout:64424509455 2024-04-01T16:34:56.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.694+0000 7fa33a600640 1 -- 172.21.15.163:0/4154665951 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa31406c940 msgr2=0x7fa31406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.694+0000 7fa33a600640 1 --2- 172.21.15.163:0/4154665951 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa31406c940 0x7fa31406ee00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa324000f60 tx=0x7fa3240079d0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.694+0000 7fa33a600640 1 -- 172.21.15.163:0/4154665951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3340c8160 msgr2=0x7fa3341f31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.694+0000 7fa33a600640 1 --2- 172.21.15.163:0/4154665951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3340c8160 0x7fa3341f31a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa320009890 tx=0x7fa3200046c0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.694+0000 7fa33a600640 1 -- 172.21.15.163:0/4154665951 shutdown_connections 2024-04-01T16:34:56.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.694+0000 7fa33a600640 1 --2- 172.21.15.163:0/4154665951 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa31406c940 0x7fa31406ee00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.694+0000 7fa33a600640 1 --2- 172.21.15.163:0/4154665951 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa334151700 0x7fa33414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.694+0000 7fa33a600640 1 --2- 172.21.15.163:0/4154665951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3340c8160 0x7fa3341f31a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.694+0000 7fa33a600640 1 --2- 172.21.15.163:0/4154665951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa334070100 0x7fa3341f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.694+0000 7fa33a600640 1 -- 172.21.15.163:0/4154665951 >> 172.21.15.163:0/4154665951 conn(0x7fa3340cbe20 msgr2=0x7fa334150bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:56.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.694+0000 7fa33a600640 1 -- 172.21.15.163:0/4154665951 shutdown_connections 2024-04-01T16:34:56.696 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.694+0000 7fa33a600640 1 -- 172.21.15.163:0/4154665951 wait complete. 2024-04-01T16:34:56.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509455 for osd.2 2024-04-01T16:34:56.713 DEBUG:teuthology.parallel:result is None 2024-04-01T16:34:56.714 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-01T16:34:56.714 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T16:34:56.952 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.952+0000 7f19abe00640 1 Processor -- start 2024-04-01T16:34:56.952 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.952+0000 7f19abe00640 1 -- start start 2024-04-01T16:34:56.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.953+0000 7f19abe00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f19ac072540 0x7f19ac072950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:56.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.953+0000 7f19abe00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19ac072090 con 0x7f19ac0c8fe0 2024-04-01T16:34:56.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.953+0000 7f19abe00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19ac15bb90 con 0x7f19ac159010 2024-04-01T16:34:56.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.953+0000 7f19abe00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f19ac15b960 con 0x7f19ac072540 2024-04-01T16:34:56.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.954+0000 7f19aaa00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f19ac0c8fe0 0x7f19ac06be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:42780/0 (socket says 172.21.15.163:42780) 2024-04-01T16:34:56.954 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.954+0000 7f19aaa00640 1 -- 172.21.15.163:0/2025162688 learned_addr learned my addr 172.21.15.163:0/2025162688 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:56.955 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.955+0000 7f19ab400640 1 --2- 172.21.15.163:0/2025162688 >> v2:172.21.15.189:3300/0 conn(0x7f19ac072540 0x7f19ac072950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:56.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.957+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785976327 0 0) 0x7f19ac072090 con 0x7f19ac0c8fe0 2024-04-01T16:34:56.958 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.957+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1990003520 con 0x7f19ac0c8fe0 2024-04-01T16:34:56.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2765112822 0 0) 0x7f1990003520 con 0x7f19ac0c8fe0 2024-04-01T16:34:56.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 >> v2:172.21.15.189:3300/0 conn(0x7f19ac072540 msgr2=0x7f19ac072950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:56.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 --2- 172.21.15.163:0/2025162688 >> v2:172.21.15.189:3300/0 conn(0x7f19ac072540 0x7f19ac072950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 >> v1:172.21.15.189:6789/0 conn(0x7f19ac159010 legacy=0x7f19ac0c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac06c560 con 0x7f19ac0c8fe0 2024-04-01T16:34:56.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7f199c001670 con 0x7f19ac0c8fe0 2024-04-01T16:34:56.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 >> v1:172.21.15.163:6789/0 conn(0x7f19ac0c8fe0 legacy=0x7f19ac06be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 --2- 172.21.15.163:0/2025162688 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1990003a00 0x7f1990003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:56.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 --2- 172.21.15.163:0/2025162688 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1990004800 0x7f1990004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:56.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 --2- 172.21.15.163:0/2025162688 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 0x7f199000fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:56.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f19900104a0 con 0x7f19900051c0 2024-04-01T16:34:56.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1990010650 con 0x7f1990003a00 2024-04-01T16:34:56.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.961+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1990010850 con 0x7f1990004800 2024-04-01T16:34:56.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.963+0000 7f19a2000640 1 --2- 172.21.15.163:0/2025162688 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1990004800 0x7f1990004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:56.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.963+0000 7f19ab400640 1 --2- 172.21.15.163:0/2025162688 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 0x7f199000fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:56.969 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.969+0000 7f19ab400640 1 -- 172.21.15.163:0/2025162688 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1990004800 msgr2=0x7f1990004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:56.969 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.969+0000 7f19ab400640 1 --2- 172.21.15.163:0/2025162688 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1990004800 0x7f1990004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.969 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.969+0000 7f19ab400640 1 -- 172.21.15.163:0/2025162688 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1990003a00 msgr2=0x7f1990003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:56.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.969+0000 7f19ab400640 1 --2- 172.21.15.163:0/2025162688 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1990003a00 0x7f1990003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.969+0000 7f19ab400640 1 -- 172.21.15.163:0/2025162688 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1990003520 con 0x7f19900051c0 2024-04-01T16:34:56.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.971+0000 7f19ab400640 1 -- 172.21.15.163:0/2025162688 reap_dead start 2024-04-01T16:34:56.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.973+0000 7f19ab400640 1 --2- 172.21.15.163:0/2025162688 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 0x7f199000fdd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009fc0 tx=0x7f1990005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70da725c67ac203e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:56.981 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.981+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4009c10 con 0x7f19900051c0 2024-04-01T16:34:56.982 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.981+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a402cca0 con 0x7f19900051c0 2024-04-01T16:34:56.982 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.981+0000 7f19aa000640 1 -- 172.21.15.163:0/2025162688 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4003bd0 con 0x7f19900051c0 2024-04-01T16:34:56.983 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.982+0000 7f19abe00640 1 -- 172.21.15.163:0/2025162688 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 msgr2=0x7f199000fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.983 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.982+0000 7f19abe00640 1 --2- 172.21.15.163:0/2025162688 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 0x7f199000fdd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009fc0 tx=0x7f1990005830 comp rx=0 tx=0).stop 2024-04-01T16:34:56.983 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.982+0000 7f19abe00640 1 -- 172.21.15.163:0/2025162688 shutdown_connections 2024-04-01T16:34:56.983 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.982+0000 7f19abe00640 1 --2- 172.21.15.163:0/2025162688 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 0x7f199000fdd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.983 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.982+0000 7f19abe00640 1 -- 172.21.15.163:0/2025162688 >> 172.21.15.163:0/2025162688 conn(0x7f19ac06f7d0 msgr2=0x7f19ac06fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:56.983 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.982+0000 7f19abe00640 1 -- 172.21.15.163:0/2025162688 shutdown_connections 2024-04-01T16:34:56.983 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.982+0000 7f19abe00640 1 -- 172.21.15.163:0/2025162688 wait complete. 2024-04-01T16:34:56.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.985+0000 7f19abe00640 1 Processor -- start 2024-04-01T16:34:56.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.985+0000 7f19abe00640 1 -- start start 2024-04-01T16:34:56.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.986+0000 7f19abe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 0x7f19ac150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:56.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.986+0000 7f19abe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19ac0c85b0 0x7f19ac156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:56.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.986+0000 7f19abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19ac0b1140 0x7f19ac156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:56.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.986+0000 7f19abe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac15c410 con 0x7f19900051c0 2024-04-01T16:34:56.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.986+0000 7f19abe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac15c130 con 0x7f19ac0b1140 2024-04-01T16:34:56.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.986+0000 7f19abe00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f19ac15c6f0 con 0x7f19ac0c85b0 2024-04-01T16:34:56.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.987+0000 7f19aaa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 0x7f19ac150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:56.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.987+0000 7f19aaa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 0x7f19ac150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50684/0 (socket says 172.21.15.163:50684) 2024-04-01T16:34:56.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.987+0000 7f19aaa00640 1 -- 172.21.15.163:0/3005101341 learned_addr learned my addr 172.21.15.163:0/3005101341 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:56.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.988+0000 7f19a2000640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19ac0c85b0 0x7f19ac156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:56.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.991+0000 7f19aaa00640 1 -- 172.21.15.163:0/3005101341 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19ac0c85b0 msgr2=0x7f19ac156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.991+0000 7f19aaa00640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19ac0c85b0 0x7f19ac156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.992 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.991+0000 7f19aaa00640 1 -- 172.21.15.163:0/3005101341 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19ac0b1140 msgr2=0x7f19ac156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:56.992 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.991+0000 7f19aaa00640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19ac0b1140 0x7f19ac156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:56.992 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.991+0000 7f19aaa00640 1 -- 172.21.15.163:0/3005101341 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac153640 con 0x7f19900051c0 2024-04-01T16:34:56.994 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.993+0000 7f19aaa00640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 0x7f19ac150f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f199c00c700 tx=0x7f199c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:56.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.997+0000 7f19a3400640 1 -- 172.21.15.163:0/3005101341 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c018070 con 0x7f19900051c0 2024-04-01T16:34:56.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.997+0000 7f19a3400640 1 -- 172.21.15.163:0/3005101341 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f199c0072f0 con 0x7f19900051c0 2024-04-01T16:34:56.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.997+0000 7f19a3400640 1 -- 172.21.15.163:0/3005101341 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c0047e0 con 0x7f19900051c0 2024-04-01T16:34:56.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.997+0000 7f19abe00640 1 -- 172.21.15.163:0/3005101341 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ac0a96d0 con 0x7f19900051c0 2024-04-01T16:34:56.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.998+0000 7f19abe00640 1 -- 172.21.15.163:0/3005101341 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ac1538c0 con 0x7f19900051c0 2024-04-01T16:34:56.999 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:56.999+0000 7f19abe00640 1 -- 172.21.15.163:0/3005101341 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ac0756d0 con 0x7f19900051c0 2024-04-01T16:34:57.025 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.025+0000 7f19a3400640 1 -- 172.21.15.163:0/3005101341 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f199c01b070 con 0x7f19900051c0 2024-04-01T16:34:57.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.027+0000 7f19a3400640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f198806c970 0x7f198806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:57.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.027+0000 7f19a3400640 1 -- 172.21.15.163:0/3005101341 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f199c004cf0 con 0x7f19900051c0 2024-04-01T16:34:57.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.027+0000 7f19a2000640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f198806c970 0x7f198806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:57.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.028+0000 7f19a2000640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f198806c970 0x7f198806ee30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0c56b0 tx=0x7f1994009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:57.379 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.379+0000 7f19a3400640 1 -- 172.21.15.163:0/3005101341 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f199c022020 con 0x7f19900051c0 2024-04-01T16:34:57.601 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.601+0000 7f19abe00640 1 -- 172.21.15.163:0/3005101341 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19ac151e80 con 0x7f198806c970 2024-04-01T16:34:57.611 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.611+0000 7f19a3400640 1 -- 172.21.15.163:0/3005101341 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251776 (secure 0 0 0) 0x7f19ac151e80 con 0x7f198806c970 2024-04-01T16:34:57.614 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:57.616 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T16:34:57.617 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.616+0000 7f19abe00640 1 -- 172.21.15.163:0/3005101341 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f198806c970 msgr2=0x7f198806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:57.617 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.616+0000 7f19abe00640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f198806c970 0x7f198806ee30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0c56b0 tx=0x7f1994009040 comp rx=0 tx=0).stop 2024-04-01T16:34:57.617 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.616+0000 7f19abe00640 1 -- 172.21.15.163:0/3005101341 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 msgr2=0x7f19ac150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:57.617 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.616+0000 7f19abe00640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 0x7f19ac150f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f199c00c700 tx=0x7f199c00cbc0 comp rx=0 tx=0).stop 2024-04-01T16:34:57.617 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.616+0000 7f19abe00640 1 -- 172.21.15.163:0/3005101341 shutdown_connections 2024-04-01T16:34:57.617 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.616+0000 7f19abe00640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f198806c970 0x7f198806ee30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:57.617 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.616+0000 7f19abe00640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19ac0b1140 0x7f19ac156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:57.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.616+0000 7f19abe00640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f19ac0c85b0 0x7f19ac156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:57.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.616+0000 7f19abe00640 1 --2- 172.21.15.163:0/3005101341 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19900051c0 0x7f19ac150f90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:57.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.616+0000 7f19abe00640 1 -- 172.21.15.163:0/3005101341 >> 172.21.15.163:0/3005101341 conn(0x7f19ac06f7d0 msgr2=0x7f19ac15aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:57.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.616+0000 7f19abe00640 1 -- 172.21.15.163:0/3005101341 shutdown_connections 2024-04-01T16:34:57.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.616+0000 7f19abe00640 1 -- 172.21.15.163:0/3005101341 wait complete. 2024-04-01T16:34:57.633 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-04-01T16:34:55.790816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219500,"kb_used_data":3324,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755220,"statfs":{"total":773094113280,"available":772869345280,"internally_reserved":0,"allocated":3403776,"data_stored":1985959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002429"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606518+0000","last_change":"2024-04-01T16:34:34.033508+0000","last_active":"2024-04-01T16:34:37.606518+0000","last_peered":"2024-04-01T16:34:37.606518+0000","last_clean":"2024-04-01T16:34:37.606518+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T16:34:37.606518+0000","last_undegraded":"2024-04-01T16:34:37.606518+0000","last_fullsized":"2024-04-01T16:34:37.606518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.261033+0000","last_change":"2024-04-01T16:34:34.065375+0000","last_active":"2024-04-01T16:34:52.261033+0000","last_peered":"2024-04-01T16:34:52.261033+0000","last_clean":"2024-04-01T16:34:52.261033+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T16:34:52.261033+0000","last_undegraded":"2024-04-01T16:34:52.261033+0000","last_fullsized":"2024-04-01T16:34:52.261033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050257+0000","last_change":"2024-04-01T16:34:34.084618+0000","last_active":"2024-04-01T16:34:38.050257+0000","last_peered":"2024-04-01T16:34:38.050257+0000","last_clean":"2024-04-01T16:34:38.050257+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T16:34:38.050257+0000","last_undegraded":"2024-04-01T16:34:38.050257+0000","last_fullsized":"2024-04-01T16:34:38.050257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:43.530081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010013+0000","last_change":"2024-04-01T16:34:34.088694+0000","last_active":"2024-04-01T16:34:55.010013+0000","last_peered":"2024-04-01T16:34:55.010013+0000","last_clean":"2024-04-01T16:34:55.010013+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T16:34:55.010013+0000","last_undegraded":"2024-04-01T16:34:55.010013+0000","last_fullsized":"2024-04-01T16:34:55.010013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605580+0000","last_change":"2024-04-01T16:34:34.085765+0000","last_active":"2024-04-01T16:34:37.605580+0000","last_peered":"2024-04-01T16:34:37.605580+0000","last_clean":"2024-04-01T16:34:37.605580+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T16:34:37.605580+0000","last_undegraded":"2024-04-01T16:34:37.605580+0000","last_fullsized":"2024-04-01T16:34:37.605580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009741+0000","last_change":"2024-04-01T16:34:34.066150+0000","last_active":"2024-04-01T16:34:55.009741+0000","last_peered":"2024-04-01T16:34:55.009741+0000","last_clean":"2024-04-01T16:34:55.009741+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T16:34:55.009741+0000","last_undegraded":"2024-04-01T16:34:55.009741+0000","last_fullsized":"2024-04-01T16:34:55.009741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:08:56.651785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.604963+0000","last_change":"2024-04-01T16:34:34.072924+0000","last_active":"2024-04-01T16:34:37.604963+0000","last_peered":"2024-04-01T16:34:37.604963+0000","last_clean":"2024-04-01T16:34:37.604963+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T16:34:37.604963+0000","last_undegraded":"2024-04-01T16:34:37.604963+0000","last_fullsized":"2024-04-01T16:34:37.604963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255225+0000","last_change":"2024-04-01T16:34:34.088361+0000","last_active":"2024-04-01T16:34:52.255225+0000","last_peered":"2024-04-01T16:34:52.255225+0000","last_clean":"2024-04-01T16:34:52.255225+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T16:34:52.255225+0000","last_undegraded":"2024-04-01T16:34:52.255225+0000","last_fullsized":"2024-04-01T16:34:52.255225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606669+0000","last_change":"2024-04-01T16:34:34.038534+0000","last_active":"2024-04-01T16:34:37.606669+0000","last_peered":"2024-04-01T16:34:37.606669+0000","last_clean":"2024-04-01T16:34:37.606669+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T16:34:37.606669+0000","last_undegraded":"2024-04-01T16:34:37.606669+0000","last_fullsized":"2024-04-01T16:34:37.606669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:54.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248629+0000","last_change":"2024-04-01T16:34:34.040513+0000","last_active":"2024-04-01T16:34:52.248629+0000","last_peered":"2024-04-01T16:34:52.248629+0000","last_clean":"2024-04-01T16:34:52.248629+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T16:34:52.248629+0000","last_undegraded":"2024-04-01T16:34:52.248629+0000","last_fullsized":"2024-04-01T16:34:52.248629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248396+0000","last_change":"2024-04-01T16:34:34.038167+0000","last_active":"2024-04-01T16:34:52.248396+0000","last_peered":"2024-04-01T16:34:52.248396+0000","last_clean":"2024-04-01T16:34:52.248396+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T16:34:52.248396+0000","last_undegraded":"2024-04-01T16:34:52.248396+0000","last_fullsized":"2024-04-01T16:34:52.248396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008124+0000","last_change":"2024-04-01T16:34:34.035177+0000","last_active":"2024-04-01T16:34:55.008124+0000","last_peered":"2024-04-01T16:34:55.008124+0000","last_clean":"2024-04-01T16:34:55.008124+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T16:34:55.008124+0000","last_undegraded":"2024-04-01T16:34:55.008124+0000","last_fullsized":"2024-04-01T16:34:55.008124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:37.711846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255564+0000","last_change":"2024-04-01T16:34:34.086031+0000","last_active":"2024-04-01T16:34:52.255564+0000","last_peered":"2024-04-01T16:34:52.255564+0000","last_clean":"2024-04-01T16:34:52.255564+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T16:34:52.255564+0000","last_undegraded":"2024-04-01T16:34:52.255564+0000","last_fullsized":"2024-04-01T16:34:52.255564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049973+0000","last_change":"2024-04-01T16:34:34.071535+0000","last_active":"2024-04-01T16:34:38.049973+0000","last_peered":"2024-04-01T16:34:38.049973+0000","last_clean":"2024-04-01T16:34:38.049973+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T16:34:38.049973+0000","last_undegraded":"2024-04-01T16:34:38.049973+0000","last_fullsized":"2024-04-01T16:34:38.049973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:45.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260608+0000","last_change":"2024-04-01T16:34:33.904701+0000","last_active":"2024-04-01T16:34:52.260608+0000","last_peered":"2024-04-01T16:34:52.260608+0000","last_clean":"2024-04-01T16:34:52.260608+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T16:34:52.260608+0000","last_undegraded":"2024-04-01T16:34:52.260608+0000","last_fullsized":"2024-04-01T16:34:52.260608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009278+0000","last_change":"2024-04-01T16:34:34.064695+0000","last_active":"2024-04-01T16:34:55.009278+0000","last_peered":"2024-04-01T16:34:55.009278+0000","last_clean":"2024-04-01T16:34:55.009278+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T16:34:55.009278+0000","last_undegraded":"2024-04-01T16:34:55.009278+0000","last_fullsized":"2024-04-01T16:34:55.009278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.798148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010268+0000","last_change":"2024-04-01T16:34:34.032994+0000","last_active":"2024-04-01T16:34:55.010268+0000","last_peered":"2024-04-01T16:34:55.010268+0000","last_clean":"2024-04-01T16:34:55.010268+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T16:34:55.010268+0000","last_undegraded":"2024-04-01T16:34:55.010268+0000","last_fullsized":"2024-04-01T16:34:55.010268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591780+0000","last_change":"2024-04-01T16:34:34.082238+0000","last_active":"2024-04-01T16:34:37.591780+0000","last_peered":"2024-04-01T16:34:37.591780+0000","last_clean":"2024-04-01T16:34:37.591780+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T16:34:37.591780+0000","last_undegraded":"2024-04-01T16:34:37.591780+0000","last_fullsized":"2024-04-01T16:34:37.591780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606200+0000","last_change":"2024-04-01T16:34:34.083056+0000","last_active":"2024-04-01T16:34:37.606200+0000","last_peered":"2024-04-01T16:34:37.606200+0000","last_clean":"2024-04-01T16:34:37.606200+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T16:34:37.606200+0000","last_undegraded":"2024-04-01T16:34:37.606200+0000","last_fullsized":"2024-04-01T16:34:37.606200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248422+0000","last_change":"2024-04-01T16:34:34.034017+0000","last_active":"2024-04-01T16:34:52.248422+0000","last_peered":"2024-04-01T16:34:52.248422+0000","last_clean":"2024-04-01T16:34:52.248422+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T16:34:52.248422+0000","last_undegraded":"2024-04-01T16:34:52.248422+0000","last_fullsized":"2024-04-01T16:34:52.248422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:33.976417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049407+0000","last_change":"2024-04-01T16:34:34.068541+0000","last_active":"2024-04-01T16:34:38.049407+0000","last_peered":"2024-04-01T16:34:38.049407+0000","last_clean":"2024-04-01T16:34:38.049407+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T16:34:38.049407+0000","last_undegraded":"2024-04-01T16:34:38.049407+0000","last_fullsized":"2024-04-01T16:34:38.049407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:29.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009827+0000","last_change":"2024-04-01T16:34:34.031774+0000","last_active":"2024-04-01T16:34:55.009827+0000","last_peered":"2024-04-01T16:34:55.009827+0000","last_clean":"2024-04-01T16:34:55.009827+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T16:34:55.009827+0000","last_undegraded":"2024-04-01T16:34:55.009827+0000","last_fullsized":"2024-04-01T16:34:55.009827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:39.294525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255352+0000","last_change":"2024-04-01T16:34:34.090324+0000","last_active":"2024-04-01T16:34:52.255352+0000","last_peered":"2024-04-01T16:34:52.255352+0000","last_clean":"2024-04-01T16:34:52.255352+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T16:34:52.255352+0000","last_undegraded":"2024-04-01T16:34:52.255352+0000","last_fullsized":"2024-04-01T16:34:52.255352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:55:40.168021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008960+0000","last_change":"2024-04-01T16:34:34.083544+0000","last_active":"2024-04-01T16:34:55.008960+0000","last_peered":"2024-04-01T16:34:55.008960+0000","last_clean":"2024-04-01T16:34:55.008960+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T16:34:55.008960+0000","last_undegraded":"2024-04-01T16:34:55.008960+0000","last_fullsized":"2024-04-01T16:34:55.008960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255904+0000","last_change":"2024-04-01T16:34:34.090721+0000","last_active":"2024-04-01T16:34:52.255904+0000","last_peered":"2024-04-01T16:34:52.255904+0000","last_clean":"2024-04-01T16:34:52.255904+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T16:34:52.255904+0000","last_undegraded":"2024-04-01T16:34:52.255904+0000","last_fullsized":"2024-04-01T16:34:52.255904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-01T16:34:37.629903+0000","last_change":"2024-04-01T16:34:52.248200+0000","last_active":"2024-04-01T16:34:52.248200+0000","last_peered":"2024-04-01T16:34:37.629903+0000","last_clean":"2024-04-01T16:34:37.629903+0000","last_became_active":"2024-04-01T16:34:34.032529+0000","last_became_peered":"2024-04-01T16:34:34.032529+0000","last_unstale":"2024-04-01T16:34:37.629903+0000","last_undegraded":"2024-04-01T16:34:37.629903+0000","last_fullsized":"2024-04-01T16:34:37.629903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260654+0000","last_change":"2024-04-01T16:34:34.091911+0000","last_active":"2024-04-01T16:34:52.260654+0000","last_peered":"2024-04-01T16:34:52.260654+0000","last_clean":"2024-04-01T16:34:52.260654+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T16:34:52.260654+0000","last_undegraded":"2024-04-01T16:34:52.260654+0000","last_fullsized":"2024-04-01T16:34:52.260654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255582+0000","last_change":"2024-04-01T16:34:34.091540+0000","last_active":"2024-04-01T16:34:52.255582+0000","last_peered":"2024-04-01T16:34:52.255582+0000","last_clean":"2024-04-01T16:34:52.255582+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T16:34:52.255582+0000","last_undegraded":"2024-04-01T16:34:52.255582+0000","last_fullsized":"2024-04-01T16:34:52.255582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049518+0000","last_change":"2024-04-01T16:34:34.087634+0000","last_active":"2024-04-01T16:34:38.049518+0000","last_peered":"2024-04-01T16:34:38.049518+0000","last_clean":"2024-04-01T16:34:38.049518+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T16:34:38.049518+0000","last_undegraded":"2024-04-01T16:34:38.049518+0000","last_fullsized":"2024-04-01T16:34:38.049518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:12.994756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009994+0000","last_change":"2024-04-01T16:34:34.084026+0000","last_active":"2024-04-01T16:34:55.009994+0000","last_peered":"2024-04-01T16:34:55.009994+0000","last_clean":"2024-04-01T16:34:55.009994+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T16:34:55.009994+0000","last_undegraded":"2024-04-01T16:34:55.009994+0000","last_fullsized":"2024-04-01T16:34:55.009994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591723+0000","last_change":"2024-04-01T16:34:34.088300+0000","last_active":"2024-04-01T16:34:37.591723+0000","last_peered":"2024-04-01T16:34:37.591723+0000","last_clean":"2024-04-01T16:34:37.591723+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T16:34:37.591723+0000","last_undegraded":"2024-04-01T16:34:37.591723+0000","last_fullsized":"2024-04-01T16:34:37.591723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.247856+0000","last_change":"2024-04-01T16:34:34.068348+0000","last_active":"2024-04-01T16:34:52.247856+0000","last_peered":"2024-04-01T16:34:52.247856+0000","last_clean":"2024-04-01T16:34:52.247856+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T16:34:52.247856+0000","last_undegraded":"2024-04-01T16:34:52.247856+0000","last_fullsized":"2024-04-01T16:34:52.247856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010349+0000","last_change":"2024-04-01T16:34:33.901019+0000","last_active":"2024-04-01T16:34:55.010349+0000","last_peered":"2024-04-01T16:34:55.010349+0000","last_clean":"2024-04-01T16:34:55.010349+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T16:34:55.010349+0000","last_undegraded":"2024-04-01T16:34:55.010349+0000","last_fullsized":"2024-04-01T16:34:55.010349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:08:37.254438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255720+0000","last_change":"2024-04-01T16:34:31.489434+0000","last_active":"2024-04-01T16:34:52.255720+0000","last_peered":"2024-04-01T16:34:52.255720+0000","last_clean":"2024-04-01T16:34:52.255720+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T16:34:52.255720+0000","last_undegraded":"2024-04-01T16:34:52.255720+0000","last_fullsized":"2024-04-01T16:34:52.255720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049618+0000","last_change":"2024-04-01T16:34:34.065342+0000","last_active":"2024-04-01T16:34:38.049618+0000","last_peered":"2024-04-01T16:34:38.049618+0000","last_clean":"2024-04-01T16:34:38.049618+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T16:34:38.049618+0000","last_undegraded":"2024-04-01T16:34:38.049618+0000","last_fullsized":"2024-04-01T16:34:38.049618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:56.911106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248428+0000","last_change":"2024-04-01T16:34:31.530201+0000","last_active":"2024-04-01T16:34:52.248428+0000","last_peered":"2024-04-01T16:34:52.248428+0000","last_clean":"2024-04-01T16:34:52.248428+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T16:34:52.248428+0000","last_undegraded":"2024-04-01T16:34:52.248428+0000","last_fullsized":"2024-04-01T16:34:52.248428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255510+0000","last_change":"2024-04-01T16:34:31.528238+0000","last_active":"2024-04-01T16:34:52.255510+0000","last_peered":"2024-04-01T16:34:52.255510+0000","last_clean":"2024-04-01T16:34:52.255510+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T16:34:52.255510+0000","last_undegraded":"2024-04-01T16:34:52.255510+0000","last_fullsized":"2024-04-01T16:34:52.255510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255256+0000","last_change":"2024-04-01T16:34:34.091302+0000","last_active":"2024-04-01T16:34:52.255256+0000","last_peered":"2024-04-01T16:34:52.255256+0000","last_clean":"2024-04-01T16:34:52.255256+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T16:34:52.255256+0000","last_undegraded":"2024-04-01T16:34:52.255256+0000","last_fullsized":"2024-04-01T16:34:52.255256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009229+0000","last_change":"2024-04-01T16:34:31.567946+0000","last_active":"2024-04-01T16:34:55.009229+0000","last_peered":"2024-04-01T16:34:55.009229+0000","last_clean":"2024-04-01T16:34:55.009229+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T16:34:55.009229+0000","last_undegraded":"2024-04-01T16:34:55.009229+0000","last_fullsized":"2024-04-01T16:34:55.009229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260464+0000","last_change":"2024-04-01T16:34:34.088894+0000","last_active":"2024-04-01T16:34:52.260464+0000","last_peered":"2024-04-01T16:34:52.260464+0000","last_clean":"2024-04-01T16:34:52.260464+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T16:34:52.260464+0000","last_undegraded":"2024-04-01T16:34:52.260464+0000","last_fullsized":"2024-04-01T16:34:52.260464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.249320+0000","last_change":"2024-04-01T16:34:31.566997+0000","last_active":"2024-04-01T16:34:52.249320+0000","last_peered":"2024-04-01T16:34:52.249320+0000","last_clean":"2024-04-01T16:34:52.249320+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T16:34:52.249320+0000","last_undegraded":"2024-04-01T16:34:52.249320+0000","last_fullsized":"2024-04-01T16:34:52.249320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010465+0000","last_change":"2024-04-01T16:34:34.030831+0000","last_active":"2024-04-01T16:34:55.010465+0000","last_peered":"2024-04-01T16:34:55.010465+0000","last_clean":"2024-04-01T16:34:55.010465+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T16:34:55.010465+0000","last_undegraded":"2024-04-01T16:34:55.010465+0000","last_fullsized":"2024-04-01T16:34:55.010465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010568+0000","last_change":"2024-04-01T16:34:31.569927+0000","last_active":"2024-04-01T16:34:55.010568+0000","last_peered":"2024-04-01T16:34:55.010568+0000","last_clean":"2024-04-01T16:34:55.010568+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T16:34:55.010568+0000","last_undegraded":"2024-04-01T16:34:55.010568+0000","last_fullsized":"2024-04-01T16:34:55.010568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:41.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051582+0000","last_change":"2024-04-01T16:34:34.068959+0000","last_active":"2024-04-01T16:34:38.051582+0000","last_peered":"2024-04-01T16:34:38.051582+0000","last_clean":"2024-04-01T16:34:38.051582+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T16:34:38.051582+0000","last_undegraded":"2024-04-01T16:34:38.051582+0000","last_fullsized":"2024-04-01T16:34:38.051582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:58:57.685708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260693+0000","last_change":"2024-04-01T16:34:31.562792+0000","last_active":"2024-04-01T16:34:52.260693+0000","last_peered":"2024-04-01T16:34:52.260693+0000","last_clean":"2024-04-01T16:34:52.260693+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T16:34:52.260693+0000","last_undegraded":"2024-04-01T16:34:52.260693+0000","last_fullsized":"2024-04-01T16:34:52.260693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:55.684911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008845+0000","last_change":"2024-04-01T16:34:33.916652+0000","last_active":"2024-04-01T16:34:55.008845+0000","last_peered":"2024-04-01T16:34:55.008845+0000","last_clean":"2024-04-01T16:34:55.008845+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T16:34:55.008845+0000","last_undegraded":"2024-04-01T16:34:55.008845+0000","last_fullsized":"2024-04-01T16:34:55.008845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'6","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248702+0000","last_change":"2024-04-01T16:34:31.531366+0000","last_active":"2024-04-01T16:34:52.248702+0000","last_peered":"2024-04-01T16:34:52.248702+0000","last_clean":"2024-04-01T16:34:52.248702+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T16:34:52.248702+0000","last_undegraded":"2024-04-01T16:34:52.248702+0000","last_fullsized":"2024-04-01T16:34:52.248702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605679+0000","last_change":"2024-04-01T16:34:34.085449+0000","last_active":"2024-04-01T16:34:37.605679+0000","last_peered":"2024-04-01T16:34:37.605679+0000","last_clean":"2024-04-01T16:34:37.605679+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T16:34:37.605679+0000","last_undegraded":"2024-04-01T16:34:37.605679+0000","last_fullsized":"2024-04-01T16:34:37.605679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049801+0000","last_change":"2024-04-01T16:34:31.444458+0000","last_active":"2024-04-01T16:34:38.049801+0000","last_peered":"2024-04-01T16:34:38.049801+0000","last_clean":"2024-04-01T16:34:38.049801+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T16:34:38.049801+0000","last_undegraded":"2024-04-01T16:34:38.049801+0000","last_fullsized":"2024-04-01T16:34:38.049801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050237+0000","last_change":"2024-04-01T16:34:34.071521+0000","last_active":"2024-04-01T16:34:38.050237+0000","last_peered":"2024-04-01T16:34:38.050237+0000","last_clean":"2024-04-01T16:34:38.050237+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T16:34:38.050237+0000","last_undegraded":"2024-04-01T16:34:38.050237+0000","last_fullsized":"2024-04-01T16:34:38.050237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:36:13.618956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010073+0000","last_change":"2024-04-01T16:34:31.566202+0000","last_active":"2024-04-01T16:34:55.010073+0000","last_peered":"2024-04-01T16:34:55.010073+0000","last_clean":"2024-04-01T16:34:55.010073+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T16:34:55.010073+0000","last_undegraded":"2024-04-01T16:34:55.010073+0000","last_fullsized":"2024-04-01T16:34:55.010073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:54.543283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605625+0000","last_change":"2024-04-01T16:34:33.930561+0000","last_active":"2024-04-01T16:34:37.605625+0000","last_peered":"2024-04-01T16:34:37.605625+0000","last_clean":"2024-04-01T16:34:37.605625+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T16:34:37.605625+0000","last_undegraded":"2024-04-01T16:34:37.605625+0000","last_fullsized":"2024-04-01T16:34:37.605625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248584+0000","last_change":"2024-04-01T16:34:31.535895+0000","last_active":"2024-04-01T16:34:52.248584+0000","last_peered":"2024-04-01T16:34:52.248584+0000","last_clean":"2024-04-01T16:34:52.248584+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T16:34:52.248584+0000","last_undegraded":"2024-04-01T16:34:52.248584+0000","last_fullsized":"2024-04-01T16:34:52.248584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:36:43.780845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.247914+0000","last_change":"2024-04-01T16:34:34.068194+0000","last_active":"2024-04-01T16:34:52.247914+0000","last_peered":"2024-04-01T16:34:52.247914+0000","last_clean":"2024-04-01T16:34:52.247914+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T16:34:52.247914+0000","last_undegraded":"2024-04-01T16:34:52.247914+0000","last_fullsized":"2024-04-01T16:34:52.247914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591561+0000","last_change":"2024-04-01T16:34:31.515495+0000","last_active":"2024-04-01T16:34:37.591561+0000","last_peered":"2024-04-01T16:34:37.591561+0000","last_clean":"2024-04-01T16:34:37.591561+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T16:34:37.591561+0000","last_undegraded":"2024-04-01T16:34:37.591561+0000","last_fullsized":"2024-04-01T16:34:37.591561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:26:56.217819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.604988+0000","last_change":"2024-04-01T16:34:33.926318+0000","last_active":"2024-04-01T16:34:37.604988+0000","last_peered":"2024-04-01T16:34:37.604988+0000","last_clean":"2024-04-01T16:34:37.604988+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T16:34:37.604988+0000","last_undegraded":"2024-04-01T16:34:37.604988+0000","last_fullsized":"2024-04-01T16:34:37.604988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009730+0000","last_change":"2024-04-01T16:34:31.440349+0000","last_active":"2024-04-01T16:34:55.009730+0000","last_peered":"2024-04-01T16:34:55.009730+0000","last_clean":"2024-04-01T16:34:55.009730+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T16:34:55.009730+0000","last_undegraded":"2024-04-01T16:34:55.009730+0000","last_fullsized":"2024-04-01T16:34:55.009730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:29.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606304+0000","last_change":"2024-04-01T16:34:33.931211+0000","last_active":"2024-04-01T16:34:37.606304+0000","last_peered":"2024-04-01T16:34:37.606304+0000","last_clean":"2024-04-01T16:34:37.606304+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T16:34:37.606304+0000","last_undegraded":"2024-04-01T16:34:37.606304+0000","last_fullsized":"2024-04-01T16:34:37.606304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:15:45.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591811+0000","last_change":"2024-04-01T16:34:31.512433+0000","last_active":"2024-04-01T16:34:37.591811+0000","last_peered":"2024-04-01T16:34:37.591811+0000","last_clean":"2024-04-01T16:34:37.591811+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T16:34:37.591811+0000","last_undegraded":"2024-04-01T16:34:37.591811+0000","last_fullsized":"2024-04-01T16:34:37.591811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:16.032012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606826+0000","last_change":"2024-04-01T16:34:33.930791+0000","last_active":"2024-04-01T16:34:37.606826+0000","last_peered":"2024-04-01T16:34:37.606826+0000","last_clean":"2024-04-01T16:34:37.606826+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T16:34:37.606826+0000","last_undegraded":"2024-04-01T16:34:37.606826+0000","last_fullsized":"2024-04-01T16:34:37.606826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:53.102054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260865+0000","last_change":"2024-04-01T16:34:31.509375+0000","last_active":"2024-04-01T16:34:52.260865+0000","last_peered":"2024-04-01T16:34:52.260865+0000","last_clean":"2024-04-01T16:34:52.260865+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T16:34:52.260865+0000","last_undegraded":"2024-04-01T16:34:52.260865+0000","last_fullsized":"2024-04-01T16:34:52.260865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010186+0000","last_change":"2024-04-01T16:34:34.085219+0000","last_active":"2024-04-01T16:34:55.010186+0000","last_peered":"2024-04-01T16:34:55.010186+0000","last_clean":"2024-04-01T16:34:55.010186+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T16:34:55.010186+0000","last_undegraded":"2024-04-01T16:34:55.010186+0000","last_fullsized":"2024-04-01T16:34:55.010186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591620+0000","last_change":"2024-04-01T16:34:31.562761+0000","last_active":"2024-04-01T16:34:37.591620+0000","last_peered":"2024-04-01T16:34:37.591620+0000","last_clean":"2024-04-01T16:34:37.591620+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T16:34:37.591620+0000","last_undegraded":"2024-04-01T16:34:37.591620+0000","last_fullsized":"2024-04-01T16:34:37.591620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:23:33.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605752+0000","last_change":"2024-04-01T16:34:34.039521+0000","last_active":"2024-04-01T16:34:37.605752+0000","last_peered":"2024-04-01T16:34:37.605752+0000","last_clean":"2024-04-01T16:34:37.605752+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T16:34:37.605752+0000","last_undegraded":"2024-04-01T16:34:37.605752+0000","last_fullsized":"2024-04-01T16:34:37.605752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605216+0000","last_change":"2024-04-01T16:34:08.195697+0000","last_active":"2024-04-01T16:34:37.605216+0000","last_peered":"2024-04-01T16:34:37.605216+0000","last_clean":"2024-04-01T16:34:37.605216+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T16:34:37.605216+0000","last_undegraded":"2024-04-01T16:34:37.605216+0000","last_fullsized":"2024-04-01T16:34:37.605216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_clean_scrub_stamp":"2024-04-01T16:34:06.247737+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:05:51.067541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009900+0000","last_change":"2024-04-01T16:34:31.569697+0000","last_active":"2024-04-01T16:34:55.009900+0000","last_peered":"2024-04-01T16:34:55.009900+0000","last_clean":"2024-04-01T16:34:55.009900+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T16:34:55.009900+0000","last_undegraded":"2024-04-01T16:34:55.009900+0000","last_fullsized":"2024-04-01T16:34:55.009900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.736852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.256046+0000","last_change":"2024-04-01T16:34:34.087298+0000","last_active":"2024-04-01T16:34:52.256046+0000","last_peered":"2024-04-01T16:34:52.256046+0000","last_clean":"2024-04-01T16:34:52.256046+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T16:34:52.256046+0000","last_undegraded":"2024-04-01T16:34:52.256046+0000","last_fullsized":"2024-04-01T16:34:52.256046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.604893+0000","last_change":"2024-04-01T16:34:31.509150+0000","last_active":"2024-04-01T16:34:37.604893+0000","last_peered":"2024-04-01T16:34:37.604893+0000","last_clean":"2024-04-01T16:34:37.604893+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T16:34:37.604893+0000","last_undegraded":"2024-04-01T16:34:37.604893+0000","last_fullsized":"2024-04-01T16:34:37.604893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.049380+0000","last_change":"2024-04-01T16:34:34.068444+0000","last_active":"2024-04-01T16:34:38.049380+0000","last_peered":"2024-04-01T16:34:38.049380+0000","last_clean":"2024-04-01T16:34:38.049380+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T16:34:38.049380+0000","last_undegraded":"2024-04-01T16:34:38.049380+0000","last_fullsized":"2024-04-01T16:34:38.049380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:04.104676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.591825+0000","last_change":"2024-04-01T16:34:31.512295+0000","last_active":"2024-04-01T16:34:37.591825+0000","last_peered":"2024-04-01T16:34:37.591825+0000","last_clean":"2024-04-01T16:34:37.591825+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T16:34:37.591825+0000","last_undegraded":"2024-04-01T16:34:37.591825+0000","last_fullsized":"2024-04-01T16:34:37.591825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:35.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260344+0000","last_change":"2024-04-01T16:34:34.083194+0000","last_active":"2024-04-01T16:34:52.260344+0000","last_peered":"2024-04-01T16:34:52.260344+0000","last_clean":"2024-04-01T16:34:52.260344+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T16:34:52.260344+0000","last_undegraded":"2024-04-01T16:34:52.260344+0000","last_fullsized":"2024-04-01T16:34:52.260344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010222+0000","last_change":"2024-04-01T16:34:31.569571+0000","last_active":"2024-04-01T16:34:55.010222+0000","last_peered":"2024-04-01T16:34:55.010222+0000","last_clean":"2024-04-01T16:34:55.010222+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T16:34:55.010222+0000","last_undegraded":"2024-04-01T16:34:55.010222+0000","last_fullsized":"2024-04-01T16:34:55.010222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:10.626933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008282+0000","last_change":"2024-04-01T16:34:34.063200+0000","last_active":"2024-04-01T16:34:55.008282+0000","last_peered":"2024-04-01T16:34:55.008282+0000","last_clean":"2024-04-01T16:34:55.008282+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T16:34:55.008282+0000","last_undegraded":"2024-04-01T16:34:55.008282+0000","last_fullsized":"2024-04-01T16:34:55.008282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:18.399835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260840+0000","last_change":"2024-04-01T16:34:31.512508+0000","last_active":"2024-04-01T16:34:52.260840+0000","last_peered":"2024-04-01T16:34:52.260840+0000","last_clean":"2024-04-01T16:34:52.260840+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T16:34:52.260840+0000","last_undegraded":"2024-04-01T16:34:52.260840+0000","last_fullsized":"2024-04-01T16:34:52.260840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050992+0000","last_change":"2024-04-01T16:34:34.084970+0000","last_active":"2024-04-01T16:34:38.050992+0000","last_peered":"2024-04-01T16:34:38.050992+0000","last_clean":"2024-04-01T16:34:38.050992+0000","last_became_active":"2024-04-01T16:34:34.084105+0000","last_became_peered":"2024-04-01T16:34:34.084105+0000","last_unstale":"2024-04-01T16:34:38.050992+0000","last_undegraded":"2024-04-01T16:34:38.050992+0000","last_fullsized":"2024-04-01T16:34:38.050992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606520+0000","last_change":"2024-04-01T16:34:31.426647+0000","last_active":"2024-04-01T16:34:37.606520+0000","last_peered":"2024-04-01T16:34:37.606520+0000","last_clean":"2024-04-01T16:34:37.606520+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T16:34:37.606520+0000","last_undegraded":"2024-04-01T16:34:37.606520+0000","last_fullsized":"2024-04-01T16:34:37.606520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:36.926701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.261159+0000","last_change":"2024-04-01T16:34:34.087431+0000","last_active":"2024-04-01T16:34:52.261159+0000","last_peered":"2024-04-01T16:34:52.261159+0000","last_clean":"2024-04-01T16:34:52.261159+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T16:34:52.261159+0000","last_undegraded":"2024-04-01T16:34:52.261159+0000","last_fullsized":"2024-04-01T16:34:52.261159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.261159+0000","last_change":"2024-04-01T16:34:31.528790+0000","last_active":"2024-04-01T16:34:52.261159+0000","last_peered":"2024-04-01T16:34:52.261159+0000","last_clean":"2024-04-01T16:34:52.261159+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T16:34:52.261159+0000","last_undegraded":"2024-04-01T16:34:52.261159+0000","last_fullsized":"2024-04-01T16:34:52.261159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.256055+0000","last_change":"2024-04-01T16:34:34.085832+0000","last_active":"2024-04-01T16:34:52.256055+0000","last_peered":"2024-04-01T16:34:52.256055+0000","last_clean":"2024-04-01T16:34:52.256055+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T16:34:52.256055+0000","last_undegraded":"2024-04-01T16:34:52.256055+0000","last_fullsized":"2024-04-01T16:34:52.256055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.249322+0000","last_change":"2024-04-01T16:34:31.534057+0000","last_active":"2024-04-01T16:34:52.249322+0000","last_peered":"2024-04-01T16:34:52.249322+0000","last_clean":"2024-04-01T16:34:52.249322+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T16:34:52.249322+0000","last_undegraded":"2024-04-01T16:34:52.249322+0000","last_fullsized":"2024-04-01T16:34:52.249322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.050929+0000","last_change":"2024-04-01T16:34:34.073261+0000","last_active":"2024-04-01T16:34:38.050929+0000","last_peered":"2024-04-01T16:34:38.050929+0000","last_clean":"2024-04-01T16:34:38.050929+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T16:34:38.050929+0000","last_undegraded":"2024-04-01T16:34:38.050929+0000","last_fullsized":"2024-04-01T16:34:38.050929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:38.619969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.604865+0000","last_change":"2024-04-01T16:34:31.423531+0000","last_active":"2024-04-01T16:34:37.604865+0000","last_peered":"2024-04-01T16:34:37.604865+0000","last_clean":"2024-04-01T16:34:37.604865+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T16:34:37.604865+0000","last_undegraded":"2024-04-01T16:34:37.604865+0000","last_fullsized":"2024-04-01T16:34:37.604865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.007775+0000","last_change":"2024-04-01T16:34:34.086029+0000","last_active":"2024-04-01T16:34:55.007775+0000","last_peered":"2024-04-01T16:34:55.007775+0000","last_clean":"2024-04-01T16:34:55.007775+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T16:34:55.007775+0000","last_undegraded":"2024-04-01T16:34:55.007775+0000","last_fullsized":"2024-04-01T16:34:55.007775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260865+0000","last_change":"2024-04-01T16:34:31.509351+0000","last_active":"2024-04-01T16:34:52.260865+0000","last_peered":"2024-04-01T16:34:52.260865+0000","last_clean":"2024-04-01T16:34:52.260865+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T16:34:52.260865+0000","last_undegraded":"2024-04-01T16:34:52.260865+0000","last_fullsized":"2024-04-01T16:34:52.260865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255343+0000","last_change":"2024-04-01T16:34:34.091932+0000","last_active":"2024-04-01T16:34:52.255343+0000","last_peered":"2024-04-01T16:34:52.255343+0000","last_clean":"2024-04-01T16:34:52.255343+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T16:34:52.255343+0000","last_undegraded":"2024-04-01T16:34:52.255343+0000","last_fullsized":"2024-04-01T16:34:52.255343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:11:00.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.261137+0000","last_change":"2024-04-01T16:34:31.517513+0000","last_active":"2024-04-01T16:34:52.261137+0000","last_peered":"2024-04-01T16:34:52.261137+0000","last_clean":"2024-04-01T16:34:52.261137+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T16:34:52.261137+0000","last_undegraded":"2024-04-01T16:34:52.261137+0000","last_fullsized":"2024-04-01T16:34:52.261137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:31.608594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":2,"reported_epoch":26,"state":"peering","last_fresh":"2024-04-01T16:34:34.078887+0000","last_change":"2024-04-01T16:34:53.550415+0000","last_active":"2024-04-01T16:34:32.285854+0000","last_peered":"2024-04-01T16:34:32.285854+0000","last_clean":"2024-04-01T16:34:32.285854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T16:34:34.078887+0000","last_undegraded":"2024-04-01T16:34:34.078887+0000","last_fullsized":"2024-04-01T16:34:34.078887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605898+0000","last_change":"2024-04-01T16:34:31.444603+0000","last_active":"2024-04-01T16:34:37.605898+0000","last_peered":"2024-04-01T16:34:37.605898+0000","last_clean":"2024-04-01T16:34:37.605898+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T16:34:37.605898+0000","last_undegraded":"2024-04-01T16:34:37.605898+0000","last_fullsized":"2024-04-01T16:34:37.605898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248166+0000","last_change":"2024-04-01T16:34:34.034061+0000","last_active":"2024-04-01T16:34:52.248166+0000","last_peered":"2024-04-01T16:34:52.248166+0000","last_clean":"2024-04-01T16:34:52.248166+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T16:34:52.248166+0000","last_undegraded":"2024-04-01T16:34:52.248166+0000","last_fullsized":"2024-04-01T16:34:52.248166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051135+0000","last_change":"2024-04-01T16:34:34.035919+0000","last_active":"2024-04-01T16:34:38.051135+0000","last_peered":"2024-04-01T16:34:38.051135+0000","last_clean":"2024-04-01T16:34:38.051135+0000","last_became_active":"2024-04-01T16:34:34.035634+0000","last_became_peered":"2024-04-01T16:34:34.035634+0000","last_unstale":"2024-04-01T16:34:38.051135+0000","last_undegraded":"2024-04-01T16:34:38.051135+0000","last_fullsized":"2024-04-01T16:34:38.051135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:24:57.379837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.605565+0000","last_change":"2024-04-01T16:34:31.563882+0000","last_active":"2024-04-01T16:34:37.605565+0000","last_peered":"2024-04-01T16:34:37.605565+0000","last_clean":"2024-04-01T16:34:37.605565+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T16:34:37.605565+0000","last_undegraded":"2024-04-01T16:34:37.605565+0000","last_fullsized":"2024-04-01T16:34:37.605565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:27.209535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010099+0000","last_change":"2024-04-01T16:34:34.034904+0000","last_active":"2024-04-01T16:34:55.010099+0000","last_peered":"2024-04-01T16:34:55.010099+0000","last_clean":"2024-04-01T16:34:55.010099+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T16:34:55.010099+0000","last_undegraded":"2024-04-01T16:34:55.010099+0000","last_fullsized":"2024-04-01T16:34:55.010099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:37.606192+0000","last_change":"2024-04-01T16:34:31.530246+0000","last_active":"2024-04-01T16:34:37.606192+0000","last_peered":"2024-04-01T16:34:37.606192+0000","last_clean":"2024-04-01T16:34:37.606192+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T16:34:37.606192+0000","last_undegraded":"2024-04-01T16:34:37.606192+0000","last_fullsized":"2024-04-01T16:34:37.606192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:48.430325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.051354+0000","last_change":"2024-04-01T16:34:34.066381+0000","last_active":"2024-04-01T16:34:38.051354+0000","last_peered":"2024-04-01T16:34:38.051354+0000","last_clean":"2024-04-01T16:34:38.051354+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T16:34:38.051354+0000","last_undegraded":"2024-04-01T16:34:38.051354+0000","last_fullsized":"2024-04-01T16:34:38.051354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:10.824493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.256152+0000","last_change":"2024-04-01T16:34:31.490535+0000","last_active":"2024-04-01T16:34:52.256152+0000","last_peered":"2024-04-01T16:34:52.256152+0000","last_clean":"2024-04-01T16:34:52.256152+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T16:34:52.256152+0000","last_undegraded":"2024-04-01T16:34:52.256152+0000","last_fullsized":"2024-04-01T16:34:52.256152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:24.709969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255831+0000","last_change":"2024-04-01T16:34:34.087097+0000","last_active":"2024-04-01T16:34:52.255831+0000","last_peered":"2024-04-01T16:34:52.255831+0000","last_clean":"2024-04-01T16:34:52.255831+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T16:34:52.255831+0000","last_undegraded":"2024-04-01T16:34:52.255831+0000","last_fullsized":"2024-04-01T16:34:52.255831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:17:48.287828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"24'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T16:34:38.052000+0000","last_change":"2024-04-01T16:34:31.420599+0000","last_active":"2024-04-01T16:34:38.052000+0000","last_peered":"2024-04-01T16:34:38.052000+0000","last_clean":"2024-04-01T16:34:38.052000+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T16:34:38.052000+0000","last_undegraded":"2024-04-01T16:34:38.052000+0000","last_fullsized":"2024-04-01T16:34:38.052000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":685650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":94700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":685706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":106980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":107016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":101001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T16:34:57.637 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T16:34:57.886 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.886+0000 7f380cc00640 1 Processor -- start 2024-04-01T16:34:57.886 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.886+0000 7f380cc00640 1 -- start start 2024-04-01T16:34:57.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.887+0000 7f380cc00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f38080c6d50 0x7f3808071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:57.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.887+0000 7f380cc00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3808072570 con 0x7f3808154a60 2024-04-01T16:34:57.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.887+0000 7f380cc00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38080c2080 con 0x7f3808072aa0 2024-04-01T16:34:57.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.887+0000 7f380cc00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f38080c2360 con 0x7f38080c6d50 2024-04-01T16:34:57.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.888+0000 7f37ffe00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f38080c6d50 0x7f3808071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:57.889 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.889+0000 7f3806800640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f3808072aa0 0x7f380806dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:45496/0 (socket says 172.21.15.163:45496) 2024-04-01T16:34:57.889 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.889+0000 7f3806800640 1 -- 172.21.15.163:0/2760503892 learned_addr learned my addr 172.21.15.163:0/2760503892 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:57.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.894+0000 7f37ffe00640 1 -- 172.21.15.163:0/2760503892 >> v1:172.21.15.189:6789/0 conn(0x7f3808072aa0 legacy=0x7f380806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:57.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.894+0000 7f37ffe00640 1 -- 172.21.15.163:0/2760503892 >> v1:172.21.15.163:6789/0 conn(0x7f3808154a60 legacy=0x7f3808073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:57.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.894+0000 7f37ffe00640 1 -- 172.21.15.163:0/2760503892 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38080c2640 con 0x7f38080c6d50 2024-04-01T16:34:57.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.899+0000 7f37ffe00640 1 --2- 172.21.15.163:0/2760503892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38080c6d50 0x7f3808071ee0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097a0 tx=0x7f37f002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abd4a0a979c6bdb server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:57.905 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.905+0000 7f3805400640 1 -- 172.21.15.163:0/2760503892 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f002f810 con 0x7f38080c6d50 2024-04-01T16:34:57.905 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.905+0000 7f3805400640 1 -- 172.21.15.163:0/2760503892 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f002f9b0 con 0x7f38080c6d50 2024-04-01T16:34:57.905 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.905+0000 7f3805400640 1 -- 172.21.15.163:0/2760503892 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f002fd80 con 0x7f38080c6d50 2024-04-01T16:34:57.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.906+0000 7f380cc00640 1 -- 172.21.15.163:0/2760503892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38080c6d50 msgr2=0x7f3808071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:57.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.906+0000 7f380cc00640 1 --2- 172.21.15.163:0/2760503892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38080c6d50 0x7f3808071ee0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097a0 tx=0x7f37f002b9f0 comp rx=0 tx=0).stop 2024-04-01T16:34:57.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.906+0000 7f380cc00640 1 -- 172.21.15.163:0/2760503892 shutdown_connections 2024-04-01T16:34:57.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.906+0000 7f380cc00640 1 --2- 172.21.15.163:0/2760503892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38080c6d50 0x7f3808071ee0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:57.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.906+0000 7f380cc00640 1 -- 172.21.15.163:0/2760503892 >> 172.21.15.163:0/2760503892 conn(0x7f38080cbe20 msgr2=0x7f38080cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:57.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.906+0000 7f380cc00640 1 -- 172.21.15.163:0/2760503892 shutdown_connections 2024-04-01T16:34:57.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.906+0000 7f380cc00640 1 -- 172.21.15.163:0/2760503892 wait complete. 2024-04-01T16:34:57.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.909+0000 7f380cc00640 1 Processor -- start 2024-04-01T16:34:57.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.909+0000 7f380cc00640 1 -- start start 2024-04-01T16:34:57.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.910+0000 7f380cc00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3808072aa0 0x7f3808146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:57.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.910+0000 7f380cc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38080c6d50 0x7f38081f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:57.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.910+0000 7f380cc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3808154a60 0x7f38081e6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:57.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.910+0000 7f380cc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3808073920 con 0x7f3808154a60 2024-04-01T16:34:57.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.910+0000 7f380cc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38080c1d80 con 0x7f38080c6d50 2024-04-01T16:34:57.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.910+0000 7f380cc00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3808073aa0 con 0x7f3808072aa0 2024-04-01T16:34:57.912 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.912+0000 7f3806800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3808154a60 0x7f38081e6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:57.912 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.912+0000 7f3806800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3808154a60 0x7f38081e6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50702/0 (socket says 172.21.15.163:50702) 2024-04-01T16:34:57.912 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.912+0000 7f3806800640 1 -- 172.21.15.163:0/2035041015 learned_addr learned my addr 172.21.15.163:0/2035041015 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:57.912 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.912+0000 7f3805e00640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3808072aa0 0x7f3808146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:57.912 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.912+0000 7f37ffe00640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38080c6d50 0x7f38081f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:57.916 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.916+0000 7f3806800640 1 -- 172.21.15.163:0/2035041015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3808072aa0 msgr2=0x7f3808146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:57.916 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.916+0000 7f3806800640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3808072aa0 0x7f3808146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:57.916 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.916+0000 7f3806800640 1 -- 172.21.15.163:0/2035041015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38080c6d50 msgr2=0x7f38081f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:57.917 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.916+0000 7f3806800640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38080c6d50 0x7f38081f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:57.917 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.916+0000 7f3806800640 1 -- 172.21.15.163:0/2035041015 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38081f0800 con 0x7f3808154a60 2024-04-01T16:34:57.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.919+0000 7f3806800640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3808154a60 0x7f38081e6500 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f380000cbf0 tx=0x7f380000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:57.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.925+0000 7f37fe000640 1 -- 172.21.15.163:0/2035041015 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3800017070 con 0x7f3808154a60 2024-04-01T16:34:57.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.925+0000 7f37fe000640 1 -- 172.21.15.163:0/2035041015 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f380000ad40 con 0x7f3808154a60 2024-04-01T16:34:57.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.925+0000 7f37fe000640 1 -- 172.21.15.163:0/2035041015 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3800012600 con 0x7f3808154a60 2024-04-01T16:34:57.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.925+0000 7f380cc00640 1 -- 172.21.15.163:0/2035041015 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38081f4230 con 0x7f3808154a60 2024-04-01T16:34:57.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.925+0000 7f380cc00640 1 -- 172.21.15.163:0/2035041015 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38081f47f0 con 0x7f3808154a60 2024-04-01T16:34:57.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:57.925+0000 7f380cc00640 1 -- 172.21.15.163:0/2035041015 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38080756d0 con 0x7f3808154a60 2024-04-01T16:34:58.200 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.200+0000 7f37fe000640 1 -- 172.21.15.163:0/2035041015 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f380001a070 con 0x7f3808154a60 2024-04-01T16:34:58.202 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.202+0000 7f37fe000640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f37e406c970 0x7f37e406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:58.203 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.203+0000 7f3805e00640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f37e406c970 0x7f37e406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:58.204 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.204+0000 7f3805e00640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f37e406c970 0x7f37e406ee30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f37f80016e0 tx=0x7f37f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:58.217 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.216+0000 7f37fe000640 1 -- 172.21.15.163:0/2035041015 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f3800057b60 con 0x7f3808154a60 2024-04-01T16:34:58.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.217+0000 7f37fe000640 1 -- 172.21.15.163:0/2035041015 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3800059ac0 con 0x7f3808154a60 2024-04-01T16:34:58.423 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.422+0000 7f380cc00640 1 -- 172.21.15.163:0/2035041015 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3808072880 con 0x7f37e406c970 2024-04-01T16:34:58.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.441+0000 7f37fe000640 1 -- 172.21.15.163:0/2035041015 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251817 (secure 0 0 0) 0x7f3808072880 con 0x7f37e406c970 2024-04-01T16:34:58.446 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:58.447 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T16:34:58.448 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.448+0000 7f380cc00640 1 -- 172.21.15.163:0/2035041015 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f37e406c970 msgr2=0x7f37e406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:58.448 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.448+0000 7f380cc00640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f37e406c970 0x7f37e406ee30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f37f80016e0 tx=0x7f37f8009040 comp rx=0 tx=0).stop 2024-04-01T16:34:58.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.448+0000 7f380cc00640 1 -- 172.21.15.163:0/2035041015 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3808154a60 msgr2=0x7f38081e6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:58.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.448+0000 7f380cc00640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3808154a60 0x7f38081e6500 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f380000cbf0 tx=0x7f380000a430 comp rx=0 tx=0).stop 2024-04-01T16:34:58.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.448+0000 7f380cc00640 1 -- 172.21.15.163:0/2035041015 shutdown_connections 2024-04-01T16:34:58.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.448+0000 7f380cc00640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f37e406c970 0x7f37e406ee30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:58.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.448+0000 7f380cc00640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3808154a60 0x7f38081e6500 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:58.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.448+0000 7f380cc00640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38080c6d50 0x7f38081f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:58.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.448+0000 7f380cc00640 1 --2- 172.21.15.163:0/2035041015 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3808072aa0 0x7f3808146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:58.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.448+0000 7f380cc00640 1 -- 172.21.15.163:0/2035041015 >> 172.21.15.163:0/2035041015 conn(0x7f38080cbe20 msgr2=0x7f380814a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:58.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.448+0000 7f380cc00640 1 -- 172.21.15.163:0/2035041015 shutdown_connections 2024-04-01T16:34:58.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.448+0000 7f380cc00640 1 -- 172.21.15.163:0/2035041015 wait complete. 2024-04-01T16:34:58.469 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-01T16:34:57.791633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219556,"kb_used_data":3396,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755164,"statfs":{"total":773094113280,"available":772869287936,"internally_reserved":0,"allocated":3477504,"data_stored":2022529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002630"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543600+0000","last_change":"2024-04-01T16:34:34.033508+0000","last_active":"2024-04-01T16:34:54.543600+0000","last_peered":"2024-04-01T16:34:54.543600+0000","last_clean":"2024-04-01T16:34:54.543600+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T16:34:54.543600+0000","last_undegraded":"2024-04-01T16:34:54.543600+0000","last_fullsized":"2024-04-01T16:34:54.543600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.261033+0000","last_change":"2024-04-01T16:34:34.065375+0000","last_active":"2024-04-01T16:34:52.261033+0000","last_peered":"2024-04-01T16:34:52.261033+0000","last_clean":"2024-04-01T16:34:52.261033+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T16:34:52.261033+0000","last_undegraded":"2024-04-01T16:34:52.261033+0000","last_fullsized":"2024-04-01T16:34:52.261033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002160+0000","last_change":"2024-04-01T16:34:34.084618+0000","last_active":"2024-04-01T16:34:55.002160+0000","last_peered":"2024-04-01T16:34:55.002160+0000","last_clean":"2024-04-01T16:34:55.002160+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T16:34:55.002160+0000","last_undegraded":"2024-04-01T16:34:55.002160+0000","last_fullsized":"2024-04-01T16:34:55.002160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:43.530081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010013+0000","last_change":"2024-04-01T16:34:34.088694+0000","last_active":"2024-04-01T16:34:55.010013+0000","last_peered":"2024-04-01T16:34:55.010013+0000","last_clean":"2024-04-01T16:34:55.010013+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T16:34:55.010013+0000","last_undegraded":"2024-04-01T16:34:55.010013+0000","last_fullsized":"2024-04-01T16:34:55.010013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542768+0000","last_change":"2024-04-01T16:34:34.085765+0000","last_active":"2024-04-01T16:34:54.542768+0000","last_peered":"2024-04-01T16:34:54.542768+0000","last_clean":"2024-04-01T16:34:54.542768+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T16:34:54.542768+0000","last_undegraded":"2024-04-01T16:34:54.542768+0000","last_fullsized":"2024-04-01T16:34:54.542768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009741+0000","last_change":"2024-04-01T16:34:34.066150+0000","last_active":"2024-04-01T16:34:55.009741+0000","last_peered":"2024-04-01T16:34:55.009741+0000","last_clean":"2024-04-01T16:34:55.009741+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T16:34:55.009741+0000","last_undegraded":"2024-04-01T16:34:55.009741+0000","last_fullsized":"2024-04-01T16:34:55.009741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:08:56.651785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542643+0000","last_change":"2024-04-01T16:34:34.072924+0000","last_active":"2024-04-01T16:34:54.542643+0000","last_peered":"2024-04-01T16:34:54.542643+0000","last_clean":"2024-04-01T16:34:54.542643+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T16:34:54.542643+0000","last_undegraded":"2024-04-01T16:34:54.542643+0000","last_fullsized":"2024-04-01T16:34:54.542643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255225+0000","last_change":"2024-04-01T16:34:34.088361+0000","last_active":"2024-04-01T16:34:52.255225+0000","last_peered":"2024-04-01T16:34:52.255225+0000","last_clean":"2024-04-01T16:34:52.255225+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T16:34:52.255225+0000","last_undegraded":"2024-04-01T16:34:52.255225+0000","last_fullsized":"2024-04-01T16:34:52.255225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543787+0000","last_change":"2024-04-01T16:34:34.038534+0000","last_active":"2024-04-01T16:34:54.543787+0000","last_peered":"2024-04-01T16:34:54.543787+0000","last_clean":"2024-04-01T16:34:54.543787+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T16:34:54.543787+0000","last_undegraded":"2024-04-01T16:34:54.543787+0000","last_fullsized":"2024-04-01T16:34:54.543787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:54.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248629+0000","last_change":"2024-04-01T16:34:34.040513+0000","last_active":"2024-04-01T16:34:52.248629+0000","last_peered":"2024-04-01T16:34:52.248629+0000","last_clean":"2024-04-01T16:34:52.248629+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T16:34:52.248629+0000","last_undegraded":"2024-04-01T16:34:52.248629+0000","last_fullsized":"2024-04-01T16:34:52.248629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248396+0000","last_change":"2024-04-01T16:34:34.038167+0000","last_active":"2024-04-01T16:34:52.248396+0000","last_peered":"2024-04-01T16:34:52.248396+0000","last_clean":"2024-04-01T16:34:52.248396+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T16:34:52.248396+0000","last_undegraded":"2024-04-01T16:34:52.248396+0000","last_fullsized":"2024-04-01T16:34:52.248396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008124+0000","last_change":"2024-04-01T16:34:34.035177+0000","last_active":"2024-04-01T16:34:55.008124+0000","last_peered":"2024-04-01T16:34:55.008124+0000","last_clean":"2024-04-01T16:34:55.008124+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T16:34:55.008124+0000","last_undegraded":"2024-04-01T16:34:55.008124+0000","last_fullsized":"2024-04-01T16:34:55.008124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:37.711846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255564+0000","last_change":"2024-04-01T16:34:34.086031+0000","last_active":"2024-04-01T16:34:52.255564+0000","last_peered":"2024-04-01T16:34:52.255564+0000","last_clean":"2024-04-01T16:34:52.255564+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T16:34:52.255564+0000","last_undegraded":"2024-04-01T16:34:52.255564+0000","last_fullsized":"2024-04-01T16:34:52.255564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.001512+0000","last_change":"2024-04-01T16:34:34.071535+0000","last_active":"2024-04-01T16:34:55.001512+0000","last_peered":"2024-04-01T16:34:55.001512+0000","last_clean":"2024-04-01T16:34:55.001512+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T16:34:55.001512+0000","last_undegraded":"2024-04-01T16:34:55.001512+0000","last_fullsized":"2024-04-01T16:34:55.001512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:45.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260608+0000","last_change":"2024-04-01T16:34:33.904701+0000","last_active":"2024-04-01T16:34:52.260608+0000","last_peered":"2024-04-01T16:34:52.260608+0000","last_clean":"2024-04-01T16:34:52.260608+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T16:34:52.260608+0000","last_undegraded":"2024-04-01T16:34:52.260608+0000","last_fullsized":"2024-04-01T16:34:52.260608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009278+0000","last_change":"2024-04-01T16:34:34.064695+0000","last_active":"2024-04-01T16:34:55.009278+0000","last_peered":"2024-04-01T16:34:55.009278+0000","last_clean":"2024-04-01T16:34:55.009278+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T16:34:55.009278+0000","last_undegraded":"2024-04-01T16:34:55.009278+0000","last_fullsized":"2024-04-01T16:34:55.009278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.798148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010268+0000","last_change":"2024-04-01T16:34:34.032994+0000","last_active":"2024-04-01T16:34:55.010268+0000","last_peered":"2024-04-01T16:34:55.010268+0000","last_clean":"2024-04-01T16:34:55.010268+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T16:34:55.010268+0000","last_undegraded":"2024-04-01T16:34:55.010268+0000","last_fullsized":"2024-04-01T16:34:55.010268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504087+0000","last_change":"2024-04-01T16:34:34.082238+0000","last_active":"2024-04-01T16:34:54.504087+0000","last_peered":"2024-04-01T16:34:54.504087+0000","last_clean":"2024-04-01T16:34:54.504087+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T16:34:54.504087+0000","last_undegraded":"2024-04-01T16:34:54.504087+0000","last_fullsized":"2024-04-01T16:34:54.504087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543579+0000","last_change":"2024-04-01T16:34:34.083056+0000","last_active":"2024-04-01T16:34:54.543579+0000","last_peered":"2024-04-01T16:34:54.543579+0000","last_clean":"2024-04-01T16:34:54.543579+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T16:34:54.543579+0000","last_undegraded":"2024-04-01T16:34:54.543579+0000","last_fullsized":"2024-04-01T16:34:54.543579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248422+0000","last_change":"2024-04-01T16:34:34.034017+0000","last_active":"2024-04-01T16:34:52.248422+0000","last_peered":"2024-04-01T16:34:52.248422+0000","last_clean":"2024-04-01T16:34:52.248422+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T16:34:52.248422+0000","last_undegraded":"2024-04-01T16:34:52.248422+0000","last_fullsized":"2024-04-01T16:34:52.248422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:33.976417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002286+0000","last_change":"2024-04-01T16:34:34.068541+0000","last_active":"2024-04-01T16:34:55.002286+0000","last_peered":"2024-04-01T16:34:55.002286+0000","last_clean":"2024-04-01T16:34:55.002286+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T16:34:55.002286+0000","last_undegraded":"2024-04-01T16:34:55.002286+0000","last_fullsized":"2024-04-01T16:34:55.002286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:29.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009827+0000","last_change":"2024-04-01T16:34:34.031774+0000","last_active":"2024-04-01T16:34:55.009827+0000","last_peered":"2024-04-01T16:34:55.009827+0000","last_clean":"2024-04-01T16:34:55.009827+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T16:34:55.009827+0000","last_undegraded":"2024-04-01T16:34:55.009827+0000","last_fullsized":"2024-04-01T16:34:55.009827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:39.294525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255352+0000","last_change":"2024-04-01T16:34:34.090324+0000","last_active":"2024-04-01T16:34:52.255352+0000","last_peered":"2024-04-01T16:34:52.255352+0000","last_clean":"2024-04-01T16:34:52.255352+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T16:34:52.255352+0000","last_undegraded":"2024-04-01T16:34:52.255352+0000","last_fullsized":"2024-04-01T16:34:52.255352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:55:40.168021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008960+0000","last_change":"2024-04-01T16:34:34.083544+0000","last_active":"2024-04-01T16:34:55.008960+0000","last_peered":"2024-04-01T16:34:55.008960+0000","last_clean":"2024-04-01T16:34:55.008960+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T16:34:55.008960+0000","last_undegraded":"2024-04-01T16:34:55.008960+0000","last_fullsized":"2024-04-01T16:34:55.008960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255904+0000","last_change":"2024-04-01T16:34:34.090721+0000","last_active":"2024-04-01T16:34:52.255904+0000","last_peered":"2024-04-01T16:34:52.255904+0000","last_clean":"2024-04-01T16:34:52.255904+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T16:34:52.255904+0000","last_undegraded":"2024-04-01T16:34:52.255904+0000","last_fullsized":"2024-04-01T16:34:52.255904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-01T16:34:37.629903+0000","last_change":"2024-04-01T16:34:52.248200+0000","last_active":"2024-04-01T16:34:52.248200+0000","last_peered":"2024-04-01T16:34:37.629903+0000","last_clean":"2024-04-01T16:34:37.629903+0000","last_became_active":"2024-04-01T16:34:34.032529+0000","last_became_peered":"2024-04-01T16:34:34.032529+0000","last_unstale":"2024-04-01T16:34:37.629903+0000","last_undegraded":"2024-04-01T16:34:37.629903+0000","last_fullsized":"2024-04-01T16:34:37.629903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260654+0000","last_change":"2024-04-01T16:34:34.091911+0000","last_active":"2024-04-01T16:34:52.260654+0000","last_peered":"2024-04-01T16:34:52.260654+0000","last_clean":"2024-04-01T16:34:52.260654+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T16:34:52.260654+0000","last_undegraded":"2024-04-01T16:34:52.260654+0000","last_fullsized":"2024-04-01T16:34:52.260654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255582+0000","last_change":"2024-04-01T16:34:34.091540+0000","last_active":"2024-04-01T16:34:52.255582+0000","last_peered":"2024-04-01T16:34:52.255582+0000","last_clean":"2024-04-01T16:34:52.255582+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T16:34:52.255582+0000","last_undegraded":"2024-04-01T16:34:52.255582+0000","last_fullsized":"2024-04-01T16:34:52.255582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002349+0000","last_change":"2024-04-01T16:34:34.087634+0000","last_active":"2024-04-01T16:34:55.002349+0000","last_peered":"2024-04-01T16:34:55.002349+0000","last_clean":"2024-04-01T16:34:55.002349+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T16:34:55.002349+0000","last_undegraded":"2024-04-01T16:34:55.002349+0000","last_fullsized":"2024-04-01T16:34:55.002349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:12.994756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009994+0000","last_change":"2024-04-01T16:34:34.084026+0000","last_active":"2024-04-01T16:34:55.009994+0000","last_peered":"2024-04-01T16:34:55.009994+0000","last_clean":"2024-04-01T16:34:55.009994+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T16:34:55.009994+0000","last_undegraded":"2024-04-01T16:34:55.009994+0000","last_fullsized":"2024-04-01T16:34:55.009994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503763+0000","last_change":"2024-04-01T16:34:34.088300+0000","last_active":"2024-04-01T16:34:54.503763+0000","last_peered":"2024-04-01T16:34:54.503763+0000","last_clean":"2024-04-01T16:34:54.503763+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T16:34:54.503763+0000","last_undegraded":"2024-04-01T16:34:54.503763+0000","last_fullsized":"2024-04-01T16:34:54.503763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.247856+0000","last_change":"2024-04-01T16:34:34.068348+0000","last_active":"2024-04-01T16:34:52.247856+0000","last_peered":"2024-04-01T16:34:52.247856+0000","last_clean":"2024-04-01T16:34:52.247856+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T16:34:52.247856+0000","last_undegraded":"2024-04-01T16:34:52.247856+0000","last_fullsized":"2024-04-01T16:34:52.247856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010349+0000","last_change":"2024-04-01T16:34:33.901019+0000","last_active":"2024-04-01T16:34:55.010349+0000","last_peered":"2024-04-01T16:34:55.010349+0000","last_clean":"2024-04-01T16:34:55.010349+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T16:34:55.010349+0000","last_undegraded":"2024-04-01T16:34:55.010349+0000","last_fullsized":"2024-04-01T16:34:55.010349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:08:37.254438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255720+0000","last_change":"2024-04-01T16:34:31.489434+0000","last_active":"2024-04-01T16:34:52.255720+0000","last_peered":"2024-04-01T16:34:52.255720+0000","last_clean":"2024-04-01T16:34:52.255720+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T16:34:52.255720+0000","last_undegraded":"2024-04-01T16:34:52.255720+0000","last_fullsized":"2024-04-01T16:34:52.255720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002555+0000","last_change":"2024-04-01T16:34:34.065342+0000","last_active":"2024-04-01T16:34:55.002555+0000","last_peered":"2024-04-01T16:34:55.002555+0000","last_clean":"2024-04-01T16:34:55.002555+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T16:34:55.002555+0000","last_undegraded":"2024-04-01T16:34:55.002555+0000","last_fullsized":"2024-04-01T16:34:55.002555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:56.911106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248428+0000","last_change":"2024-04-01T16:34:31.530201+0000","last_active":"2024-04-01T16:34:52.248428+0000","last_peered":"2024-04-01T16:34:52.248428+0000","last_clean":"2024-04-01T16:34:52.248428+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T16:34:52.248428+0000","last_undegraded":"2024-04-01T16:34:52.248428+0000","last_fullsized":"2024-04-01T16:34:52.248428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255510+0000","last_change":"2024-04-01T16:34:31.528238+0000","last_active":"2024-04-01T16:34:52.255510+0000","last_peered":"2024-04-01T16:34:52.255510+0000","last_clean":"2024-04-01T16:34:52.255510+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T16:34:52.255510+0000","last_undegraded":"2024-04-01T16:34:52.255510+0000","last_fullsized":"2024-04-01T16:34:52.255510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255256+0000","last_change":"2024-04-01T16:34:34.091302+0000","last_active":"2024-04-01T16:34:52.255256+0000","last_peered":"2024-04-01T16:34:52.255256+0000","last_clean":"2024-04-01T16:34:52.255256+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T16:34:52.255256+0000","last_undegraded":"2024-04-01T16:34:52.255256+0000","last_fullsized":"2024-04-01T16:34:52.255256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009229+0000","last_change":"2024-04-01T16:34:31.567946+0000","last_active":"2024-04-01T16:34:55.009229+0000","last_peered":"2024-04-01T16:34:55.009229+0000","last_clean":"2024-04-01T16:34:55.009229+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T16:34:55.009229+0000","last_undegraded":"2024-04-01T16:34:55.009229+0000","last_fullsized":"2024-04-01T16:34:55.009229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260464+0000","last_change":"2024-04-01T16:34:34.088894+0000","last_active":"2024-04-01T16:34:52.260464+0000","last_peered":"2024-04-01T16:34:52.260464+0000","last_clean":"2024-04-01T16:34:52.260464+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T16:34:52.260464+0000","last_undegraded":"2024-04-01T16:34:52.260464+0000","last_fullsized":"2024-04-01T16:34:52.260464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.249320+0000","last_change":"2024-04-01T16:34:31.566997+0000","last_active":"2024-04-01T16:34:52.249320+0000","last_peered":"2024-04-01T16:34:52.249320+0000","last_clean":"2024-04-01T16:34:52.249320+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T16:34:52.249320+0000","last_undegraded":"2024-04-01T16:34:52.249320+0000","last_fullsized":"2024-04-01T16:34:52.249320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010465+0000","last_change":"2024-04-01T16:34:34.030831+0000","last_active":"2024-04-01T16:34:55.010465+0000","last_peered":"2024-04-01T16:34:55.010465+0000","last_clean":"2024-04-01T16:34:55.010465+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T16:34:55.010465+0000","last_undegraded":"2024-04-01T16:34:55.010465+0000","last_fullsized":"2024-04-01T16:34:55.010465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010568+0000","last_change":"2024-04-01T16:34:31.569927+0000","last_active":"2024-04-01T16:34:55.010568+0000","last_peered":"2024-04-01T16:34:55.010568+0000","last_clean":"2024-04-01T16:34:55.010568+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T16:34:55.010568+0000","last_undegraded":"2024-04-01T16:34:55.010568+0000","last_fullsized":"2024-04-01T16:34:55.010568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:41.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002879+0000","last_change":"2024-04-01T16:34:34.068959+0000","last_active":"2024-04-01T16:34:55.002879+0000","last_peered":"2024-04-01T16:34:55.002879+0000","last_clean":"2024-04-01T16:34:55.002879+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T16:34:55.002879+0000","last_undegraded":"2024-04-01T16:34:55.002879+0000","last_fullsized":"2024-04-01T16:34:55.002879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:58:57.685708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260693+0000","last_change":"2024-04-01T16:34:31.562792+0000","last_active":"2024-04-01T16:34:52.260693+0000","last_peered":"2024-04-01T16:34:52.260693+0000","last_clean":"2024-04-01T16:34:52.260693+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T16:34:52.260693+0000","last_undegraded":"2024-04-01T16:34:52.260693+0000","last_fullsized":"2024-04-01T16:34:52.260693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:55.684911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008845+0000","last_change":"2024-04-01T16:34:33.916652+0000","last_active":"2024-04-01T16:34:55.008845+0000","last_peered":"2024-04-01T16:34:55.008845+0000","last_clean":"2024-04-01T16:34:55.008845+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T16:34:55.008845+0000","last_undegraded":"2024-04-01T16:34:55.008845+0000","last_fullsized":"2024-04-01T16:34:55.008845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'6","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248702+0000","last_change":"2024-04-01T16:34:31.531366+0000","last_active":"2024-04-01T16:34:52.248702+0000","last_peered":"2024-04-01T16:34:52.248702+0000","last_clean":"2024-04-01T16:34:52.248702+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T16:34:52.248702+0000","last_undegraded":"2024-04-01T16:34:52.248702+0000","last_fullsized":"2024-04-01T16:34:52.248702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543193+0000","last_change":"2024-04-01T16:34:34.085449+0000","last_active":"2024-04-01T16:34:54.543193+0000","last_peered":"2024-04-01T16:34:54.543193+0000","last_clean":"2024-04-01T16:34:54.543193+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T16:34:54.543193+0000","last_undegraded":"2024-04-01T16:34:54.543193+0000","last_fullsized":"2024-04-01T16:34:54.543193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002803+0000","last_change":"2024-04-01T16:34:31.444458+0000","last_active":"2024-04-01T16:34:55.002803+0000","last_peered":"2024-04-01T16:34:55.002803+0000","last_clean":"2024-04-01T16:34:55.002803+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T16:34:55.002803+0000","last_undegraded":"2024-04-01T16:34:55.002803+0000","last_fullsized":"2024-04-01T16:34:55.002803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.001912+0000","last_change":"2024-04-01T16:34:34.071521+0000","last_active":"2024-04-01T16:34:55.001912+0000","last_peered":"2024-04-01T16:34:55.001912+0000","last_clean":"2024-04-01T16:34:55.001912+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T16:34:55.001912+0000","last_undegraded":"2024-04-01T16:34:55.001912+0000","last_fullsized":"2024-04-01T16:34:55.001912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:36:13.618956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010073+0000","last_change":"2024-04-01T16:34:31.566202+0000","last_active":"2024-04-01T16:34:55.010073+0000","last_peered":"2024-04-01T16:34:55.010073+0000","last_clean":"2024-04-01T16:34:55.010073+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T16:34:55.010073+0000","last_undegraded":"2024-04-01T16:34:55.010073+0000","last_fullsized":"2024-04-01T16:34:55.010073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:54.543283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543363+0000","last_change":"2024-04-01T16:34:33.930561+0000","last_active":"2024-04-01T16:34:54.543363+0000","last_peered":"2024-04-01T16:34:54.543363+0000","last_clean":"2024-04-01T16:34:54.543363+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T16:34:54.543363+0000","last_undegraded":"2024-04-01T16:34:54.543363+0000","last_fullsized":"2024-04-01T16:34:54.543363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248584+0000","last_change":"2024-04-01T16:34:31.535895+0000","last_active":"2024-04-01T16:34:52.248584+0000","last_peered":"2024-04-01T16:34:52.248584+0000","last_clean":"2024-04-01T16:34:52.248584+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T16:34:52.248584+0000","last_undegraded":"2024-04-01T16:34:52.248584+0000","last_fullsized":"2024-04-01T16:34:52.248584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:36:43.780845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.247914+0000","last_change":"2024-04-01T16:34:34.068194+0000","last_active":"2024-04-01T16:34:52.247914+0000","last_peered":"2024-04-01T16:34:52.247914+0000","last_clean":"2024-04-01T16:34:52.247914+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T16:34:52.247914+0000","last_undegraded":"2024-04-01T16:34:52.247914+0000","last_fullsized":"2024-04-01T16:34:52.247914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503806+0000","last_change":"2024-04-01T16:34:31.515495+0000","last_active":"2024-04-01T16:34:54.503806+0000","last_peered":"2024-04-01T16:34:54.503806+0000","last_clean":"2024-04-01T16:34:54.503806+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T16:34:54.503806+0000","last_undegraded":"2024-04-01T16:34:54.503806+0000","last_fullsized":"2024-04-01T16:34:54.503806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:26:56.217819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542753+0000","last_change":"2024-04-01T16:34:33.926318+0000","last_active":"2024-04-01T16:34:54.542753+0000","last_peered":"2024-04-01T16:34:54.542753+0000","last_clean":"2024-04-01T16:34:54.542753+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T16:34:54.542753+0000","last_undegraded":"2024-04-01T16:34:54.542753+0000","last_fullsized":"2024-04-01T16:34:54.542753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009730+0000","last_change":"2024-04-01T16:34:31.440349+0000","last_active":"2024-04-01T16:34:55.009730+0000","last_peered":"2024-04-01T16:34:55.009730+0000","last_clean":"2024-04-01T16:34:55.009730+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T16:34:55.009730+0000","last_undegraded":"2024-04-01T16:34:55.009730+0000","last_fullsized":"2024-04-01T16:34:55.009730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:29.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542735+0000","last_change":"2024-04-01T16:34:33.931211+0000","last_active":"2024-04-01T16:34:54.542735+0000","last_peered":"2024-04-01T16:34:54.542735+0000","last_clean":"2024-04-01T16:34:54.542735+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T16:34:54.542735+0000","last_undegraded":"2024-04-01T16:34:54.542735+0000","last_fullsized":"2024-04-01T16:34:54.542735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:15:45.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504196+0000","last_change":"2024-04-01T16:34:31.512433+0000","last_active":"2024-04-01T16:34:54.504196+0000","last_peered":"2024-04-01T16:34:54.504196+0000","last_clean":"2024-04-01T16:34:54.504196+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T16:34:54.504196+0000","last_undegraded":"2024-04-01T16:34:54.504196+0000","last_fullsized":"2024-04-01T16:34:54.504196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:16.032012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543722+0000","last_change":"2024-04-01T16:34:33.930791+0000","last_active":"2024-04-01T16:34:54.543722+0000","last_peered":"2024-04-01T16:34:54.543722+0000","last_clean":"2024-04-01T16:34:54.543722+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T16:34:54.543722+0000","last_undegraded":"2024-04-01T16:34:54.543722+0000","last_fullsized":"2024-04-01T16:34:54.543722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:53.102054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260865+0000","last_change":"2024-04-01T16:34:31.509375+0000","last_active":"2024-04-01T16:34:52.260865+0000","last_peered":"2024-04-01T16:34:52.260865+0000","last_clean":"2024-04-01T16:34:52.260865+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T16:34:52.260865+0000","last_undegraded":"2024-04-01T16:34:52.260865+0000","last_fullsized":"2024-04-01T16:34:52.260865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010186+0000","last_change":"2024-04-01T16:34:34.085219+0000","last_active":"2024-04-01T16:34:55.010186+0000","last_peered":"2024-04-01T16:34:55.010186+0000","last_clean":"2024-04-01T16:34:55.010186+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T16:34:55.010186+0000","last_undegraded":"2024-04-01T16:34:55.010186+0000","last_fullsized":"2024-04-01T16:34:55.010186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504130+0000","last_change":"2024-04-01T16:34:31.562761+0000","last_active":"2024-04-01T16:34:54.504130+0000","last_peered":"2024-04-01T16:34:54.504130+0000","last_clean":"2024-04-01T16:34:54.504130+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T16:34:54.504130+0000","last_undegraded":"2024-04-01T16:34:54.504130+0000","last_fullsized":"2024-04-01T16:34:54.504130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:23:33.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543747+0000","last_change":"2024-04-01T16:34:34.039521+0000","last_active":"2024-04-01T16:34:54.543747+0000","last_peered":"2024-04-01T16:34:54.543747+0000","last_clean":"2024-04-01T16:34:54.543747+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T16:34:54.543747+0000","last_undegraded":"2024-04-01T16:34:54.543747+0000","last_fullsized":"2024-04-01T16:34:54.543747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543415+0000","last_change":"2024-04-01T16:34:08.195697+0000","last_active":"2024-04-01T16:34:54.543415+0000","last_peered":"2024-04-01T16:34:54.543415+0000","last_clean":"2024-04-01T16:34:54.543415+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T16:34:54.543415+0000","last_undegraded":"2024-04-01T16:34:54.543415+0000","last_fullsized":"2024-04-01T16:34:54.543415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_clean_scrub_stamp":"2024-04-01T16:34:06.247737+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:05:51.067541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009900+0000","last_change":"2024-04-01T16:34:31.569697+0000","last_active":"2024-04-01T16:34:55.009900+0000","last_peered":"2024-04-01T16:34:55.009900+0000","last_clean":"2024-04-01T16:34:55.009900+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T16:34:55.009900+0000","last_undegraded":"2024-04-01T16:34:55.009900+0000","last_fullsized":"2024-04-01T16:34:55.009900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.736852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.256046+0000","last_change":"2024-04-01T16:34:34.087298+0000","last_active":"2024-04-01T16:34:52.256046+0000","last_peered":"2024-04-01T16:34:52.256046+0000","last_clean":"2024-04-01T16:34:52.256046+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T16:34:52.256046+0000","last_undegraded":"2024-04-01T16:34:52.256046+0000","last_fullsized":"2024-04-01T16:34:52.256046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542776+0000","last_change":"2024-04-01T16:34:31.509150+0000","last_active":"2024-04-01T16:34:54.542776+0000","last_peered":"2024-04-01T16:34:54.542776+0000","last_clean":"2024-04-01T16:34:54.542776+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T16:34:54.542776+0000","last_undegraded":"2024-04-01T16:34:54.542776+0000","last_fullsized":"2024-04-01T16:34:54.542776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.001494+0000","last_change":"2024-04-01T16:34:34.068444+0000","last_active":"2024-04-01T16:34:55.001494+0000","last_peered":"2024-04-01T16:34:55.001494+0000","last_clean":"2024-04-01T16:34:55.001494+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T16:34:55.001494+0000","last_undegraded":"2024-04-01T16:34:55.001494+0000","last_fullsized":"2024-04-01T16:34:55.001494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:04.104676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503955+0000","last_change":"2024-04-01T16:34:31.512295+0000","last_active":"2024-04-01T16:34:54.503955+0000","last_peered":"2024-04-01T16:34:54.503955+0000","last_clean":"2024-04-01T16:34:54.503955+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T16:34:54.503955+0000","last_undegraded":"2024-04-01T16:34:54.503955+0000","last_fullsized":"2024-04-01T16:34:54.503955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:35.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260344+0000","last_change":"2024-04-01T16:34:34.083194+0000","last_active":"2024-04-01T16:34:52.260344+0000","last_peered":"2024-04-01T16:34:52.260344+0000","last_clean":"2024-04-01T16:34:52.260344+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T16:34:52.260344+0000","last_undegraded":"2024-04-01T16:34:52.260344+0000","last_fullsized":"2024-04-01T16:34:52.260344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010222+0000","last_change":"2024-04-01T16:34:31.569571+0000","last_active":"2024-04-01T16:34:55.010222+0000","last_peered":"2024-04-01T16:34:55.010222+0000","last_clean":"2024-04-01T16:34:55.010222+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T16:34:55.010222+0000","last_undegraded":"2024-04-01T16:34:55.010222+0000","last_fullsized":"2024-04-01T16:34:55.010222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:10.626933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008282+0000","last_change":"2024-04-01T16:34:34.063200+0000","last_active":"2024-04-01T16:34:55.008282+0000","last_peered":"2024-04-01T16:34:55.008282+0000","last_clean":"2024-04-01T16:34:55.008282+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T16:34:55.008282+0000","last_undegraded":"2024-04-01T16:34:55.008282+0000","last_fullsized":"2024-04-01T16:34:55.008282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:18.399835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260840+0000","last_change":"2024-04-01T16:34:31.512508+0000","last_active":"2024-04-01T16:34:52.260840+0000","last_peered":"2024-04-01T16:34:52.260840+0000","last_clean":"2024-04-01T16:34:52.260840+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T16:34:52.260840+0000","last_undegraded":"2024-04-01T16:34:52.260840+0000","last_fullsized":"2024-04-01T16:34:52.260840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.515324+0000","last_change":"2024-04-01T16:34:54.510347+0000","last_active":"2024-04-01T16:34:54.515324+0000","last_peered":"2024-04-01T16:34:54.515324+0000","last_clean":"2024-04-01T16:34:54.515324+0000","last_became_active":"2024-04-01T16:34:54.509976+0000","last_became_peered":"2024-04-01T16:34:54.509976+0000","last_unstale":"2024-04-01T16:34:54.515324+0000","last_undegraded":"2024-04-01T16:34:54.515324+0000","last_fullsized":"2024-04-01T16:34:54.515324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:41:48.631612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543670+0000","last_change":"2024-04-01T16:34:31.426647+0000","last_active":"2024-04-01T16:34:54.543670+0000","last_peered":"2024-04-01T16:34:54.543670+0000","last_clean":"2024-04-01T16:34:54.543670+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T16:34:54.543670+0000","last_undegraded":"2024-04-01T16:34:54.543670+0000","last_fullsized":"2024-04-01T16:34:54.543670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:36.926701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.261159+0000","last_change":"2024-04-01T16:34:34.087431+0000","last_active":"2024-04-01T16:34:52.261159+0000","last_peered":"2024-04-01T16:34:52.261159+0000","last_clean":"2024-04-01T16:34:52.261159+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T16:34:52.261159+0000","last_undegraded":"2024-04-01T16:34:52.261159+0000","last_fullsized":"2024-04-01T16:34:52.261159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.261159+0000","last_change":"2024-04-01T16:34:31.528790+0000","last_active":"2024-04-01T16:34:52.261159+0000","last_peered":"2024-04-01T16:34:52.261159+0000","last_clean":"2024-04-01T16:34:52.261159+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T16:34:52.261159+0000","last_undegraded":"2024-04-01T16:34:52.261159+0000","last_fullsized":"2024-04-01T16:34:52.261159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.256055+0000","last_change":"2024-04-01T16:34:34.085832+0000","last_active":"2024-04-01T16:34:52.256055+0000","last_peered":"2024-04-01T16:34:52.256055+0000","last_clean":"2024-04-01T16:34:52.256055+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T16:34:52.256055+0000","last_undegraded":"2024-04-01T16:34:52.256055+0000","last_fullsized":"2024-04-01T16:34:52.256055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.249322+0000","last_change":"2024-04-01T16:34:31.534057+0000","last_active":"2024-04-01T16:34:52.249322+0000","last_peered":"2024-04-01T16:34:52.249322+0000","last_clean":"2024-04-01T16:34:52.249322+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T16:34:52.249322+0000","last_undegraded":"2024-04-01T16:34:52.249322+0000","last_fullsized":"2024-04-01T16:34:52.249322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002868+0000","last_change":"2024-04-01T16:34:34.073261+0000","last_active":"2024-04-01T16:34:55.002868+0000","last_peered":"2024-04-01T16:34:55.002868+0000","last_clean":"2024-04-01T16:34:55.002868+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T16:34:55.002868+0000","last_undegraded":"2024-04-01T16:34:55.002868+0000","last_fullsized":"2024-04-01T16:34:55.002868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:38.619969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542511+0000","last_change":"2024-04-01T16:34:31.423531+0000","last_active":"2024-04-01T16:34:54.542511+0000","last_peered":"2024-04-01T16:34:54.542511+0000","last_clean":"2024-04-01T16:34:54.542511+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T16:34:54.542511+0000","last_undegraded":"2024-04-01T16:34:54.542511+0000","last_fullsized":"2024-04-01T16:34:54.542511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.007775+0000","last_change":"2024-04-01T16:34:34.086029+0000","last_active":"2024-04-01T16:34:55.007775+0000","last_peered":"2024-04-01T16:34:55.007775+0000","last_clean":"2024-04-01T16:34:55.007775+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T16:34:55.007775+0000","last_undegraded":"2024-04-01T16:34:55.007775+0000","last_fullsized":"2024-04-01T16:34:55.007775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260865+0000","last_change":"2024-04-01T16:34:31.509351+0000","last_active":"2024-04-01T16:34:52.260865+0000","last_peered":"2024-04-01T16:34:52.260865+0000","last_clean":"2024-04-01T16:34:52.260865+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T16:34:52.260865+0000","last_undegraded":"2024-04-01T16:34:52.260865+0000","last_fullsized":"2024-04-01T16:34:52.260865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255343+0000","last_change":"2024-04-01T16:34:34.091932+0000","last_active":"2024-04-01T16:34:52.255343+0000","last_peered":"2024-04-01T16:34:52.255343+0000","last_clean":"2024-04-01T16:34:52.255343+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T16:34:52.255343+0000","last_undegraded":"2024-04-01T16:34:52.255343+0000","last_fullsized":"2024-04-01T16:34:52.255343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:11:00.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.261137+0000","last_change":"2024-04-01T16:34:31.517513+0000","last_active":"2024-04-01T16:34:52.261137+0000","last_peered":"2024-04-01T16:34:52.261137+0000","last_clean":"2024-04-01T16:34:52.261137+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T16:34:52.261137+0000","last_undegraded":"2024-04-01T16:34:52.261137+0000","last_fullsized":"2024-04-01T16:34:52.261137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:31.608594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":2,"reported_epoch":26,"state":"peering","last_fresh":"2024-04-01T16:34:34.078887+0000","last_change":"2024-04-01T16:34:53.550415+0000","last_active":"2024-04-01T16:34:32.285854+0000","last_peered":"2024-04-01T16:34:32.285854+0000","last_clean":"2024-04-01T16:34:32.285854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T16:34:34.078887+0000","last_undegraded":"2024-04-01T16:34:34.078887+0000","last_fullsized":"2024-04-01T16:34:34.078887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543847+0000","last_change":"2024-04-01T16:34:31.444603+0000","last_active":"2024-04-01T16:34:54.543847+0000","last_peered":"2024-04-01T16:34:54.543847+0000","last_clean":"2024-04-01T16:34:54.543847+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T16:34:54.543847+0000","last_undegraded":"2024-04-01T16:34:54.543847+0000","last_fullsized":"2024-04-01T16:34:54.543847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248166+0000","last_change":"2024-04-01T16:34:34.034061+0000","last_active":"2024-04-01T16:34:52.248166+0000","last_peered":"2024-04-01T16:34:52.248166+0000","last_clean":"2024-04-01T16:34:52.248166+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T16:34:52.248166+0000","last_undegraded":"2024-04-01T16:34:52.248166+0000","last_fullsized":"2024-04-01T16:34:52.248166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.014117+0000","last_change":"2024-04-01T16:34:55.011962+0000","last_active":"2024-04-01T16:34:55.014117+0000","last_peered":"2024-04-01T16:34:55.014117+0000","last_clean":"2024-04-01T16:34:55.014117+0000","last_became_active":"2024-04-01T16:34:55.011400+0000","last_became_peered":"2024-04-01T16:34:55.011400+0000","last_unstale":"2024-04-01T16:34:55.014117+0000","last_undegraded":"2024-04-01T16:34:55.014117+0000","last_fullsized":"2024-04-01T16:34:55.014117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:14:52.381836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543077+0000","last_change":"2024-04-01T16:34:31.563882+0000","last_active":"2024-04-01T16:34:54.543077+0000","last_peered":"2024-04-01T16:34:54.543077+0000","last_clean":"2024-04-01T16:34:54.543077+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T16:34:54.543077+0000","last_undegraded":"2024-04-01T16:34:54.543077+0000","last_fullsized":"2024-04-01T16:34:54.543077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:27.209535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010099+0000","last_change":"2024-04-01T16:34:34.034904+0000","last_active":"2024-04-01T16:34:55.010099+0000","last_peered":"2024-04-01T16:34:55.010099+0000","last_clean":"2024-04-01T16:34:55.010099+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T16:34:55.010099+0000","last_undegraded":"2024-04-01T16:34:55.010099+0000","last_fullsized":"2024-04-01T16:34:55.010099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543474+0000","last_change":"2024-04-01T16:34:31.530246+0000","last_active":"2024-04-01T16:34:54.543474+0000","last_peered":"2024-04-01T16:34:54.543474+0000","last_clean":"2024-04-01T16:34:54.543474+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T16:34:54.543474+0000","last_undegraded":"2024-04-01T16:34:54.543474+0000","last_fullsized":"2024-04-01T16:34:54.543474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:48.430325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002793+0000","last_change":"2024-04-01T16:34:34.066381+0000","last_active":"2024-04-01T16:34:55.002793+0000","last_peered":"2024-04-01T16:34:55.002793+0000","last_clean":"2024-04-01T16:34:55.002793+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T16:34:55.002793+0000","last_undegraded":"2024-04-01T16:34:55.002793+0000","last_fullsized":"2024-04-01T16:34:55.002793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:10.824493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.256152+0000","last_change":"2024-04-01T16:34:31.490535+0000","last_active":"2024-04-01T16:34:52.256152+0000","last_peered":"2024-04-01T16:34:52.256152+0000","last_clean":"2024-04-01T16:34:52.256152+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T16:34:52.256152+0000","last_undegraded":"2024-04-01T16:34:52.256152+0000","last_fullsized":"2024-04-01T16:34:52.256152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:24.709969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255831+0000","last_change":"2024-04-01T16:34:34.087097+0000","last_active":"2024-04-01T16:34:52.255831+0000","last_peered":"2024-04-01T16:34:52.255831+0000","last_clean":"2024-04-01T16:34:52.255831+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T16:34:52.255831+0000","last_undegraded":"2024-04-01T16:34:52.255831+0000","last_fullsized":"2024-04-01T16:34:52.255831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:17:48.287828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"24'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.003040+0000","last_change":"2024-04-01T16:34:31.420599+0000","last_active":"2024-04-01T16:34:55.003040+0000","last_peered":"2024-04-01T16:34:55.003040+0000","last_clean":"2024-04-01T16:34:55.003040+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T16:34:55.003040+0000","last_undegraded":"2024-04-01T16:34:55.003040+0000","last_fullsized":"2024-04-01T16:34:55.003040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":697840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":106890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":697896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":106980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":107016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":101001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T16:34:58.473 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T16:34:58.721 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.722+0000 7f32d4a00640 1 Processor -- start 2024-04-01T16:34:58.722 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.722+0000 7f32d4a00640 1 -- start start 2024-04-01T16:34:58.725 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.725+0000 7f32d4a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f32d00c3e40 0x7f32d00c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:58.725 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.725+0000 7f32d4a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d00c4810 con 0x7f32d014e0e0 2024-04-01T16:34:58.725 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.725+0000 7f32d4a00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d014e4c0 con 0x7f32d00c8570 2024-04-01T16:34:58.725 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.725+0000 7f32d4a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f32d0067280 con 0x7f32d00c3e40 2024-04-01T16:34:58.758 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.758+0000 7f32ce800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f32d00c3e40 0x7f32d00c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:58.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.761+0000 7f32ce800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f32d00c3e40 0x7f32d00c42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50718/0 (socket says 172.21.15.163:50718) 2024-04-01T16:34:58.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.761+0000 7f32ce800640 1 -- 172.21.15.163:0/917068812 learned_addr learned my addr 172.21.15.163:0/917068812 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:58.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.772+0000 7f32ce800640 1 -- 172.21.15.163:0/917068812 >> v1:172.21.15.189:6789/0 conn(0x7f32d00c8570 legacy=0x7f32d00c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:58.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.772+0000 7f32ce800640 1 -- 172.21.15.163:0/917068812 >> v1:172.21.15.163:6789/0 conn(0x7f32d014e0e0 legacy=0x7f32d0157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:34:58.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.772+0000 7f32ce800640 1 -- 172.21.15.163:0/917068812 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d00c8d00 con 0x7f32d00c3e40 2024-04-01T16:34:58.783 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.784+0000 7f32ce800640 1 --2- 172.21.15.163:0/917068812 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32d00c3e40 0x7f32d00c42d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009e50 tx=0x7f32c802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3600bb79fc5a270 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:58.803 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.803+0000 7f32cca00640 1 -- 172.21.15.163:0/917068812 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c802cb20 con 0x7f32d00c3e40 2024-04-01T16:34:58.803 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.804+0000 7f32cca00640 1 -- 172.21.15.163:0/917068812 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c802ccc0 con 0x7f32d00c3e40 2024-04-01T16:34:58.803 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.804+0000 7f32cca00640 1 -- 172.21.15.163:0/917068812 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8034610 con 0x7f32d00c3e40 2024-04-01T16:34:58.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.805+0000 7f32d4a00640 1 -- 172.21.15.163:0/917068812 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32d00c3e40 msgr2=0x7f32d00c42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:58.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.805+0000 7f32d4a00640 1 --2- 172.21.15.163:0/917068812 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32d00c3e40 0x7f32d00c42d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009e50 tx=0x7f32c802bf80 comp rx=0 tx=0).stop 2024-04-01T16:34:58.805 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.805+0000 7f32d4a00640 1 -- 172.21.15.163:0/917068812 shutdown_connections 2024-04-01T16:34:58.805 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.805+0000 7f32d4a00640 1 --2- 172.21.15.163:0/917068812 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32d00c3e40 0x7f32d00c42d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:58.805 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.805+0000 7f32d4a00640 1 -- 172.21.15.163:0/917068812 >> 172.21.15.163:0/917068812 conn(0x7f32d00c8f80 msgr2=0x7f32d00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:58.805 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.806+0000 7f32d4a00640 1 -- 172.21.15.163:0/917068812 shutdown_connections 2024-04-01T16:34:58.806 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.806+0000 7f32d4a00640 1 -- 172.21.15.163:0/917068812 wait complete. 2024-04-01T16:34:58.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.809+0000 7f32d4a00640 1 Processor -- start 2024-04-01T16:34:58.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.809+0000 7f32d4a00640 1 -- start start 2024-04-01T16:34:58.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.811+0000 7f32d4a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32d00c3e40 0x7f32d014b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:58.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.811+0000 7f32d4a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32d00c8570 0x7f32d0143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:58.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.811+0000 7f32d4a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32d014e0e0 0x7f32d0158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:58.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.811+0000 7f32d4a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f32d00c6470 con 0x7f32d00c8570 2024-04-01T16:34:58.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.811+0000 7f32d4a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32d0067800 con 0x7f32d014e0e0 2024-04-01T16:34:58.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.811+0000 7f32d4a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f32d00c6750 con 0x7f32d00c3e40 2024-04-01T16:34:58.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.813+0000 7f32cde00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32d00c3e40 0x7f32d014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:58.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.813+0000 7f32ce800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32d014e0e0 0x7f32d0158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:58.813 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.813+0000 7f32cde00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32d00c3e40 0x7f32d014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:38438/0 (socket says 172.21.15.163:38438) 2024-04-01T16:34:58.813 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.813+0000 7f32cde00640 1 -- 172.21.15.163:0/3457927856 learned_addr learned my addr 172.21.15.163:0/3457927856 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:58.814 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.815+0000 7f32cd400640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32d00c8570 0x7f32d0143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:58.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.818+0000 7f32cde00640 1 -- 172.21.15.163:0/3457927856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32d014e0e0 msgr2=0x7f32d0158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:58.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.818+0000 7f32cde00640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32d014e0e0 0x7f32d0158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:58.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.818+0000 7f32cde00640 1 -- 172.21.15.163:0/3457927856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32d00c8570 msgr2=0x7f32d0143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:58.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.818+0000 7f32cde00640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32d00c8570 0x7f32d0143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:58.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.818+0000 7f32cde00640 1 -- 172.21.15.163:0/3457927856 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d014ab50 con 0x7f32d00c3e40 2024-04-01T16:34:58.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.823+0000 7f32cde00640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32d00c3e40 0x7f32d014b330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c460 tx=0x7f32c000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:58.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.829+0000 7f32c6000640 1 -- 172.21.15.163:0/3457927856 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0016020 con 0x7f32d00c3e40 2024-04-01T16:34:58.829 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.829+0000 7f32c6000640 1 -- 172.21.15.163:0/3457927856 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c0012870 con 0x7f32d00c3e40 2024-04-01T16:34:58.829 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.829+0000 7f32c6000640 1 -- 172.21.15.163:0/3457927856 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0012c60 con 0x7f32d00c3e40 2024-04-01T16:34:58.829 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.829+0000 7f32d4a00640 1 -- 172.21.15.163:0/3457927856 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d0154b30 con 0x7f32d00c3e40 2024-04-01T16:34:58.829 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.829+0000 7f32d4a00640 1 -- 172.21.15.163:0/3457927856 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d014c770 con 0x7f32d00c3e40 2024-04-01T16:34:58.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:58.831+0000 7f32d4a00640 1 -- 172.21.15.163:0/3457927856 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d00756d0 con 0x7f32d00c3e40 2024-04-01T16:34:59.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.048+0000 7f32c6000640 1 -- 172.21.15.163:0/3457927856 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f32c0019020 con 0x7f32d00c3e40 2024-04-01T16:34:59.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.050+0000 7f32c6000640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f32b006c940 0x7f32b006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:59.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.051+0000 7f32cd400640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f32b006c940 0x7f32b006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:59.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.052+0000 7f32cd400640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f32b006c940 0x7f32b006ee00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f32bc006fd0 tx=0x7f32bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:59.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.165+0000 7f32c6000640 1 -- 172.21.15.163:0/3457927856 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f32c0012e00 con 0x7f32d00c3e40 2024-04-01T16:34:59.199 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.200+0000 7f32c6000640 1 -- 172.21.15.163:0/3457927856 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f32c0020070 con 0x7f32d00c3e40 2024-04-01T16:34:59.415 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.415+0000 7f32d4a00640 1 -- 172.21.15.163:0/3457927856 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f32d006c690 con 0x7f32b006c940 2024-04-01T16:34:59.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.433+0000 7f32c6000640 1 -- 172.21.15.163:0/3457927856 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251817 (secure 0 0 0) 0x7f32d006c690 con 0x7f32b006c940 2024-04-01T16:34:59.435 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:34:59.436 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T16:34:59.438 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.437+0000 7f32d4a00640 1 -- 172.21.15.163:0/3457927856 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f32b006c940 msgr2=0x7f32b006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:59.438 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.437+0000 7f32d4a00640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f32b006c940 0x7f32b006ee00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f32bc006fd0 tx=0x7f32bc008040 comp rx=0 tx=0).stop 2024-04-01T16:34:59.438 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.437+0000 7f32d4a00640 1 -- 172.21.15.163:0/3457927856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32d00c3e40 msgr2=0x7f32d014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:59.438 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.437+0000 7f32d4a00640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32d00c3e40 0x7f32d014b330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c460 tx=0x7f32c000c920 comp rx=0 tx=0).stop 2024-04-01T16:34:59.438 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.437+0000 7f32d4a00640 1 -- 172.21.15.163:0/3457927856 shutdown_connections 2024-04-01T16:34:59.438 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.437+0000 7f32d4a00640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f32b006c940 0x7f32b006ee00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:59.438 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.437+0000 7f32d4a00640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32d014e0e0 0x7f32d0158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:59.438 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.437+0000 7f32d4a00640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f32d00c8570 0x7f32d0143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:59.439 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.437+0000 7f32d4a00640 1 --2- 172.21.15.163:0/3457927856 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f32d00c3e40 0x7f32d014b330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:59.439 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.437+0000 7f32d4a00640 1 -- 172.21.15.163:0/3457927856 >> 172.21.15.163:0/3457927856 conn(0x7f32d00c8f80 msgr2=0x7f32d00ca960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:59.439 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.437+0000 7f32d4a00640 1 -- 172.21.15.163:0/3457927856 shutdown_connections 2024-04-01T16:34:59.439 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.437+0000 7f32d4a00640 1 -- 172.21.15.163:0/3457927856 wait complete. 2024-04-01T16:34:59.455 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-01T16:34:57.791633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219556,"kb_used_data":3396,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755164,"statfs":{"total":773094113280,"available":772869287936,"internally_reserved":0,"allocated":3477504,"data_stored":2022529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002630"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543600+0000","last_change":"2024-04-01T16:34:34.033508+0000","last_active":"2024-04-01T16:34:54.543600+0000","last_peered":"2024-04-01T16:34:54.543600+0000","last_clean":"2024-04-01T16:34:54.543600+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T16:34:54.543600+0000","last_undegraded":"2024-04-01T16:34:54.543600+0000","last_fullsized":"2024-04-01T16:34:54.543600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.261033+0000","last_change":"2024-04-01T16:34:34.065375+0000","last_active":"2024-04-01T16:34:52.261033+0000","last_peered":"2024-04-01T16:34:52.261033+0000","last_clean":"2024-04-01T16:34:52.261033+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T16:34:52.261033+0000","last_undegraded":"2024-04-01T16:34:52.261033+0000","last_fullsized":"2024-04-01T16:34:52.261033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002160+0000","last_change":"2024-04-01T16:34:34.084618+0000","last_active":"2024-04-01T16:34:55.002160+0000","last_peered":"2024-04-01T16:34:55.002160+0000","last_clean":"2024-04-01T16:34:55.002160+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T16:34:55.002160+0000","last_undegraded":"2024-04-01T16:34:55.002160+0000","last_fullsized":"2024-04-01T16:34:55.002160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:43.530081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010013+0000","last_change":"2024-04-01T16:34:34.088694+0000","last_active":"2024-04-01T16:34:55.010013+0000","last_peered":"2024-04-01T16:34:55.010013+0000","last_clean":"2024-04-01T16:34:55.010013+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T16:34:55.010013+0000","last_undegraded":"2024-04-01T16:34:55.010013+0000","last_fullsized":"2024-04-01T16:34:55.010013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542768+0000","last_change":"2024-04-01T16:34:34.085765+0000","last_active":"2024-04-01T16:34:54.542768+0000","last_peered":"2024-04-01T16:34:54.542768+0000","last_clean":"2024-04-01T16:34:54.542768+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T16:34:54.542768+0000","last_undegraded":"2024-04-01T16:34:54.542768+0000","last_fullsized":"2024-04-01T16:34:54.542768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009741+0000","last_change":"2024-04-01T16:34:34.066150+0000","last_active":"2024-04-01T16:34:55.009741+0000","last_peered":"2024-04-01T16:34:55.009741+0000","last_clean":"2024-04-01T16:34:55.009741+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T16:34:55.009741+0000","last_undegraded":"2024-04-01T16:34:55.009741+0000","last_fullsized":"2024-04-01T16:34:55.009741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:08:56.651785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542643+0000","last_change":"2024-04-01T16:34:34.072924+0000","last_active":"2024-04-01T16:34:54.542643+0000","last_peered":"2024-04-01T16:34:54.542643+0000","last_clean":"2024-04-01T16:34:54.542643+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T16:34:54.542643+0000","last_undegraded":"2024-04-01T16:34:54.542643+0000","last_fullsized":"2024-04-01T16:34:54.542643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255225+0000","last_change":"2024-04-01T16:34:34.088361+0000","last_active":"2024-04-01T16:34:52.255225+0000","last_peered":"2024-04-01T16:34:52.255225+0000","last_clean":"2024-04-01T16:34:52.255225+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T16:34:52.255225+0000","last_undegraded":"2024-04-01T16:34:52.255225+0000","last_fullsized":"2024-04-01T16:34:52.255225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543787+0000","last_change":"2024-04-01T16:34:34.038534+0000","last_active":"2024-04-01T16:34:54.543787+0000","last_peered":"2024-04-01T16:34:54.543787+0000","last_clean":"2024-04-01T16:34:54.543787+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T16:34:54.543787+0000","last_undegraded":"2024-04-01T16:34:54.543787+0000","last_fullsized":"2024-04-01T16:34:54.543787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:54.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248629+0000","last_change":"2024-04-01T16:34:34.040513+0000","last_active":"2024-04-01T16:34:52.248629+0000","last_peered":"2024-04-01T16:34:52.248629+0000","last_clean":"2024-04-01T16:34:52.248629+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T16:34:52.248629+0000","last_undegraded":"2024-04-01T16:34:52.248629+0000","last_fullsized":"2024-04-01T16:34:52.248629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248396+0000","last_change":"2024-04-01T16:34:34.038167+0000","last_active":"2024-04-01T16:34:52.248396+0000","last_peered":"2024-04-01T16:34:52.248396+0000","last_clean":"2024-04-01T16:34:52.248396+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T16:34:52.248396+0000","last_undegraded":"2024-04-01T16:34:52.248396+0000","last_fullsized":"2024-04-01T16:34:52.248396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008124+0000","last_change":"2024-04-01T16:34:34.035177+0000","last_active":"2024-04-01T16:34:55.008124+0000","last_peered":"2024-04-01T16:34:55.008124+0000","last_clean":"2024-04-01T16:34:55.008124+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T16:34:55.008124+0000","last_undegraded":"2024-04-01T16:34:55.008124+0000","last_fullsized":"2024-04-01T16:34:55.008124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:37.711846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255564+0000","last_change":"2024-04-01T16:34:34.086031+0000","last_active":"2024-04-01T16:34:52.255564+0000","last_peered":"2024-04-01T16:34:52.255564+0000","last_clean":"2024-04-01T16:34:52.255564+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T16:34:52.255564+0000","last_undegraded":"2024-04-01T16:34:52.255564+0000","last_fullsized":"2024-04-01T16:34:52.255564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.001512+0000","last_change":"2024-04-01T16:34:34.071535+0000","last_active":"2024-04-01T16:34:55.001512+0000","last_peered":"2024-04-01T16:34:55.001512+0000","last_clean":"2024-04-01T16:34:55.001512+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T16:34:55.001512+0000","last_undegraded":"2024-04-01T16:34:55.001512+0000","last_fullsized":"2024-04-01T16:34:55.001512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:45.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260608+0000","last_change":"2024-04-01T16:34:33.904701+0000","last_active":"2024-04-01T16:34:52.260608+0000","last_peered":"2024-04-01T16:34:52.260608+0000","last_clean":"2024-04-01T16:34:52.260608+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T16:34:52.260608+0000","last_undegraded":"2024-04-01T16:34:52.260608+0000","last_fullsized":"2024-04-01T16:34:52.260608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009278+0000","last_change":"2024-04-01T16:34:34.064695+0000","last_active":"2024-04-01T16:34:55.009278+0000","last_peered":"2024-04-01T16:34:55.009278+0000","last_clean":"2024-04-01T16:34:55.009278+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T16:34:55.009278+0000","last_undegraded":"2024-04-01T16:34:55.009278+0000","last_fullsized":"2024-04-01T16:34:55.009278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.798148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010268+0000","last_change":"2024-04-01T16:34:34.032994+0000","last_active":"2024-04-01T16:34:55.010268+0000","last_peered":"2024-04-01T16:34:55.010268+0000","last_clean":"2024-04-01T16:34:55.010268+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T16:34:55.010268+0000","last_undegraded":"2024-04-01T16:34:55.010268+0000","last_fullsized":"2024-04-01T16:34:55.010268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504087+0000","last_change":"2024-04-01T16:34:34.082238+0000","last_active":"2024-04-01T16:34:54.504087+0000","last_peered":"2024-04-01T16:34:54.504087+0000","last_clean":"2024-04-01T16:34:54.504087+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T16:34:54.504087+0000","last_undegraded":"2024-04-01T16:34:54.504087+0000","last_fullsized":"2024-04-01T16:34:54.504087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543579+0000","last_change":"2024-04-01T16:34:34.083056+0000","last_active":"2024-04-01T16:34:54.543579+0000","last_peered":"2024-04-01T16:34:54.543579+0000","last_clean":"2024-04-01T16:34:54.543579+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T16:34:54.543579+0000","last_undegraded":"2024-04-01T16:34:54.543579+0000","last_fullsized":"2024-04-01T16:34:54.543579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248422+0000","last_change":"2024-04-01T16:34:34.034017+0000","last_active":"2024-04-01T16:34:52.248422+0000","last_peered":"2024-04-01T16:34:52.248422+0000","last_clean":"2024-04-01T16:34:52.248422+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T16:34:52.248422+0000","last_undegraded":"2024-04-01T16:34:52.248422+0000","last_fullsized":"2024-04-01T16:34:52.248422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:33.976417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002286+0000","last_change":"2024-04-01T16:34:34.068541+0000","last_active":"2024-04-01T16:34:55.002286+0000","last_peered":"2024-04-01T16:34:55.002286+0000","last_clean":"2024-04-01T16:34:55.002286+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T16:34:55.002286+0000","last_undegraded":"2024-04-01T16:34:55.002286+0000","last_fullsized":"2024-04-01T16:34:55.002286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:29.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009827+0000","last_change":"2024-04-01T16:34:34.031774+0000","last_active":"2024-04-01T16:34:55.009827+0000","last_peered":"2024-04-01T16:34:55.009827+0000","last_clean":"2024-04-01T16:34:55.009827+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T16:34:55.009827+0000","last_undegraded":"2024-04-01T16:34:55.009827+0000","last_fullsized":"2024-04-01T16:34:55.009827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:39.294525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255352+0000","last_change":"2024-04-01T16:34:34.090324+0000","last_active":"2024-04-01T16:34:52.255352+0000","last_peered":"2024-04-01T16:34:52.255352+0000","last_clean":"2024-04-01T16:34:52.255352+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T16:34:52.255352+0000","last_undegraded":"2024-04-01T16:34:52.255352+0000","last_fullsized":"2024-04-01T16:34:52.255352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:55:40.168021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008960+0000","last_change":"2024-04-01T16:34:34.083544+0000","last_active":"2024-04-01T16:34:55.008960+0000","last_peered":"2024-04-01T16:34:55.008960+0000","last_clean":"2024-04-01T16:34:55.008960+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T16:34:55.008960+0000","last_undegraded":"2024-04-01T16:34:55.008960+0000","last_fullsized":"2024-04-01T16:34:55.008960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255904+0000","last_change":"2024-04-01T16:34:34.090721+0000","last_active":"2024-04-01T16:34:52.255904+0000","last_peered":"2024-04-01T16:34:52.255904+0000","last_clean":"2024-04-01T16:34:52.255904+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T16:34:52.255904+0000","last_undegraded":"2024-04-01T16:34:52.255904+0000","last_fullsized":"2024-04-01T16:34:52.255904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-01T16:34:37.629903+0000","last_change":"2024-04-01T16:34:52.248200+0000","last_active":"2024-04-01T16:34:52.248200+0000","last_peered":"2024-04-01T16:34:37.629903+0000","last_clean":"2024-04-01T16:34:37.629903+0000","last_became_active":"2024-04-01T16:34:34.032529+0000","last_became_peered":"2024-04-01T16:34:34.032529+0000","last_unstale":"2024-04-01T16:34:37.629903+0000","last_undegraded":"2024-04-01T16:34:37.629903+0000","last_fullsized":"2024-04-01T16:34:37.629903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260654+0000","last_change":"2024-04-01T16:34:34.091911+0000","last_active":"2024-04-01T16:34:52.260654+0000","last_peered":"2024-04-01T16:34:52.260654+0000","last_clean":"2024-04-01T16:34:52.260654+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T16:34:52.260654+0000","last_undegraded":"2024-04-01T16:34:52.260654+0000","last_fullsized":"2024-04-01T16:34:52.260654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255582+0000","last_change":"2024-04-01T16:34:34.091540+0000","last_active":"2024-04-01T16:34:52.255582+0000","last_peered":"2024-04-01T16:34:52.255582+0000","last_clean":"2024-04-01T16:34:52.255582+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T16:34:52.255582+0000","last_undegraded":"2024-04-01T16:34:52.255582+0000","last_fullsized":"2024-04-01T16:34:52.255582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002349+0000","last_change":"2024-04-01T16:34:34.087634+0000","last_active":"2024-04-01T16:34:55.002349+0000","last_peered":"2024-04-01T16:34:55.002349+0000","last_clean":"2024-04-01T16:34:55.002349+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T16:34:55.002349+0000","last_undegraded":"2024-04-01T16:34:55.002349+0000","last_fullsized":"2024-04-01T16:34:55.002349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:12.994756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009994+0000","last_change":"2024-04-01T16:34:34.084026+0000","last_active":"2024-04-01T16:34:55.009994+0000","last_peered":"2024-04-01T16:34:55.009994+0000","last_clean":"2024-04-01T16:34:55.009994+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T16:34:55.009994+0000","last_undegraded":"2024-04-01T16:34:55.009994+0000","last_fullsized":"2024-04-01T16:34:55.009994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503763+0000","last_change":"2024-04-01T16:34:34.088300+0000","last_active":"2024-04-01T16:34:54.503763+0000","last_peered":"2024-04-01T16:34:54.503763+0000","last_clean":"2024-04-01T16:34:54.503763+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T16:34:54.503763+0000","last_undegraded":"2024-04-01T16:34:54.503763+0000","last_fullsized":"2024-04-01T16:34:54.503763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.247856+0000","last_change":"2024-04-01T16:34:34.068348+0000","last_active":"2024-04-01T16:34:52.247856+0000","last_peered":"2024-04-01T16:34:52.247856+0000","last_clean":"2024-04-01T16:34:52.247856+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T16:34:52.247856+0000","last_undegraded":"2024-04-01T16:34:52.247856+0000","last_fullsized":"2024-04-01T16:34:52.247856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010349+0000","last_change":"2024-04-01T16:34:33.901019+0000","last_active":"2024-04-01T16:34:55.010349+0000","last_peered":"2024-04-01T16:34:55.010349+0000","last_clean":"2024-04-01T16:34:55.010349+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T16:34:55.010349+0000","last_undegraded":"2024-04-01T16:34:55.010349+0000","last_fullsized":"2024-04-01T16:34:55.010349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:08:37.254438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255720+0000","last_change":"2024-04-01T16:34:31.489434+0000","last_active":"2024-04-01T16:34:52.255720+0000","last_peered":"2024-04-01T16:34:52.255720+0000","last_clean":"2024-04-01T16:34:52.255720+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T16:34:52.255720+0000","last_undegraded":"2024-04-01T16:34:52.255720+0000","last_fullsized":"2024-04-01T16:34:52.255720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002555+0000","last_change":"2024-04-01T16:34:34.065342+0000","last_active":"2024-04-01T16:34:55.002555+0000","last_peered":"2024-04-01T16:34:55.002555+0000","last_clean":"2024-04-01T16:34:55.002555+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T16:34:55.002555+0000","last_undegraded":"2024-04-01T16:34:55.002555+0000","last_fullsized":"2024-04-01T16:34:55.002555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:56.911106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248428+0000","last_change":"2024-04-01T16:34:31.530201+0000","last_active":"2024-04-01T16:34:52.248428+0000","last_peered":"2024-04-01T16:34:52.248428+0000","last_clean":"2024-04-01T16:34:52.248428+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T16:34:52.248428+0000","last_undegraded":"2024-04-01T16:34:52.248428+0000","last_fullsized":"2024-04-01T16:34:52.248428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255510+0000","last_change":"2024-04-01T16:34:31.528238+0000","last_active":"2024-04-01T16:34:52.255510+0000","last_peered":"2024-04-01T16:34:52.255510+0000","last_clean":"2024-04-01T16:34:52.255510+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T16:34:52.255510+0000","last_undegraded":"2024-04-01T16:34:52.255510+0000","last_fullsized":"2024-04-01T16:34:52.255510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255256+0000","last_change":"2024-04-01T16:34:34.091302+0000","last_active":"2024-04-01T16:34:52.255256+0000","last_peered":"2024-04-01T16:34:52.255256+0000","last_clean":"2024-04-01T16:34:52.255256+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T16:34:52.255256+0000","last_undegraded":"2024-04-01T16:34:52.255256+0000","last_fullsized":"2024-04-01T16:34:52.255256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009229+0000","last_change":"2024-04-01T16:34:31.567946+0000","last_active":"2024-04-01T16:34:55.009229+0000","last_peered":"2024-04-01T16:34:55.009229+0000","last_clean":"2024-04-01T16:34:55.009229+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T16:34:55.009229+0000","last_undegraded":"2024-04-01T16:34:55.009229+0000","last_fullsized":"2024-04-01T16:34:55.009229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260464+0000","last_change":"2024-04-01T16:34:34.088894+0000","last_active":"2024-04-01T16:34:52.260464+0000","last_peered":"2024-04-01T16:34:52.260464+0000","last_clean":"2024-04-01T16:34:52.260464+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T16:34:52.260464+0000","last_undegraded":"2024-04-01T16:34:52.260464+0000","last_fullsized":"2024-04-01T16:34:52.260464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.249320+0000","last_change":"2024-04-01T16:34:31.566997+0000","last_active":"2024-04-01T16:34:52.249320+0000","last_peered":"2024-04-01T16:34:52.249320+0000","last_clean":"2024-04-01T16:34:52.249320+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T16:34:52.249320+0000","last_undegraded":"2024-04-01T16:34:52.249320+0000","last_fullsized":"2024-04-01T16:34:52.249320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010465+0000","last_change":"2024-04-01T16:34:34.030831+0000","last_active":"2024-04-01T16:34:55.010465+0000","last_peered":"2024-04-01T16:34:55.010465+0000","last_clean":"2024-04-01T16:34:55.010465+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T16:34:55.010465+0000","last_undegraded":"2024-04-01T16:34:55.010465+0000","last_fullsized":"2024-04-01T16:34:55.010465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010568+0000","last_change":"2024-04-01T16:34:31.569927+0000","last_active":"2024-04-01T16:34:55.010568+0000","last_peered":"2024-04-01T16:34:55.010568+0000","last_clean":"2024-04-01T16:34:55.010568+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T16:34:55.010568+0000","last_undegraded":"2024-04-01T16:34:55.010568+0000","last_fullsized":"2024-04-01T16:34:55.010568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:41.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002879+0000","last_change":"2024-04-01T16:34:34.068959+0000","last_active":"2024-04-01T16:34:55.002879+0000","last_peered":"2024-04-01T16:34:55.002879+0000","last_clean":"2024-04-01T16:34:55.002879+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T16:34:55.002879+0000","last_undegraded":"2024-04-01T16:34:55.002879+0000","last_fullsized":"2024-04-01T16:34:55.002879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:58:57.685708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260693+0000","last_change":"2024-04-01T16:34:31.562792+0000","last_active":"2024-04-01T16:34:52.260693+0000","last_peered":"2024-04-01T16:34:52.260693+0000","last_clean":"2024-04-01T16:34:52.260693+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T16:34:52.260693+0000","last_undegraded":"2024-04-01T16:34:52.260693+0000","last_fullsized":"2024-04-01T16:34:52.260693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:55.684911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008845+0000","last_change":"2024-04-01T16:34:33.916652+0000","last_active":"2024-04-01T16:34:55.008845+0000","last_peered":"2024-04-01T16:34:55.008845+0000","last_clean":"2024-04-01T16:34:55.008845+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T16:34:55.008845+0000","last_undegraded":"2024-04-01T16:34:55.008845+0000","last_fullsized":"2024-04-01T16:34:55.008845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'6","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248702+0000","last_change":"2024-04-01T16:34:31.531366+0000","last_active":"2024-04-01T16:34:52.248702+0000","last_peered":"2024-04-01T16:34:52.248702+0000","last_clean":"2024-04-01T16:34:52.248702+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T16:34:52.248702+0000","last_undegraded":"2024-04-01T16:34:52.248702+0000","last_fullsized":"2024-04-01T16:34:52.248702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543193+0000","last_change":"2024-04-01T16:34:34.085449+0000","last_active":"2024-04-01T16:34:54.543193+0000","last_peered":"2024-04-01T16:34:54.543193+0000","last_clean":"2024-04-01T16:34:54.543193+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T16:34:54.543193+0000","last_undegraded":"2024-04-01T16:34:54.543193+0000","last_fullsized":"2024-04-01T16:34:54.543193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002803+0000","last_change":"2024-04-01T16:34:31.444458+0000","last_active":"2024-04-01T16:34:55.002803+0000","last_peered":"2024-04-01T16:34:55.002803+0000","last_clean":"2024-04-01T16:34:55.002803+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T16:34:55.002803+0000","last_undegraded":"2024-04-01T16:34:55.002803+0000","last_fullsized":"2024-04-01T16:34:55.002803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.001912+0000","last_change":"2024-04-01T16:34:34.071521+0000","last_active":"2024-04-01T16:34:55.001912+0000","last_peered":"2024-04-01T16:34:55.001912+0000","last_clean":"2024-04-01T16:34:55.001912+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T16:34:55.001912+0000","last_undegraded":"2024-04-01T16:34:55.001912+0000","last_fullsized":"2024-04-01T16:34:55.001912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:36:13.618956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010073+0000","last_change":"2024-04-01T16:34:31.566202+0000","last_active":"2024-04-01T16:34:55.010073+0000","last_peered":"2024-04-01T16:34:55.010073+0000","last_clean":"2024-04-01T16:34:55.010073+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T16:34:55.010073+0000","last_undegraded":"2024-04-01T16:34:55.010073+0000","last_fullsized":"2024-04-01T16:34:55.010073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:54.543283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543363+0000","last_change":"2024-04-01T16:34:33.930561+0000","last_active":"2024-04-01T16:34:54.543363+0000","last_peered":"2024-04-01T16:34:54.543363+0000","last_clean":"2024-04-01T16:34:54.543363+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T16:34:54.543363+0000","last_undegraded":"2024-04-01T16:34:54.543363+0000","last_fullsized":"2024-04-01T16:34:54.543363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248584+0000","last_change":"2024-04-01T16:34:31.535895+0000","last_active":"2024-04-01T16:34:52.248584+0000","last_peered":"2024-04-01T16:34:52.248584+0000","last_clean":"2024-04-01T16:34:52.248584+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T16:34:52.248584+0000","last_undegraded":"2024-04-01T16:34:52.248584+0000","last_fullsized":"2024-04-01T16:34:52.248584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:36:43.780845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.247914+0000","last_change":"2024-04-01T16:34:34.068194+0000","last_active":"2024-04-01T16:34:52.247914+0000","last_peered":"2024-04-01T16:34:52.247914+0000","last_clean":"2024-04-01T16:34:52.247914+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T16:34:52.247914+0000","last_undegraded":"2024-04-01T16:34:52.247914+0000","last_fullsized":"2024-04-01T16:34:52.247914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503806+0000","last_change":"2024-04-01T16:34:31.515495+0000","last_active":"2024-04-01T16:34:54.503806+0000","last_peered":"2024-04-01T16:34:54.503806+0000","last_clean":"2024-04-01T16:34:54.503806+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T16:34:54.503806+0000","last_undegraded":"2024-04-01T16:34:54.503806+0000","last_fullsized":"2024-04-01T16:34:54.503806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:26:56.217819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542753+0000","last_change":"2024-04-01T16:34:33.926318+0000","last_active":"2024-04-01T16:34:54.542753+0000","last_peered":"2024-04-01T16:34:54.542753+0000","last_clean":"2024-04-01T16:34:54.542753+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T16:34:54.542753+0000","last_undegraded":"2024-04-01T16:34:54.542753+0000","last_fullsized":"2024-04-01T16:34:54.542753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009730+0000","last_change":"2024-04-01T16:34:31.440349+0000","last_active":"2024-04-01T16:34:55.009730+0000","last_peered":"2024-04-01T16:34:55.009730+0000","last_clean":"2024-04-01T16:34:55.009730+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T16:34:55.009730+0000","last_undegraded":"2024-04-01T16:34:55.009730+0000","last_fullsized":"2024-04-01T16:34:55.009730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:29.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542735+0000","last_change":"2024-04-01T16:34:33.931211+0000","last_active":"2024-04-01T16:34:54.542735+0000","last_peered":"2024-04-01T16:34:54.542735+0000","last_clean":"2024-04-01T16:34:54.542735+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T16:34:54.542735+0000","last_undegraded":"2024-04-01T16:34:54.542735+0000","last_fullsized":"2024-04-01T16:34:54.542735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:15:45.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504196+0000","last_change":"2024-04-01T16:34:31.512433+0000","last_active":"2024-04-01T16:34:54.504196+0000","last_peered":"2024-04-01T16:34:54.504196+0000","last_clean":"2024-04-01T16:34:54.504196+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T16:34:54.504196+0000","last_undegraded":"2024-04-01T16:34:54.504196+0000","last_fullsized":"2024-04-01T16:34:54.504196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:16.032012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543722+0000","last_change":"2024-04-01T16:34:33.930791+0000","last_active":"2024-04-01T16:34:54.543722+0000","last_peered":"2024-04-01T16:34:54.543722+0000","last_clean":"2024-04-01T16:34:54.543722+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T16:34:54.543722+0000","last_undegraded":"2024-04-01T16:34:54.543722+0000","last_fullsized":"2024-04-01T16:34:54.543722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:53.102054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260865+0000","last_change":"2024-04-01T16:34:31.509375+0000","last_active":"2024-04-01T16:34:52.260865+0000","last_peered":"2024-04-01T16:34:52.260865+0000","last_clean":"2024-04-01T16:34:52.260865+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T16:34:52.260865+0000","last_undegraded":"2024-04-01T16:34:52.260865+0000","last_fullsized":"2024-04-01T16:34:52.260865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010186+0000","last_change":"2024-04-01T16:34:34.085219+0000","last_active":"2024-04-01T16:34:55.010186+0000","last_peered":"2024-04-01T16:34:55.010186+0000","last_clean":"2024-04-01T16:34:55.010186+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T16:34:55.010186+0000","last_undegraded":"2024-04-01T16:34:55.010186+0000","last_fullsized":"2024-04-01T16:34:55.010186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504130+0000","last_change":"2024-04-01T16:34:31.562761+0000","last_active":"2024-04-01T16:34:54.504130+0000","last_peered":"2024-04-01T16:34:54.504130+0000","last_clean":"2024-04-01T16:34:54.504130+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T16:34:54.504130+0000","last_undegraded":"2024-04-01T16:34:54.504130+0000","last_fullsized":"2024-04-01T16:34:54.504130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:23:33.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543747+0000","last_change":"2024-04-01T16:34:34.039521+0000","last_active":"2024-04-01T16:34:54.543747+0000","last_peered":"2024-04-01T16:34:54.543747+0000","last_clean":"2024-04-01T16:34:54.543747+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T16:34:54.543747+0000","last_undegraded":"2024-04-01T16:34:54.543747+0000","last_fullsized":"2024-04-01T16:34:54.543747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543415+0000","last_change":"2024-04-01T16:34:08.195697+0000","last_active":"2024-04-01T16:34:54.543415+0000","last_peered":"2024-04-01T16:34:54.543415+0000","last_clean":"2024-04-01T16:34:54.543415+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T16:34:54.543415+0000","last_undegraded":"2024-04-01T16:34:54.543415+0000","last_fullsized":"2024-04-01T16:34:54.543415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_clean_scrub_stamp":"2024-04-01T16:34:06.247737+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:05:51.067541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009900+0000","last_change":"2024-04-01T16:34:31.569697+0000","last_active":"2024-04-01T16:34:55.009900+0000","last_peered":"2024-04-01T16:34:55.009900+0000","last_clean":"2024-04-01T16:34:55.009900+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T16:34:55.009900+0000","last_undegraded":"2024-04-01T16:34:55.009900+0000","last_fullsized":"2024-04-01T16:34:55.009900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.736852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.256046+0000","last_change":"2024-04-01T16:34:34.087298+0000","last_active":"2024-04-01T16:34:52.256046+0000","last_peered":"2024-04-01T16:34:52.256046+0000","last_clean":"2024-04-01T16:34:52.256046+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T16:34:52.256046+0000","last_undegraded":"2024-04-01T16:34:52.256046+0000","last_fullsized":"2024-04-01T16:34:52.256046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542776+0000","last_change":"2024-04-01T16:34:31.509150+0000","last_active":"2024-04-01T16:34:54.542776+0000","last_peered":"2024-04-01T16:34:54.542776+0000","last_clean":"2024-04-01T16:34:54.542776+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T16:34:54.542776+0000","last_undegraded":"2024-04-01T16:34:54.542776+0000","last_fullsized":"2024-04-01T16:34:54.542776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.001494+0000","last_change":"2024-04-01T16:34:34.068444+0000","last_active":"2024-04-01T16:34:55.001494+0000","last_peered":"2024-04-01T16:34:55.001494+0000","last_clean":"2024-04-01T16:34:55.001494+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T16:34:55.001494+0000","last_undegraded":"2024-04-01T16:34:55.001494+0000","last_fullsized":"2024-04-01T16:34:55.001494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:04.104676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503955+0000","last_change":"2024-04-01T16:34:31.512295+0000","last_active":"2024-04-01T16:34:54.503955+0000","last_peered":"2024-04-01T16:34:54.503955+0000","last_clean":"2024-04-01T16:34:54.503955+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T16:34:54.503955+0000","last_undegraded":"2024-04-01T16:34:54.503955+0000","last_fullsized":"2024-04-01T16:34:54.503955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:35.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260344+0000","last_change":"2024-04-01T16:34:34.083194+0000","last_active":"2024-04-01T16:34:52.260344+0000","last_peered":"2024-04-01T16:34:52.260344+0000","last_clean":"2024-04-01T16:34:52.260344+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T16:34:52.260344+0000","last_undegraded":"2024-04-01T16:34:52.260344+0000","last_fullsized":"2024-04-01T16:34:52.260344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010222+0000","last_change":"2024-04-01T16:34:31.569571+0000","last_active":"2024-04-01T16:34:55.010222+0000","last_peered":"2024-04-01T16:34:55.010222+0000","last_clean":"2024-04-01T16:34:55.010222+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T16:34:55.010222+0000","last_undegraded":"2024-04-01T16:34:55.010222+0000","last_fullsized":"2024-04-01T16:34:55.010222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:10.626933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008282+0000","last_change":"2024-04-01T16:34:34.063200+0000","last_active":"2024-04-01T16:34:55.008282+0000","last_peered":"2024-04-01T16:34:55.008282+0000","last_clean":"2024-04-01T16:34:55.008282+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T16:34:55.008282+0000","last_undegraded":"2024-04-01T16:34:55.008282+0000","last_fullsized":"2024-04-01T16:34:55.008282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:18.399835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260840+0000","last_change":"2024-04-01T16:34:31.512508+0000","last_active":"2024-04-01T16:34:52.260840+0000","last_peered":"2024-04-01T16:34:52.260840+0000","last_clean":"2024-04-01T16:34:52.260840+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T16:34:52.260840+0000","last_undegraded":"2024-04-01T16:34:52.260840+0000","last_fullsized":"2024-04-01T16:34:52.260840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.515324+0000","last_change":"2024-04-01T16:34:54.510347+0000","last_active":"2024-04-01T16:34:54.515324+0000","last_peered":"2024-04-01T16:34:54.515324+0000","last_clean":"2024-04-01T16:34:54.515324+0000","last_became_active":"2024-04-01T16:34:54.509976+0000","last_became_peered":"2024-04-01T16:34:54.509976+0000","last_unstale":"2024-04-01T16:34:54.515324+0000","last_undegraded":"2024-04-01T16:34:54.515324+0000","last_fullsized":"2024-04-01T16:34:54.515324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:41:48.631612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543670+0000","last_change":"2024-04-01T16:34:31.426647+0000","last_active":"2024-04-01T16:34:54.543670+0000","last_peered":"2024-04-01T16:34:54.543670+0000","last_clean":"2024-04-01T16:34:54.543670+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T16:34:54.543670+0000","last_undegraded":"2024-04-01T16:34:54.543670+0000","last_fullsized":"2024-04-01T16:34:54.543670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:36.926701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.261159+0000","last_change":"2024-04-01T16:34:34.087431+0000","last_active":"2024-04-01T16:34:52.261159+0000","last_peered":"2024-04-01T16:34:52.261159+0000","last_clean":"2024-04-01T16:34:52.261159+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T16:34:52.261159+0000","last_undegraded":"2024-04-01T16:34:52.261159+0000","last_fullsized":"2024-04-01T16:34:52.261159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.261159+0000","last_change":"2024-04-01T16:34:31.528790+0000","last_active":"2024-04-01T16:34:52.261159+0000","last_peered":"2024-04-01T16:34:52.261159+0000","last_clean":"2024-04-01T16:34:52.261159+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T16:34:52.261159+0000","last_undegraded":"2024-04-01T16:34:52.261159+0000","last_fullsized":"2024-04-01T16:34:52.261159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.256055+0000","last_change":"2024-04-01T16:34:34.085832+0000","last_active":"2024-04-01T16:34:52.256055+0000","last_peered":"2024-04-01T16:34:52.256055+0000","last_clean":"2024-04-01T16:34:52.256055+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T16:34:52.256055+0000","last_undegraded":"2024-04-01T16:34:52.256055+0000","last_fullsized":"2024-04-01T16:34:52.256055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.249322+0000","last_change":"2024-04-01T16:34:31.534057+0000","last_active":"2024-04-01T16:34:52.249322+0000","last_peered":"2024-04-01T16:34:52.249322+0000","last_clean":"2024-04-01T16:34:52.249322+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T16:34:52.249322+0000","last_undegraded":"2024-04-01T16:34:52.249322+0000","last_fullsized":"2024-04-01T16:34:52.249322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002868+0000","last_change":"2024-04-01T16:34:34.073261+0000","last_active":"2024-04-01T16:34:55.002868+0000","last_peered":"2024-04-01T16:34:55.002868+0000","last_clean":"2024-04-01T16:34:55.002868+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T16:34:55.002868+0000","last_undegraded":"2024-04-01T16:34:55.002868+0000","last_fullsized":"2024-04-01T16:34:55.002868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:38.619969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542511+0000","last_change":"2024-04-01T16:34:31.423531+0000","last_active":"2024-04-01T16:34:54.542511+0000","last_peered":"2024-04-01T16:34:54.542511+0000","last_clean":"2024-04-01T16:34:54.542511+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T16:34:54.542511+0000","last_undegraded":"2024-04-01T16:34:54.542511+0000","last_fullsized":"2024-04-01T16:34:54.542511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.007775+0000","last_change":"2024-04-01T16:34:34.086029+0000","last_active":"2024-04-01T16:34:55.007775+0000","last_peered":"2024-04-01T16:34:55.007775+0000","last_clean":"2024-04-01T16:34:55.007775+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T16:34:55.007775+0000","last_undegraded":"2024-04-01T16:34:55.007775+0000","last_fullsized":"2024-04-01T16:34:55.007775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.260865+0000","last_change":"2024-04-01T16:34:31.509351+0000","last_active":"2024-04-01T16:34:52.260865+0000","last_peered":"2024-04-01T16:34:52.260865+0000","last_clean":"2024-04-01T16:34:52.260865+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T16:34:52.260865+0000","last_undegraded":"2024-04-01T16:34:52.260865+0000","last_fullsized":"2024-04-01T16:34:52.260865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255343+0000","last_change":"2024-04-01T16:34:34.091932+0000","last_active":"2024-04-01T16:34:52.255343+0000","last_peered":"2024-04-01T16:34:52.255343+0000","last_clean":"2024-04-01T16:34:52.255343+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T16:34:52.255343+0000","last_undegraded":"2024-04-01T16:34:52.255343+0000","last_fullsized":"2024-04-01T16:34:52.255343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:11:00.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.261137+0000","last_change":"2024-04-01T16:34:31.517513+0000","last_active":"2024-04-01T16:34:52.261137+0000","last_peered":"2024-04-01T16:34:52.261137+0000","last_clean":"2024-04-01T16:34:52.261137+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T16:34:52.261137+0000","last_undegraded":"2024-04-01T16:34:52.261137+0000","last_fullsized":"2024-04-01T16:34:52.261137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:31.608594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":2,"reported_epoch":26,"state":"peering","last_fresh":"2024-04-01T16:34:34.078887+0000","last_change":"2024-04-01T16:34:53.550415+0000","last_active":"2024-04-01T16:34:32.285854+0000","last_peered":"2024-04-01T16:34:32.285854+0000","last_clean":"2024-04-01T16:34:32.285854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-01T16:34:34.078887+0000","last_undegraded":"2024-04-01T16:34:34.078887+0000","last_fullsized":"2024-04-01T16:34:34.078887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543847+0000","last_change":"2024-04-01T16:34:31.444603+0000","last_active":"2024-04-01T16:34:54.543847+0000","last_peered":"2024-04-01T16:34:54.543847+0000","last_clean":"2024-04-01T16:34:54.543847+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T16:34:54.543847+0000","last_undegraded":"2024-04-01T16:34:54.543847+0000","last_fullsized":"2024-04-01T16:34:54.543847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.248166+0000","last_change":"2024-04-01T16:34:34.034061+0000","last_active":"2024-04-01T16:34:52.248166+0000","last_peered":"2024-04-01T16:34:52.248166+0000","last_clean":"2024-04-01T16:34:52.248166+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T16:34:52.248166+0000","last_undegraded":"2024-04-01T16:34:52.248166+0000","last_fullsized":"2024-04-01T16:34:52.248166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.014117+0000","last_change":"2024-04-01T16:34:55.011962+0000","last_active":"2024-04-01T16:34:55.014117+0000","last_peered":"2024-04-01T16:34:55.014117+0000","last_clean":"2024-04-01T16:34:55.014117+0000","last_became_active":"2024-04-01T16:34:55.011400+0000","last_became_peered":"2024-04-01T16:34:55.011400+0000","last_unstale":"2024-04-01T16:34:55.014117+0000","last_undegraded":"2024-04-01T16:34:55.014117+0000","last_fullsized":"2024-04-01T16:34:55.014117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:14:52.381836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543077+0000","last_change":"2024-04-01T16:34:31.563882+0000","last_active":"2024-04-01T16:34:54.543077+0000","last_peered":"2024-04-01T16:34:54.543077+0000","last_clean":"2024-04-01T16:34:54.543077+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T16:34:54.543077+0000","last_undegraded":"2024-04-01T16:34:54.543077+0000","last_fullsized":"2024-04-01T16:34:54.543077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:27.209535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010099+0000","last_change":"2024-04-01T16:34:34.034904+0000","last_active":"2024-04-01T16:34:55.010099+0000","last_peered":"2024-04-01T16:34:55.010099+0000","last_clean":"2024-04-01T16:34:55.010099+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T16:34:55.010099+0000","last_undegraded":"2024-04-01T16:34:55.010099+0000","last_fullsized":"2024-04-01T16:34:55.010099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543474+0000","last_change":"2024-04-01T16:34:31.530246+0000","last_active":"2024-04-01T16:34:54.543474+0000","last_peered":"2024-04-01T16:34:54.543474+0000","last_clean":"2024-04-01T16:34:54.543474+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T16:34:54.543474+0000","last_undegraded":"2024-04-01T16:34:54.543474+0000","last_fullsized":"2024-04-01T16:34:54.543474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:48.430325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002793+0000","last_change":"2024-04-01T16:34:34.066381+0000","last_active":"2024-04-01T16:34:55.002793+0000","last_peered":"2024-04-01T16:34:55.002793+0000","last_clean":"2024-04-01T16:34:55.002793+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T16:34:55.002793+0000","last_undegraded":"2024-04-01T16:34:55.002793+0000","last_fullsized":"2024-04-01T16:34:55.002793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:10.824493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.256152+0000","last_change":"2024-04-01T16:34:31.490535+0000","last_active":"2024-04-01T16:34:52.256152+0000","last_peered":"2024-04-01T16:34:52.256152+0000","last_clean":"2024-04-01T16:34:52.256152+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T16:34:52.256152+0000","last_undegraded":"2024-04-01T16:34:52.256152+0000","last_fullsized":"2024-04-01T16:34:52.256152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:24.709969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-01T16:34:52.255831+0000","last_change":"2024-04-01T16:34:34.087097+0000","last_active":"2024-04-01T16:34:52.255831+0000","last_peered":"2024-04-01T16:34:52.255831+0000","last_clean":"2024-04-01T16:34:52.255831+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T16:34:52.255831+0000","last_undegraded":"2024-04-01T16:34:52.255831+0000","last_fullsized":"2024-04-01T16:34:52.255831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:17:48.287828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"24'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.003040+0000","last_change":"2024-04-01T16:34:31.420599+0000","last_active":"2024-04-01T16:34:55.003040+0000","last_peered":"2024-04-01T16:34:55.003040+0000","last_clean":"2024-04-01T16:34:55.003040+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T16:34:55.003040+0000","last_undegraded":"2024-04-01T16:34:55.003040+0000","last_fullsized":"2024-04-01T16:34:55.003040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":697840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":106890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":697896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":106980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":107016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":101001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T16:34:59.459 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-04-01T16:34:59.459 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 18, 'reported_epoch': 25, 'state': 'peering', 'last_fresh': '2024-04-01T16:34:37.629903+0000', 'last_change': '2024-04-01T16:34:52.248200+0000', 'last_active': '2024-04-01T16:34:52.248200+0000', 'last_peered': '2024-04-01T16:34:37.629903+0000', 'last_clean': '2024-04-01T16:34:37.629903+0000', 'last_became_active': '2024-04-01T16:34:34.032529+0000', 'last_became_peered': '2024-04-01T16:34:34.032529+0000', 'last_unstale': '2024-04-01T16:34:37.629903+0000', 'last_undegraded': '2024-04-01T16:34:37.629903+0000', 'last_fullsized': '2024-04-01T16:34:37.629903+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 22, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T16:34:32.285854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T16:34:32.285854+0000', 'last_clean_scrub_stamp': '2024-04-01T16:34:32.285854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2, 7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-01T16:34:59.459 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-04-01T16:34:59.459 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 26, 'state': 'peering', 'last_fresh': '2024-04-01T16:34:34.078887+0000', 'last_change': '2024-04-01T16:34:53.550415+0000', 'last_active': '2024-04-01T16:34:32.285854+0000', 'last_peered': '2024-04-01T16:34:32.285854+0000', 'last_clean': '2024-04-01T16:34:32.285854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-01T16:34:34.078887+0000', 'last_undegraded': '2024-04-01T16:34:34.078887+0000', 'last_fullsized': '2024-04-01T16:34:34.078887+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 22, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-01T16:34:32.285854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T16:34:32.285854+0000', 'last_clean_scrub_stamp': '2024-04-01T16:34:32.285854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-01T16:34:59.460 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-01T16:34:59.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.703+0000 7f040ac00640 1 Processor -- start 2024-04-01T16:34:59.703 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.703+0000 7f040ac00640 1 -- start start 2024-04-01T16:34:59.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.705+0000 7f040ac00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f040406b540 0x7f040415ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:59.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.705+0000 7f040ac00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0404158200 con 0x7f04040714c0 2024-04-01T16:34:59.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.705+0000 7f040ac00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0404070660 con 0x7f0404157e20 2024-04-01T16:34:59.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.705+0000 7f040ac00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f040415a8d0 con 0x7f040406b540 2024-04-01T16:34:59.705 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.706+0000 7f0408e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f040406b540 0x7f040415ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:59.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.707+0000 7f0409800640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f0404157e20 0x7f04040730f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:45516/0 (socket says 172.21.15.163:45516) 2024-04-01T16:34:59.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.707+0000 7f0409800640 1 -- 172.21.15.163:0/2669668612 learned_addr learned my addr 172.21.15.163:0/2669668612 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:34:59.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.710+0000 7f0408e00640 1 -- 172.21.15.163:0/2669668612 >> v1:172.21.15.189:6789/0 conn(0x7f0404157e20 legacy=0x7f04040730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:59.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.710+0000 7f0408e00640 1 -- 172.21.15.163:0/2669668612 >> v1:172.21.15.163:6789/0 conn(0x7f04040714c0 legacy=0x7f0404165040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:59.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.710+0000 7f0408e00640 1 -- 172.21.15.163:0/2669668612 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040415e720 con 0x7f040406b540 2024-04-01T16:34:59.717 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.717+0000 7f0408e00640 1 --2- 172.21.15.163:0/2669668612 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f040406b540 0x7f040415ad60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f040415aa50 tx=0x7f03f002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07a7448ace978ab server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:59.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.727+0000 7f0403e00640 1 -- 172.21.15.163:0/2669668612 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0034070 con 0x7f040406b540 2024-04-01T16:34:59.727 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.727+0000 7f0403e00640 1 -- 172.21.15.163:0/2669668612 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f0030610 con 0x7f040406b540 2024-04-01T16:34:59.727 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.727+0000 7f0403e00640 1 -- 172.21.15.163:0/2669668612 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f00309e0 con 0x7f040406b540 2024-04-01T16:34:59.727 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.728+0000 7f040ac00640 1 -- 172.21.15.163:0/2669668612 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f040406b540 msgr2=0x7f040415ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:59.728 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.728+0000 7f040ac00640 1 --2- 172.21.15.163:0/2669668612 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f040406b540 0x7f040415ad60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f040415aa50 tx=0x7f03f002b960 comp rx=0 tx=0).stop 2024-04-01T16:34:59.728 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.728+0000 7f040ac00640 1 -- 172.21.15.163:0/2669668612 shutdown_connections 2024-04-01T16:34:59.728 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.728+0000 7f040ac00640 1 --2- 172.21.15.163:0/2669668612 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f040406b540 0x7f040415ad60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:59.728 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.728+0000 7f040ac00640 1 -- 172.21.15.163:0/2669668612 >> 172.21.15.163:0/2669668612 conn(0x7f040406ead0 msgr2=0x7f040406eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:34:59.728 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.728+0000 7f040ac00640 1 -- 172.21.15.163:0/2669668612 shutdown_connections 2024-04-01T16:34:59.728 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.728+0000 7f040ac00640 1 -- 172.21.15.163:0/2669668612 wait complete. 2024-04-01T16:34:59.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.731+0000 7f040ac00640 1 Processor -- start 2024-04-01T16:34:59.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.731+0000 7f040ac00640 1 -- start start 2024-04-01T16:34:59.732 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.733+0000 7f040ac00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f040406b540 0x7f04041f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:59.732 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.733+0000 7f040ac00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04040714c0 0x7f04041e7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:59.732 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.733+0000 7f040ac00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0404157e20 0x7f04040cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:34:59.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.733+0000 7f040ac00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0404070aa0 con 0x7f0404157e20 2024-04-01T16:34:59.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.733+0000 7f040ac00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0404070920 con 0x7f040406b540 2024-04-01T16:34:59.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.733+0000 7f040ac00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f040406bb40 con 0x7f04040714c0 2024-04-01T16:34:59.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.734+0000 7f040a200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0404157e20 0x7f04040cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:59.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.734+0000 7f0409800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f040406b540 0x7f04041f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:59.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.734+0000 7f040a200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0404157e20 0x7f04040cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50744/0 (socket says 172.21.15.163:50744) 2024-04-01T16:34:59.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.735+0000 7f040a200640 1 -- 172.21.15.163:0/313001413 learned_addr learned my addr 172.21.15.163:0/313001413 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:34:59.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.735+0000 7f0408e00640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04040714c0 0x7f04041e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:34:59.738 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.738+0000 7f040a200640 1 -- 172.21.15.163:0/313001413 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04040714c0 msgr2=0x7f04041e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:59.738 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.738+0000 7f040a200640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04040714c0 0x7f04041e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:59.738 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.738+0000 7f040a200640 1 -- 172.21.15.163:0/313001413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f040406b540 msgr2=0x7f04041f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:34:59.738 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.738+0000 7f040a200640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f040406b540 0x7f04041f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:34:59.738 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.738+0000 7f040a200640 1 -- 172.21.15.163:0/313001413 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04041f46b0 con 0x7f0404157e20 2024-04-01T16:34:59.740 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.741+0000 7f040a200640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0404157e20 0x7f04040cd280 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00c730 tx=0x7f03fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:34:59.742 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.743+0000 7f0401600640 1 -- 172.21.15.163:0/313001413 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc003b70 con 0x7f0404157e20 2024-04-01T16:34:59.742 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.743+0000 7f040ac00640 1 -- 172.21.15.163:0/313001413 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04041e5400 con 0x7f0404157e20 2024-04-01T16:34:59.743 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.743+0000 7f040ac00640 1 -- 172.21.15.163:0/313001413 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04041e5980 con 0x7f0404157e20 2024-04-01T16:34:59.744 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.745+0000 7f040ac00640 1 -- 172.21.15.163:0/313001413 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040406be70 con 0x7f0404157e20 2024-04-01T16:34:59.744 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.745+0000 7f0401600640 1 -- 172.21.15.163:0/313001413 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03fc00ce40 con 0x7f0404157e20 2024-04-01T16:34:59.744 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:34:59.745+0000 7f0401600640 1 -- 172.21.15.163:0/313001413 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0017b0 con 0x7f0404157e20 2024-04-01T16:35:00.060 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.061+0000 7f0401600640 1 -- 172.21.15.163:0/313001413 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f03fc00a7f0 con 0x7f0404157e20 2024-04-01T16:35:00.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.062+0000 7f0401600640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f03e406c8f0 0x7f03e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:00.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.063+0000 7f0409800640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f03e406c8f0 0x7f03e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:00.064 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.064+0000 7f0409800640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f03e406c8f0 0x7f03e406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f03f8005880 tx=0x7f03f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:00.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.121+0000 7f0401600640 1 -- 172.21.15.163:0/313001413 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f03fc057f00 con 0x7f0404157e20 2024-04-01T16:35:00.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.122+0000 7f0401600640 1 -- 172.21.15.163:0/313001413 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f03fc020020 con 0x7f0404157e20 2024-04-01T16:35:00.438 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.439+0000 7f040ac00640 1 -- 172.21.15.163:0/313001413 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0404156090 con 0x7f0404157e20 2024-04-01T16:35:00.471 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.471+0000 7f0401600640 1 -- 172.21.15.163:0/313001413 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2818 (secure 0 0 0) 0x7f03fc059e60 con 0x7f0404157e20 2024-04-01T16:35:00.471 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:35:00.472 INFO:teuthology.orchestra.run.smithi163.stdout:{"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":78,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":27,"num_osds":8,"num_up_osds":8,"osd_up_since":1711989244,"num_in_osds":8,"osd_in_since":1711989234,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224874496,"bytes_avail":772869238784,"bytes_total":773094113280},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4270}],"up:standby":5},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-04-01T16:34:53.790368+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-01T16:35:00.474 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.475+0000 7f040ac00640 1 -- 172.21.15.163:0/313001413 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f03e406c8f0 msgr2=0x7f03e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:00.475 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.475+0000 7f040ac00640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f03e406c8f0 0x7f03e406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f03f8005880 tx=0x7f03f8009040 comp rx=0 tx=0).stop 2024-04-01T16:35:00.475 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.475+0000 7f040ac00640 1 -- 172.21.15.163:0/313001413 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0404157e20 msgr2=0x7f04040cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:00.475 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.475+0000 7f040ac00640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0404157e20 0x7f04040cd280 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00c730 tx=0x7f03fc00cbf0 comp rx=0 tx=0).stop 2024-04-01T16:35:00.475 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.475+0000 7f040ac00640 1 -- 172.21.15.163:0/313001413 shutdown_connections 2024-04-01T16:35:00.475 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.475+0000 7f040ac00640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f03e406c8f0 0x7f03e406edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:00.475 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.475+0000 7f040ac00640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0404157e20 0x7f04040cd280 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:00.475 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.475+0000 7f040ac00640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f04040714c0 0x7f04041e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:00.475 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.475+0000 7f040ac00640 1 --2- 172.21.15.163:0/313001413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f040406b540 0x7f04041f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:00.475 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.475+0000 7f040ac00640 1 -- 172.21.15.163:0/313001413 >> 172.21.15.163:0/313001413 conn(0x7f040406ead0 msgr2=0x7f04040c2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:00.475 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.475+0000 7f040ac00640 1 -- 172.21.15.163:0/313001413 shutdown_connections 2024-04-01T16:35:00.475 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.475+0000 7f040ac00640 1 -- 172.21.15.163:0/313001413 wait complete. 2024-04-01T16:35:00.493 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-01T16:35:00.493 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T16:35:00.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.704+0000 7f76d3e00640 1 Processor -- start 2024-04-01T16:35:00.704 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.705+0000 7f76d3e00640 1 -- start start 2024-04-01T16:35:00.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.706+0000 7f76d3e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f76cc0710c0 0x7f76cc0ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:00.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.706+0000 7f76d3e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f76cc0ce900 0x7f76cc15bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:00.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.706+0000 7f76d3e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76cc06c560 con 0x7f76cc154b90 2024-04-01T16:35:00.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.706+0000 7f76d3e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f76cc0714e0 con 0x7f76cc0710c0 2024-04-01T16:35:00.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.706+0000 7f76d3e00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f76cc06c820 con 0x7f76cc0ce900 2024-04-01T16:35:00.706 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.707+0000 7f76d0a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f76cc0710c0 0x7f76cc0ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:00.707 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.708+0000 7f76d1e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f76cc0ce900 0x7f76cc15bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:00.707 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.708+0000 7f76d0a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f76cc0710c0 0x7f76cc0ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50750/0 (socket says 172.21.15.163:50750) 2024-04-01T16:35:00.707 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.708+0000 7f76d0a00640 1 -- 172.21.15.163:0/4189649130 learned_addr learned my addr 172.21.15.163:0/4189649130 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:00.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.711+0000 7f76d0a00640 1 -- 172.21.15.163:0/4189649130 >> v2:172.21.15.189:3300/0 conn(0x7f76cc0ce900 msgr2=0x7f76cc15bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:00.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.711+0000 7f76d0a00640 1 --2- 172.21.15.163:0/4189649130 >> v2:172.21.15.189:3300/0 conn(0x7f76cc0ce900 0x7f76cc15bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:00.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.711+0000 7f76d0a00640 1 -- 172.21.15.163:0/4189649130 >> v1:172.21.15.163:6789/0 conn(0x7f76cc154b90 legacy=0x7f76cc15e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:00.710 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.711+0000 7f76d0a00640 1 -- 172.21.15.163:0/4189649130 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc06cb00 con 0x7f76cc0710c0 2024-04-01T16:35:00.715 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.716+0000 7f76d0a00640 1 --2- 172.21.15.163:0/4189649130 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0710c0 0x7f76cc0ce3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0719c0 tx=0x7f76b802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72af7644f076e29 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:00.721 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.722+0000 7f76cbe00640 1 -- 172.21.15.163:0/4189649130 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b802f850 con 0x7f76cc0710c0 2024-04-01T16:35:00.722 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.722+0000 7f76cbe00640 1 -- 172.21.15.163:0/4189649130 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b802f9f0 con 0x7f76cc0710c0 2024-04-01T16:35:00.722 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.722+0000 7f76cbe00640 1 -- 172.21.15.163:0/4189649130 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b802fdc0 con 0x7f76cc0710c0 2024-04-01T16:35:00.722 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.723+0000 7f76d3e00640 1 -- 172.21.15.163:0/4189649130 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0710c0 msgr2=0x7f76cc0ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:00.722 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.723+0000 7f76d3e00640 1 --2- 172.21.15.163:0/4189649130 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0710c0 0x7f76cc0ce3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0719c0 tx=0x7f76b802ba30 comp rx=0 tx=0).stop 2024-04-01T16:35:00.723 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.723+0000 7f76d3e00640 1 -- 172.21.15.163:0/4189649130 shutdown_connections 2024-04-01T16:35:00.723 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.723+0000 7f76d3e00640 1 --2- 172.21.15.163:0/4189649130 >> v2:172.21.15.189:3300/0 conn(0x7f76cc0ce900 0x7f76cc15bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:00.723 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.723+0000 7f76d3e00640 1 --2- 172.21.15.163:0/4189649130 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0710c0 0x7f76cc0ce3c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:00.723 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.723+0000 7f76d3e00640 1 -- 172.21.15.163:0/4189649130 >> 172.21.15.163:0/4189649130 conn(0x7f76cc0676a0 msgr2=0x7f76cc067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:00.723 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.723+0000 7f76d3e00640 1 -- 172.21.15.163:0/4189649130 shutdown_connections 2024-04-01T16:35:00.723 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.723+0000 7f76d3e00640 1 -- 172.21.15.163:0/4189649130 wait complete. 2024-04-01T16:35:00.724 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.725+0000 7f76d3e00640 1 Processor -- start 2024-04-01T16:35:00.724 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.725+0000 7f76d3e00640 1 -- start start 2024-04-01T16:35:00.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.726+0000 7f76d3e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f76cc0710c0 0x7f76cc0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:00.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.726+0000 7f76d3e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ce900 0x7f76cc1f1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:00.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.726+0000 7f76d3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76cc154b90 0x7f76cc14e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:00.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.726+0000 7f76d3e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc06d3a0 con 0x7f76cc0ce900 2024-04-01T16:35:00.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.726+0000 7f76d3e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc06d0c0 con 0x7f76cc154b90 2024-04-01T16:35:00.726 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.726+0000 7f76d3e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f76cc15c4e0 con 0x7f76cc0710c0 2024-04-01T16:35:00.727 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.727+0000 7f76d0a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ce900 0x7f76cc1f1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:00.727 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.727+0000 7f76d0a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ce900 0x7f76cc1f1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50764/0 (socket says 172.21.15.163:50764) 2024-04-01T16:35:00.727 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.727+0000 7f76d0a00640 1 -- 172.21.15.163:0/909912057 learned_addr learned my addr 172.21.15.163:0/909912057 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:00.727 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.728+0000 7f76d1e00640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76cc154b90 0x7f76cc14e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:00.727 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.728+0000 7f76d1400640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f76cc0710c0 0x7f76cc0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:00.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.731+0000 7f76d0a00640 1 -- 172.21.15.163:0/909912057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f76cc0710c0 msgr2=0x7f76cc0c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:00.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.731+0000 7f76d0a00640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f76cc0710c0 0x7f76cc0c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:00.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.731+0000 7f76d0a00640 1 -- 172.21.15.163:0/909912057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76cc154b90 msgr2=0x7f76cc14e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:00.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.731+0000 7f76d0a00640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76cc154b90 0x7f76cc14e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:00.731 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.731+0000 7f76d0a00640 1 -- 172.21.15.163:0/909912057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc0c68f0 con 0x7f76cc0ce900 2024-04-01T16:35:00.733 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.734+0000 7f76d0a00640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ce900 0x7f76cc1f1500 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f76b80090b0 tx=0x7f76b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:00.738 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.738+0000 7f76c9600640 1 -- 172.21.15.163:0/909912057 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8037c80 con 0x7f76cc0ce900 2024-04-01T16:35:00.738 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.738+0000 7f76c9600640 1 -- 172.21.15.163:0/909912057 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b8047070 con 0x7f76cc0ce900 2024-04-01T16:35:00.738 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.738+0000 7f76c9600640 1 -- 172.21.15.163:0/909912057 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b80426c0 con 0x7f76cc0ce900 2024-04-01T16:35:00.738 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.738+0000 7f76d3e00640 1 -- 172.21.15.163:0/909912057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76cc0c6bb0 con 0x7f76cc0ce900 2024-04-01T16:35:00.738 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.739+0000 7f76d3e00640 1 -- 172.21.15.163:0/909912057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76cc0c56f0 con 0x7f76cc0ce900 2024-04-01T16:35:00.739 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.740+0000 7f76d3e00640 1 -- 172.21.15.163:0/909912057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76cc06e7e0 con 0x7f76cc0ce900 2024-04-01T16:35:00.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.942+0000 7f76c9600640 1 -- 172.21.15.163:0/909912057 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f76b8040050 con 0x7f76cc0ce900 2024-04-01T16:35:00.943 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.944+0000 7f76c9600640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f76ac06c940 0x7f76ac06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:00.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.945+0000 7f76d1400640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f76ac06c940 0x7f76ac06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:00.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:00.946+0000 7f76d1400640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f76ac06c940 0x7f76ac06ee00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0016e0 tx=0x7f76bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:01.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.079+0000 7f76c9600640 1 -- 172.21.15.163:0/909912057 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f76b807af50 con 0x7f76cc0ce900 2024-04-01T16:35:01.080 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.080+0000 7f76c9600640 1 -- 172.21.15.163:0/909912057 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f76b8033030 con 0x7f76cc0ce900 2024-04-01T16:35:01.284 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.284+0000 7f76d3e00640 1 -- 172.21.15.163:0/909912057 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76cc0756d0 con 0x7f76ac06c940 2024-04-01T16:35:01.292 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.293+0000 7f76c9600640 1 -- 172.21.15.163:0/909912057 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251933 (secure 0 0 0) 0x7f76cc0756d0 con 0x7f76ac06c940 2024-04-01T16:35:01.295 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:35:01.298 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T16:35:01.300 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.300+0000 7f76d3e00640 1 -- 172.21.15.163:0/909912057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f76ac06c940 msgr2=0x7f76ac06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:01.300 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.301+0000 7f76d3e00640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f76ac06c940 0x7f76ac06ee00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0016e0 tx=0x7f76bc009040 comp rx=0 tx=0).stop 2024-04-01T16:35:01.300 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.301+0000 7f76d3e00640 1 -- 172.21.15.163:0/909912057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ce900 msgr2=0x7f76cc1f1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:01.300 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.301+0000 7f76d3e00640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ce900 0x7f76cc1f1500 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f76b80090b0 tx=0x7f76b80046c0 comp rx=0 tx=0).stop 2024-04-01T16:35:01.301 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.301+0000 7f76d3e00640 1 -- 172.21.15.163:0/909912057 shutdown_connections 2024-04-01T16:35:01.301 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.301+0000 7f76d3e00640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f76ac06c940 0x7f76ac06ee00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:01.301 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.301+0000 7f76d3e00640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76cc154b90 0x7f76cc14e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:01.301 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.301+0000 7f76d3e00640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ce900 0x7f76cc1f1500 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:01.301 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.301+0000 7f76d3e00640 1 --2- 172.21.15.163:0/909912057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f76cc0710c0 0x7f76cc0c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:01.301 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.301+0000 7f76d3e00640 1 -- 172.21.15.163:0/909912057 >> 172.21.15.163:0/909912057 conn(0x7f76cc0676a0 msgr2=0x7f76cc149b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:01.301 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.301+0000 7f76d3e00640 1 -- 172.21.15.163:0/909912057 shutdown_connections 2024-04-01T16:35:01.301 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:01.301+0000 7f76d3e00640 1 -- 172.21.15.163:0/909912057 wait complete. 2024-04-01T16:35:01.320 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-04-01T16:34:59.792405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219604,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755116,"statfs":{"total":773094113280,"available":772869238784,"internally_reserved":0,"allocated":3514368,"data_stored":2040676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002800"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543600+0000","last_change":"2024-04-01T16:34:34.033508+0000","last_active":"2024-04-01T16:34:54.543600+0000","last_peered":"2024-04-01T16:34:54.543600+0000","last_clean":"2024-04-01T16:34:54.543600+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T16:34:54.543600+0000","last_undegraded":"2024-04-01T16:34:54.543600+0000","last_fullsized":"2024-04-01T16:34:54.543600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507263+0000","last_change":"2024-04-01T16:34:34.065375+0000","last_active":"2024-04-01T16:34:54.507263+0000","last_peered":"2024-04-01T16:34:54.507263+0000","last_clean":"2024-04-01T16:34:54.507263+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T16:34:54.507263+0000","last_undegraded":"2024-04-01T16:34:54.507263+0000","last_fullsized":"2024-04-01T16:34:54.507263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002160+0000","last_change":"2024-04-01T16:34:34.084618+0000","last_active":"2024-04-01T16:34:55.002160+0000","last_peered":"2024-04-01T16:34:55.002160+0000","last_clean":"2024-04-01T16:34:55.002160+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T16:34:55.002160+0000","last_undegraded":"2024-04-01T16:34:55.002160+0000","last_fullsized":"2024-04-01T16:34:55.002160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:43.530081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010013+0000","last_change":"2024-04-01T16:34:34.088694+0000","last_active":"2024-04-01T16:34:55.010013+0000","last_peered":"2024-04-01T16:34:55.010013+0000","last_clean":"2024-04-01T16:34:55.010013+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T16:34:55.010013+0000","last_undegraded":"2024-04-01T16:34:55.010013+0000","last_fullsized":"2024-04-01T16:34:55.010013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542768+0000","last_change":"2024-04-01T16:34:34.085765+0000","last_active":"2024-04-01T16:34:54.542768+0000","last_peered":"2024-04-01T16:34:54.542768+0000","last_clean":"2024-04-01T16:34:54.542768+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T16:34:54.542768+0000","last_undegraded":"2024-04-01T16:34:54.542768+0000","last_fullsized":"2024-04-01T16:34:54.542768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009741+0000","last_change":"2024-04-01T16:34:34.066150+0000","last_active":"2024-04-01T16:34:55.009741+0000","last_peered":"2024-04-01T16:34:55.009741+0000","last_clean":"2024-04-01T16:34:55.009741+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T16:34:55.009741+0000","last_undegraded":"2024-04-01T16:34:55.009741+0000","last_fullsized":"2024-04-01T16:34:55.009741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:08:56.651785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542643+0000","last_change":"2024-04-01T16:34:34.072924+0000","last_active":"2024-04-01T16:34:54.542643+0000","last_peered":"2024-04-01T16:34:54.542643+0000","last_clean":"2024-04-01T16:34:54.542643+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T16:34:54.542643+0000","last_undegraded":"2024-04-01T16:34:54.542643+0000","last_fullsized":"2024-04-01T16:34:54.542643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500391+0000","last_change":"2024-04-01T16:34:34.088361+0000","last_active":"2024-04-01T16:34:54.500391+0000","last_peered":"2024-04-01T16:34:54.500391+0000","last_clean":"2024-04-01T16:34:54.500391+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T16:34:54.500391+0000","last_undegraded":"2024-04-01T16:34:54.500391+0000","last_fullsized":"2024-04-01T16:34:54.500391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543787+0000","last_change":"2024-04-01T16:34:34.038534+0000","last_active":"2024-04-01T16:34:54.543787+0000","last_peered":"2024-04-01T16:34:54.543787+0000","last_clean":"2024-04-01T16:34:54.543787+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T16:34:54.543787+0000","last_undegraded":"2024-04-01T16:34:54.543787+0000","last_fullsized":"2024-04-01T16:34:54.543787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:54.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503700+0000","last_change":"2024-04-01T16:34:34.040513+0000","last_active":"2024-04-01T16:34:54.503700+0000","last_peered":"2024-04-01T16:34:54.503700+0000","last_clean":"2024-04-01T16:34:54.503700+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T16:34:54.503700+0000","last_undegraded":"2024-04-01T16:34:54.503700+0000","last_fullsized":"2024-04-01T16:34:54.503700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503534+0000","last_change":"2024-04-01T16:34:34.038167+0000","last_active":"2024-04-01T16:34:54.503534+0000","last_peered":"2024-04-01T16:34:54.503534+0000","last_clean":"2024-04-01T16:34:54.503534+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T16:34:54.503534+0000","last_undegraded":"2024-04-01T16:34:54.503534+0000","last_fullsized":"2024-04-01T16:34:54.503534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008124+0000","last_change":"2024-04-01T16:34:34.035177+0000","last_active":"2024-04-01T16:34:55.008124+0000","last_peered":"2024-04-01T16:34:55.008124+0000","last_clean":"2024-04-01T16:34:55.008124+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T16:34:55.008124+0000","last_undegraded":"2024-04-01T16:34:55.008124+0000","last_fullsized":"2024-04-01T16:34:55.008124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:37.711846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500735+0000","last_change":"2024-04-01T16:34:34.086031+0000","last_active":"2024-04-01T16:34:54.500735+0000","last_peered":"2024-04-01T16:34:54.500735+0000","last_clean":"2024-04-01T16:34:54.500735+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T16:34:54.500735+0000","last_undegraded":"2024-04-01T16:34:54.500735+0000","last_fullsized":"2024-04-01T16:34:54.500735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.001512+0000","last_change":"2024-04-01T16:34:34.071535+0000","last_active":"2024-04-01T16:34:55.001512+0000","last_peered":"2024-04-01T16:34:55.001512+0000","last_clean":"2024-04-01T16:34:55.001512+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T16:34:55.001512+0000","last_undegraded":"2024-04-01T16:34:55.001512+0000","last_fullsized":"2024-04-01T16:34:55.001512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:45.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507709+0000","last_change":"2024-04-01T16:34:33.904701+0000","last_active":"2024-04-01T16:34:54.507709+0000","last_peered":"2024-04-01T16:34:54.507709+0000","last_clean":"2024-04-01T16:34:54.507709+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T16:34:54.507709+0000","last_undegraded":"2024-04-01T16:34:54.507709+0000","last_fullsized":"2024-04-01T16:34:54.507709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009278+0000","last_change":"2024-04-01T16:34:34.064695+0000","last_active":"2024-04-01T16:34:55.009278+0000","last_peered":"2024-04-01T16:34:55.009278+0000","last_clean":"2024-04-01T16:34:55.009278+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T16:34:55.009278+0000","last_undegraded":"2024-04-01T16:34:55.009278+0000","last_fullsized":"2024-04-01T16:34:55.009278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.798148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010268+0000","last_change":"2024-04-01T16:34:34.032994+0000","last_active":"2024-04-01T16:34:55.010268+0000","last_peered":"2024-04-01T16:34:55.010268+0000","last_clean":"2024-04-01T16:34:55.010268+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T16:34:55.010268+0000","last_undegraded":"2024-04-01T16:34:55.010268+0000","last_fullsized":"2024-04-01T16:34:55.010268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504087+0000","last_change":"2024-04-01T16:34:34.082238+0000","last_active":"2024-04-01T16:34:54.504087+0000","last_peered":"2024-04-01T16:34:54.504087+0000","last_clean":"2024-04-01T16:34:54.504087+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T16:34:54.504087+0000","last_undegraded":"2024-04-01T16:34:54.504087+0000","last_fullsized":"2024-04-01T16:34:54.504087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543579+0000","last_change":"2024-04-01T16:34:34.083056+0000","last_active":"2024-04-01T16:34:54.543579+0000","last_peered":"2024-04-01T16:34:54.543579+0000","last_clean":"2024-04-01T16:34:54.543579+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T16:34:54.543579+0000","last_undegraded":"2024-04-01T16:34:54.543579+0000","last_fullsized":"2024-04-01T16:34:54.543579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503181+0000","last_change":"2024-04-01T16:34:34.034017+0000","last_active":"2024-04-01T16:34:54.503181+0000","last_peered":"2024-04-01T16:34:54.503181+0000","last_clean":"2024-04-01T16:34:54.503181+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T16:34:54.503181+0000","last_undegraded":"2024-04-01T16:34:54.503181+0000","last_fullsized":"2024-04-01T16:34:54.503181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:33.976417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002286+0000","last_change":"2024-04-01T16:34:34.068541+0000","last_active":"2024-04-01T16:34:55.002286+0000","last_peered":"2024-04-01T16:34:55.002286+0000","last_clean":"2024-04-01T16:34:55.002286+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T16:34:55.002286+0000","last_undegraded":"2024-04-01T16:34:55.002286+0000","last_fullsized":"2024-04-01T16:34:55.002286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:29.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009827+0000","last_change":"2024-04-01T16:34:34.031774+0000","last_active":"2024-04-01T16:34:55.009827+0000","last_peered":"2024-04-01T16:34:55.009827+0000","last_clean":"2024-04-01T16:34:55.009827+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T16:34:55.009827+0000","last_undegraded":"2024-04-01T16:34:55.009827+0000","last_fullsized":"2024-04-01T16:34:55.009827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:39.294525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500493+0000","last_change":"2024-04-01T16:34:34.090324+0000","last_active":"2024-04-01T16:34:54.500493+0000","last_peered":"2024-04-01T16:34:54.500493+0000","last_clean":"2024-04-01T16:34:54.500493+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T16:34:54.500493+0000","last_undegraded":"2024-04-01T16:34:54.500493+0000","last_fullsized":"2024-04-01T16:34:54.500493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:55:40.168021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008960+0000","last_change":"2024-04-01T16:34:34.083544+0000","last_active":"2024-04-01T16:34:55.008960+0000","last_peered":"2024-04-01T16:34:55.008960+0000","last_clean":"2024-04-01T16:34:55.008960+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T16:34:55.008960+0000","last_undegraded":"2024-04-01T16:34:55.008960+0000","last_fullsized":"2024-04-01T16:34:55.008960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.501281+0000","last_change":"2024-04-01T16:34:34.090721+0000","last_active":"2024-04-01T16:34:54.501281+0000","last_peered":"2024-04-01T16:34:54.501281+0000","last_clean":"2024-04-01T16:34:54.501281+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T16:34:54.501281+0000","last_undegraded":"2024-04-01T16:34:54.501281+0000","last_fullsized":"2024-04-01T16:34:54.501281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.510600+0000","last_change":"2024-04-01T16:34:54.510600+0000","last_active":"2024-04-01T16:34:54.510600+0000","last_peered":"2024-04-01T16:34:54.510600+0000","last_clean":"2024-04-01T16:34:54.510600+0000","last_became_active":"2024-04-01T16:34:54.510173+0000","last_became_peered":"2024-04-01T16:34:54.510173+0000","last_unstale":"2024-04-01T16:34:54.510600+0000","last_undegraded":"2024-04-01T16:34:54.510600+0000","last_fullsized":"2024-04-01T16:34:54.510600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507313+0000","last_change":"2024-04-01T16:34:34.091911+0000","last_active":"2024-04-01T16:34:54.507313+0000","last_peered":"2024-04-01T16:34:54.507313+0000","last_clean":"2024-04-01T16:34:54.507313+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T16:34:54.507313+0000","last_undegraded":"2024-04-01T16:34:54.507313+0000","last_fullsized":"2024-04-01T16:34:54.507313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500864+0000","last_change":"2024-04-01T16:34:34.091540+0000","last_active":"2024-04-01T16:34:54.500864+0000","last_peered":"2024-04-01T16:34:54.500864+0000","last_clean":"2024-04-01T16:34:54.500864+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T16:34:54.500864+0000","last_undegraded":"2024-04-01T16:34:54.500864+0000","last_fullsized":"2024-04-01T16:34:54.500864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002349+0000","last_change":"2024-04-01T16:34:34.087634+0000","last_active":"2024-04-01T16:34:55.002349+0000","last_peered":"2024-04-01T16:34:55.002349+0000","last_clean":"2024-04-01T16:34:55.002349+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T16:34:55.002349+0000","last_undegraded":"2024-04-01T16:34:55.002349+0000","last_fullsized":"2024-04-01T16:34:55.002349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:12.994756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009994+0000","last_change":"2024-04-01T16:34:34.084026+0000","last_active":"2024-04-01T16:34:55.009994+0000","last_peered":"2024-04-01T16:34:55.009994+0000","last_clean":"2024-04-01T16:34:55.009994+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T16:34:55.009994+0000","last_undegraded":"2024-04-01T16:34:55.009994+0000","last_fullsized":"2024-04-01T16:34:55.009994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503763+0000","last_change":"2024-04-01T16:34:34.088300+0000","last_active":"2024-04-01T16:34:54.503763+0000","last_peered":"2024-04-01T16:34:54.503763+0000","last_clean":"2024-04-01T16:34:54.503763+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T16:34:54.503763+0000","last_undegraded":"2024-04-01T16:34:54.503763+0000","last_fullsized":"2024-04-01T16:34:54.503763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503052+0000","last_change":"2024-04-01T16:34:34.068348+0000","last_active":"2024-04-01T16:34:54.503052+0000","last_peered":"2024-04-01T16:34:54.503052+0000","last_clean":"2024-04-01T16:34:54.503052+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T16:34:54.503052+0000","last_undegraded":"2024-04-01T16:34:54.503052+0000","last_fullsized":"2024-04-01T16:34:54.503052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010349+0000","last_change":"2024-04-01T16:34:33.901019+0000","last_active":"2024-04-01T16:34:55.010349+0000","last_peered":"2024-04-01T16:34:55.010349+0000","last_clean":"2024-04-01T16:34:55.010349+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T16:34:55.010349+0000","last_undegraded":"2024-04-01T16:34:55.010349+0000","last_fullsized":"2024-04-01T16:34:55.010349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:08:37.254438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.501042+0000","last_change":"2024-04-01T16:34:31.489434+0000","last_active":"2024-04-01T16:34:54.501042+0000","last_peered":"2024-04-01T16:34:54.501042+0000","last_clean":"2024-04-01T16:34:54.501042+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T16:34:54.501042+0000","last_undegraded":"2024-04-01T16:34:54.501042+0000","last_fullsized":"2024-04-01T16:34:54.501042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002555+0000","last_change":"2024-04-01T16:34:34.065342+0000","last_active":"2024-04-01T16:34:55.002555+0000","last_peered":"2024-04-01T16:34:55.002555+0000","last_clean":"2024-04-01T16:34:55.002555+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T16:34:55.002555+0000","last_undegraded":"2024-04-01T16:34:55.002555+0000","last_fullsized":"2024-04-01T16:34:55.002555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:56.911106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.502921+0000","last_change":"2024-04-01T16:34:31.530201+0000","last_active":"2024-04-01T16:34:54.502921+0000","last_peered":"2024-04-01T16:34:54.502921+0000","last_clean":"2024-04-01T16:34:54.502921+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T16:34:54.502921+0000","last_undegraded":"2024-04-01T16:34:54.502921+0000","last_fullsized":"2024-04-01T16:34:54.502921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.501594+0000","last_change":"2024-04-01T16:34:31.528238+0000","last_active":"2024-04-01T16:34:54.501594+0000","last_peered":"2024-04-01T16:34:54.501594+0000","last_clean":"2024-04-01T16:34:54.501594+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T16:34:54.501594+0000","last_undegraded":"2024-04-01T16:34:54.501594+0000","last_fullsized":"2024-04-01T16:34:54.501594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500402+0000","last_change":"2024-04-01T16:34:34.091302+0000","last_active":"2024-04-01T16:34:54.500402+0000","last_peered":"2024-04-01T16:34:54.500402+0000","last_clean":"2024-04-01T16:34:54.500402+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T16:34:54.500402+0000","last_undegraded":"2024-04-01T16:34:54.500402+0000","last_fullsized":"2024-04-01T16:34:54.500402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009229+0000","last_change":"2024-04-01T16:34:31.567946+0000","last_active":"2024-04-01T16:34:55.009229+0000","last_peered":"2024-04-01T16:34:55.009229+0000","last_clean":"2024-04-01T16:34:55.009229+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T16:34:55.009229+0000","last_undegraded":"2024-04-01T16:34:55.009229+0000","last_fullsized":"2024-04-01T16:34:55.009229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507905+0000","last_change":"2024-04-01T16:34:34.088894+0000","last_active":"2024-04-01T16:34:54.507905+0000","last_peered":"2024-04-01T16:34:54.507905+0000","last_clean":"2024-04-01T16:34:54.507905+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T16:34:54.507905+0000","last_undegraded":"2024-04-01T16:34:54.507905+0000","last_fullsized":"2024-04-01T16:34:54.507905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504022+0000","last_change":"2024-04-01T16:34:31.566997+0000","last_active":"2024-04-01T16:34:54.504022+0000","last_peered":"2024-04-01T16:34:54.504022+0000","last_clean":"2024-04-01T16:34:54.504022+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T16:34:54.504022+0000","last_undegraded":"2024-04-01T16:34:54.504022+0000","last_fullsized":"2024-04-01T16:34:54.504022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010465+0000","last_change":"2024-04-01T16:34:34.030831+0000","last_active":"2024-04-01T16:34:55.010465+0000","last_peered":"2024-04-01T16:34:55.010465+0000","last_clean":"2024-04-01T16:34:55.010465+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T16:34:55.010465+0000","last_undegraded":"2024-04-01T16:34:55.010465+0000","last_fullsized":"2024-04-01T16:34:55.010465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010568+0000","last_change":"2024-04-01T16:34:31.569927+0000","last_active":"2024-04-01T16:34:55.010568+0000","last_peered":"2024-04-01T16:34:55.010568+0000","last_clean":"2024-04-01T16:34:55.010568+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T16:34:55.010568+0000","last_undegraded":"2024-04-01T16:34:55.010568+0000","last_fullsized":"2024-04-01T16:34:55.010568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:41.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002879+0000","last_change":"2024-04-01T16:34:34.068959+0000","last_active":"2024-04-01T16:34:55.002879+0000","last_peered":"2024-04-01T16:34:55.002879+0000","last_clean":"2024-04-01T16:34:55.002879+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T16:34:55.002879+0000","last_undegraded":"2024-04-01T16:34:55.002879+0000","last_fullsized":"2024-04-01T16:34:55.002879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:58:57.685708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507455+0000","last_change":"2024-04-01T16:34:31.562792+0000","last_active":"2024-04-01T16:34:54.507455+0000","last_peered":"2024-04-01T16:34:54.507455+0000","last_clean":"2024-04-01T16:34:54.507455+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T16:34:54.507455+0000","last_undegraded":"2024-04-01T16:34:54.507455+0000","last_fullsized":"2024-04-01T16:34:54.507455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:55.684911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008845+0000","last_change":"2024-04-01T16:34:33.916652+0000","last_active":"2024-04-01T16:34:55.008845+0000","last_peered":"2024-04-01T16:34:55.008845+0000","last_clean":"2024-04-01T16:34:55.008845+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T16:34:55.008845+0000","last_undegraded":"2024-04-01T16:34:55.008845+0000","last_fullsized":"2024-04-01T16:34:55.008845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503068+0000","last_change":"2024-04-01T16:34:31.531366+0000","last_active":"2024-04-01T16:34:54.503068+0000","last_peered":"2024-04-01T16:34:54.503068+0000","last_clean":"2024-04-01T16:34:54.503068+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T16:34:54.503068+0000","last_undegraded":"2024-04-01T16:34:54.503068+0000","last_fullsized":"2024-04-01T16:34:54.503068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543193+0000","last_change":"2024-04-01T16:34:34.085449+0000","last_active":"2024-04-01T16:34:54.543193+0000","last_peered":"2024-04-01T16:34:54.543193+0000","last_clean":"2024-04-01T16:34:54.543193+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T16:34:54.543193+0000","last_undegraded":"2024-04-01T16:34:54.543193+0000","last_fullsized":"2024-04-01T16:34:54.543193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002803+0000","last_change":"2024-04-01T16:34:31.444458+0000","last_active":"2024-04-01T16:34:55.002803+0000","last_peered":"2024-04-01T16:34:55.002803+0000","last_clean":"2024-04-01T16:34:55.002803+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T16:34:55.002803+0000","last_undegraded":"2024-04-01T16:34:55.002803+0000","last_fullsized":"2024-04-01T16:34:55.002803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.001912+0000","last_change":"2024-04-01T16:34:34.071521+0000","last_active":"2024-04-01T16:34:55.001912+0000","last_peered":"2024-04-01T16:34:55.001912+0000","last_clean":"2024-04-01T16:34:55.001912+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T16:34:55.001912+0000","last_undegraded":"2024-04-01T16:34:55.001912+0000","last_fullsized":"2024-04-01T16:34:55.001912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:36:13.618956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010073+0000","last_change":"2024-04-01T16:34:31.566202+0000","last_active":"2024-04-01T16:34:55.010073+0000","last_peered":"2024-04-01T16:34:55.010073+0000","last_clean":"2024-04-01T16:34:55.010073+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T16:34:55.010073+0000","last_undegraded":"2024-04-01T16:34:55.010073+0000","last_fullsized":"2024-04-01T16:34:55.010073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:54.543283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543363+0000","last_change":"2024-04-01T16:34:33.930561+0000","last_active":"2024-04-01T16:34:54.543363+0000","last_peered":"2024-04-01T16:34:54.543363+0000","last_clean":"2024-04-01T16:34:54.543363+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T16:34:54.543363+0000","last_undegraded":"2024-04-01T16:34:54.543363+0000","last_fullsized":"2024-04-01T16:34:54.543363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.502718+0000","last_change":"2024-04-01T16:34:31.535895+0000","last_active":"2024-04-01T16:34:54.502718+0000","last_peered":"2024-04-01T16:34:54.502718+0000","last_clean":"2024-04-01T16:34:54.502718+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T16:34:54.502718+0000","last_undegraded":"2024-04-01T16:34:54.502718+0000","last_fullsized":"2024-04-01T16:34:54.502718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:36:43.780845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.502790+0000","last_change":"2024-04-01T16:34:34.068194+0000","last_active":"2024-04-01T16:34:54.502790+0000","last_peered":"2024-04-01T16:34:54.502790+0000","last_clean":"2024-04-01T16:34:54.502790+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T16:34:54.502790+0000","last_undegraded":"2024-04-01T16:34:54.502790+0000","last_fullsized":"2024-04-01T16:34:54.502790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503806+0000","last_change":"2024-04-01T16:34:31.515495+0000","last_active":"2024-04-01T16:34:54.503806+0000","last_peered":"2024-04-01T16:34:54.503806+0000","last_clean":"2024-04-01T16:34:54.503806+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T16:34:54.503806+0000","last_undegraded":"2024-04-01T16:34:54.503806+0000","last_fullsized":"2024-04-01T16:34:54.503806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:26:56.217819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542753+0000","last_change":"2024-04-01T16:34:33.926318+0000","last_active":"2024-04-01T16:34:54.542753+0000","last_peered":"2024-04-01T16:34:54.542753+0000","last_clean":"2024-04-01T16:34:54.542753+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T16:34:54.542753+0000","last_undegraded":"2024-04-01T16:34:54.542753+0000","last_fullsized":"2024-04-01T16:34:54.542753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009730+0000","last_change":"2024-04-01T16:34:31.440349+0000","last_active":"2024-04-01T16:34:55.009730+0000","last_peered":"2024-04-01T16:34:55.009730+0000","last_clean":"2024-04-01T16:34:55.009730+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T16:34:55.009730+0000","last_undegraded":"2024-04-01T16:34:55.009730+0000","last_fullsized":"2024-04-01T16:34:55.009730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:29.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542735+0000","last_change":"2024-04-01T16:34:33.931211+0000","last_active":"2024-04-01T16:34:54.542735+0000","last_peered":"2024-04-01T16:34:54.542735+0000","last_clean":"2024-04-01T16:34:54.542735+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T16:34:54.542735+0000","last_undegraded":"2024-04-01T16:34:54.542735+0000","last_fullsized":"2024-04-01T16:34:54.542735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:15:45.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504196+0000","last_change":"2024-04-01T16:34:31.512433+0000","last_active":"2024-04-01T16:34:54.504196+0000","last_peered":"2024-04-01T16:34:54.504196+0000","last_clean":"2024-04-01T16:34:54.504196+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T16:34:54.504196+0000","last_undegraded":"2024-04-01T16:34:54.504196+0000","last_fullsized":"2024-04-01T16:34:54.504196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:16.032012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543722+0000","last_change":"2024-04-01T16:34:33.930791+0000","last_active":"2024-04-01T16:34:54.543722+0000","last_peered":"2024-04-01T16:34:54.543722+0000","last_clean":"2024-04-01T16:34:54.543722+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T16:34:54.543722+0000","last_undegraded":"2024-04-01T16:34:54.543722+0000","last_fullsized":"2024-04-01T16:34:54.543722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:53.102054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.508092+0000","last_change":"2024-04-01T16:34:31.509375+0000","last_active":"2024-04-01T16:34:54.508092+0000","last_peered":"2024-04-01T16:34:54.508092+0000","last_clean":"2024-04-01T16:34:54.508092+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T16:34:54.508092+0000","last_undegraded":"2024-04-01T16:34:54.508092+0000","last_fullsized":"2024-04-01T16:34:54.508092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010186+0000","last_change":"2024-04-01T16:34:34.085219+0000","last_active":"2024-04-01T16:34:55.010186+0000","last_peered":"2024-04-01T16:34:55.010186+0000","last_clean":"2024-04-01T16:34:55.010186+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T16:34:55.010186+0000","last_undegraded":"2024-04-01T16:34:55.010186+0000","last_fullsized":"2024-04-01T16:34:55.010186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504130+0000","last_change":"2024-04-01T16:34:31.562761+0000","last_active":"2024-04-01T16:34:54.504130+0000","last_peered":"2024-04-01T16:34:54.504130+0000","last_clean":"2024-04-01T16:34:54.504130+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T16:34:54.504130+0000","last_undegraded":"2024-04-01T16:34:54.504130+0000","last_fullsized":"2024-04-01T16:34:54.504130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:23:33.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543747+0000","last_change":"2024-04-01T16:34:34.039521+0000","last_active":"2024-04-01T16:34:54.543747+0000","last_peered":"2024-04-01T16:34:54.543747+0000","last_clean":"2024-04-01T16:34:54.543747+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T16:34:54.543747+0000","last_undegraded":"2024-04-01T16:34:54.543747+0000","last_fullsized":"2024-04-01T16:34:54.543747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543415+0000","last_change":"2024-04-01T16:34:08.195697+0000","last_active":"2024-04-01T16:34:54.543415+0000","last_peered":"2024-04-01T16:34:54.543415+0000","last_clean":"2024-04-01T16:34:54.543415+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T16:34:54.543415+0000","last_undegraded":"2024-04-01T16:34:54.543415+0000","last_fullsized":"2024-04-01T16:34:54.543415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_clean_scrub_stamp":"2024-04-01T16:34:06.247737+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:05:51.067541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009900+0000","last_change":"2024-04-01T16:34:31.569697+0000","last_active":"2024-04-01T16:34:55.009900+0000","last_peered":"2024-04-01T16:34:55.009900+0000","last_clean":"2024-04-01T16:34:55.009900+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T16:34:55.009900+0000","last_undegraded":"2024-04-01T16:34:55.009900+0000","last_fullsized":"2024-04-01T16:34:55.009900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.736852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500620+0000","last_change":"2024-04-01T16:34:34.087298+0000","last_active":"2024-04-01T16:34:54.500620+0000","last_peered":"2024-04-01T16:34:54.500620+0000","last_clean":"2024-04-01T16:34:54.500620+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T16:34:54.500620+0000","last_undegraded":"2024-04-01T16:34:54.500620+0000","last_fullsized":"2024-04-01T16:34:54.500620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542776+0000","last_change":"2024-04-01T16:34:31.509150+0000","last_active":"2024-04-01T16:34:54.542776+0000","last_peered":"2024-04-01T16:34:54.542776+0000","last_clean":"2024-04-01T16:34:54.542776+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T16:34:54.542776+0000","last_undegraded":"2024-04-01T16:34:54.542776+0000","last_fullsized":"2024-04-01T16:34:54.542776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.001494+0000","last_change":"2024-04-01T16:34:34.068444+0000","last_active":"2024-04-01T16:34:55.001494+0000","last_peered":"2024-04-01T16:34:55.001494+0000","last_clean":"2024-04-01T16:34:55.001494+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T16:34:55.001494+0000","last_undegraded":"2024-04-01T16:34:55.001494+0000","last_fullsized":"2024-04-01T16:34:55.001494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:04.104676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503955+0000","last_change":"2024-04-01T16:34:31.512295+0000","last_active":"2024-04-01T16:34:54.503955+0000","last_peered":"2024-04-01T16:34:54.503955+0000","last_clean":"2024-04-01T16:34:54.503955+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T16:34:54.503955+0000","last_undegraded":"2024-04-01T16:34:54.503955+0000","last_fullsized":"2024-04-01T16:34:54.503955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:35.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507321+0000","last_change":"2024-04-01T16:34:34.083194+0000","last_active":"2024-04-01T16:34:54.507321+0000","last_peered":"2024-04-01T16:34:54.507321+0000","last_clean":"2024-04-01T16:34:54.507321+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T16:34:54.507321+0000","last_undegraded":"2024-04-01T16:34:54.507321+0000","last_fullsized":"2024-04-01T16:34:54.507321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010222+0000","last_change":"2024-04-01T16:34:31.569571+0000","last_active":"2024-04-01T16:34:55.010222+0000","last_peered":"2024-04-01T16:34:55.010222+0000","last_clean":"2024-04-01T16:34:55.010222+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T16:34:55.010222+0000","last_undegraded":"2024-04-01T16:34:55.010222+0000","last_fullsized":"2024-04-01T16:34:55.010222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:10.626933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008282+0000","last_change":"2024-04-01T16:34:34.063200+0000","last_active":"2024-04-01T16:34:55.008282+0000","last_peered":"2024-04-01T16:34:55.008282+0000","last_clean":"2024-04-01T16:34:55.008282+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T16:34:55.008282+0000","last_undegraded":"2024-04-01T16:34:55.008282+0000","last_fullsized":"2024-04-01T16:34:55.008282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:18.399835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507079+0000","last_change":"2024-04-01T16:34:31.512508+0000","last_active":"2024-04-01T16:34:54.507079+0000","last_peered":"2024-04-01T16:34:54.507079+0000","last_clean":"2024-04-01T16:34:54.507079+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T16:34:54.507079+0000","last_undegraded":"2024-04-01T16:34:54.507079+0000","last_fullsized":"2024-04-01T16:34:54.507079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.515324+0000","last_change":"2024-04-01T16:34:54.510347+0000","last_active":"2024-04-01T16:34:54.515324+0000","last_peered":"2024-04-01T16:34:54.515324+0000","last_clean":"2024-04-01T16:34:54.515324+0000","last_became_active":"2024-04-01T16:34:54.509976+0000","last_became_peered":"2024-04-01T16:34:54.509976+0000","last_unstale":"2024-04-01T16:34:54.515324+0000","last_undegraded":"2024-04-01T16:34:54.515324+0000","last_fullsized":"2024-04-01T16:34:54.515324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:41:48.631612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543670+0000","last_change":"2024-04-01T16:34:31.426647+0000","last_active":"2024-04-01T16:34:54.543670+0000","last_peered":"2024-04-01T16:34:54.543670+0000","last_clean":"2024-04-01T16:34:54.543670+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T16:34:54.543670+0000","last_undegraded":"2024-04-01T16:34:54.543670+0000","last_fullsized":"2024-04-01T16:34:54.543670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:36.926701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.506967+0000","last_change":"2024-04-01T16:34:34.087431+0000","last_active":"2024-04-01T16:34:54.506967+0000","last_peered":"2024-04-01T16:34:54.506967+0000","last_clean":"2024-04-01T16:34:54.506967+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T16:34:54.506967+0000","last_undegraded":"2024-04-01T16:34:54.506967+0000","last_fullsized":"2024-04-01T16:34:54.506967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507371+0000","last_change":"2024-04-01T16:34:31.528790+0000","last_active":"2024-04-01T16:34:54.507371+0000","last_peered":"2024-04-01T16:34:54.507371+0000","last_clean":"2024-04-01T16:34:54.507371+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T16:34:54.507371+0000","last_undegraded":"2024-04-01T16:34:54.507371+0000","last_fullsized":"2024-04-01T16:34:54.507371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.501403+0000","last_change":"2024-04-01T16:34:34.085832+0000","last_active":"2024-04-01T16:34:54.501403+0000","last_peered":"2024-04-01T16:34:54.501403+0000","last_clean":"2024-04-01T16:34:54.501403+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T16:34:54.501403+0000","last_undegraded":"2024-04-01T16:34:54.501403+0000","last_fullsized":"2024-04-01T16:34:54.501403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504313+0000","last_change":"2024-04-01T16:34:31.534057+0000","last_active":"2024-04-01T16:34:54.504313+0000","last_peered":"2024-04-01T16:34:54.504313+0000","last_clean":"2024-04-01T16:34:54.504313+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T16:34:54.504313+0000","last_undegraded":"2024-04-01T16:34:54.504313+0000","last_fullsized":"2024-04-01T16:34:54.504313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002868+0000","last_change":"2024-04-01T16:34:34.073261+0000","last_active":"2024-04-01T16:34:55.002868+0000","last_peered":"2024-04-01T16:34:55.002868+0000","last_clean":"2024-04-01T16:34:55.002868+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T16:34:55.002868+0000","last_undegraded":"2024-04-01T16:34:55.002868+0000","last_fullsized":"2024-04-01T16:34:55.002868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:38.619969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542511+0000","last_change":"2024-04-01T16:34:31.423531+0000","last_active":"2024-04-01T16:34:54.542511+0000","last_peered":"2024-04-01T16:34:54.542511+0000","last_clean":"2024-04-01T16:34:54.542511+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T16:34:54.542511+0000","last_undegraded":"2024-04-01T16:34:54.542511+0000","last_fullsized":"2024-04-01T16:34:54.542511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.007775+0000","last_change":"2024-04-01T16:34:34.086029+0000","last_active":"2024-04-01T16:34:55.007775+0000","last_peered":"2024-04-01T16:34:55.007775+0000","last_clean":"2024-04-01T16:34:55.007775+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T16:34:55.007775+0000","last_undegraded":"2024-04-01T16:34:55.007775+0000","last_fullsized":"2024-04-01T16:34:55.007775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.508000+0000","last_change":"2024-04-01T16:34:31.509351+0000","last_active":"2024-04-01T16:34:54.508000+0000","last_peered":"2024-04-01T16:34:54.508000+0000","last_clean":"2024-04-01T16:34:54.508000+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T16:34:54.508000+0000","last_undegraded":"2024-04-01T16:34:54.508000+0000","last_fullsized":"2024-04-01T16:34:54.508000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500527+0000","last_change":"2024-04-01T16:34:34.091932+0000","last_active":"2024-04-01T16:34:54.500527+0000","last_peered":"2024-04-01T16:34:54.500527+0000","last_clean":"2024-04-01T16:34:54.500527+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T16:34:54.500527+0000","last_undegraded":"2024-04-01T16:34:54.500527+0000","last_fullsized":"2024-04-01T16:34:54.500527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:11:00.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507136+0000","last_change":"2024-04-01T16:34:31.517513+0000","last_active":"2024-04-01T16:34:54.507136+0000","last_peered":"2024-04-01T16:34:54.507136+0000","last_clean":"2024-04-01T16:34:54.507136+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T16:34:54.507136+0000","last_undegraded":"2024-04-01T16:34:54.507136+0000","last_fullsized":"2024-04-01T16:34:54.507136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:31.608594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.004709+0000","last_change":"2024-04-01T16:34:55.004709+0000","last_active":"2024-04-01T16:34:55.004709+0000","last_peered":"2024-04-01T16:34:55.004709+0000","last_clean":"2024-04-01T16:34:55.004709+0000","last_became_active":"2024-04-01T16:34:55.003987+0000","last_became_peered":"2024-04-01T16:34:55.003987+0000","last_unstale":"2024-04-01T16:34:55.004709+0000","last_undegraded":"2024-04-01T16:34:55.004709+0000","last_fullsized":"2024-04-01T16:34:55.004709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543847+0000","last_change":"2024-04-01T16:34:31.444603+0000","last_active":"2024-04-01T16:34:54.543847+0000","last_peered":"2024-04-01T16:34:54.543847+0000","last_clean":"2024-04-01T16:34:54.543847+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T16:34:54.543847+0000","last_undegraded":"2024-04-01T16:34:54.543847+0000","last_fullsized":"2024-04-01T16:34:54.543847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.502835+0000","last_change":"2024-04-01T16:34:34.034061+0000","last_active":"2024-04-01T16:34:54.502835+0000","last_peered":"2024-04-01T16:34:54.502835+0000","last_clean":"2024-04-01T16:34:54.502835+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T16:34:54.502835+0000","last_undegraded":"2024-04-01T16:34:54.502835+0000","last_fullsized":"2024-04-01T16:34:54.502835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.014117+0000","last_change":"2024-04-01T16:34:55.011962+0000","last_active":"2024-04-01T16:34:55.014117+0000","last_peered":"2024-04-01T16:34:55.014117+0000","last_clean":"2024-04-01T16:34:55.014117+0000","last_became_active":"2024-04-01T16:34:55.011400+0000","last_became_peered":"2024-04-01T16:34:55.011400+0000","last_unstale":"2024-04-01T16:34:55.014117+0000","last_undegraded":"2024-04-01T16:34:55.014117+0000","last_fullsized":"2024-04-01T16:34:55.014117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:14:52.381836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543077+0000","last_change":"2024-04-01T16:34:31.563882+0000","last_active":"2024-04-01T16:34:54.543077+0000","last_peered":"2024-04-01T16:34:54.543077+0000","last_clean":"2024-04-01T16:34:54.543077+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T16:34:54.543077+0000","last_undegraded":"2024-04-01T16:34:54.543077+0000","last_fullsized":"2024-04-01T16:34:54.543077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:27.209535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010099+0000","last_change":"2024-04-01T16:34:34.034904+0000","last_active":"2024-04-01T16:34:55.010099+0000","last_peered":"2024-04-01T16:34:55.010099+0000","last_clean":"2024-04-01T16:34:55.010099+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T16:34:55.010099+0000","last_undegraded":"2024-04-01T16:34:55.010099+0000","last_fullsized":"2024-04-01T16:34:55.010099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543474+0000","last_change":"2024-04-01T16:34:31.530246+0000","last_active":"2024-04-01T16:34:54.543474+0000","last_peered":"2024-04-01T16:34:54.543474+0000","last_clean":"2024-04-01T16:34:54.543474+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T16:34:54.543474+0000","last_undegraded":"2024-04-01T16:34:54.543474+0000","last_fullsized":"2024-04-01T16:34:54.543474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:48.430325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002793+0000","last_change":"2024-04-01T16:34:34.066381+0000","last_active":"2024-04-01T16:34:55.002793+0000","last_peered":"2024-04-01T16:34:55.002793+0000","last_clean":"2024-04-01T16:34:55.002793+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T16:34:55.002793+0000","last_undegraded":"2024-04-01T16:34:55.002793+0000","last_fullsized":"2024-04-01T16:34:55.002793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:10.824493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.501493+0000","last_change":"2024-04-01T16:34:31.490535+0000","last_active":"2024-04-01T16:34:54.501493+0000","last_peered":"2024-04-01T16:34:54.501493+0000","last_clean":"2024-04-01T16:34:54.501493+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T16:34:54.501493+0000","last_undegraded":"2024-04-01T16:34:54.501493+0000","last_fullsized":"2024-04-01T16:34:54.501493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:24.709969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.501287+0000","last_change":"2024-04-01T16:34:34.087097+0000","last_active":"2024-04-01T16:34:54.501287+0000","last_peered":"2024-04-01T16:34:54.501287+0000","last_clean":"2024-04-01T16:34:54.501287+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T16:34:54.501287+0000","last_undegraded":"2024-04-01T16:34:54.501287+0000","last_fullsized":"2024-04-01T16:34:54.501287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:17:48.287828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"24'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.003040+0000","last_change":"2024-04-01T16:34:31.420599+0000","last_active":"2024-04-01T16:34:55.003040+0000","last_peered":"2024-04-01T16:34:55.003040+0000","last_clean":"2024-04-01T16:34:55.003040+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T16:34:55.003040+0000","last_undegraded":"2024-04-01T16:34:55.003040+0000","last_fullsized":"2024-04-01T16:34:55.003040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":697840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":106890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":697896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":106980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":107016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":108502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":108502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":107050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T16:35:04.325 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T16:35:04.541 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.542+0000 7f3082a00640 1 Processor -- start 2024-04-01T16:35:04.542 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.542+0000 7f3082a00640 1 -- start start 2024-04-01T16:35:04.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.543+0000 7f3082a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f307c0c3bf0 0x7f307c156c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:04.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.543+0000 7f3082a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f307c0c3fd0 0x7f307c15a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:04.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.544+0000 7f3082a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f307c0c61d0 0x7f307c150790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:04.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.544+0000 7f3082a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f307c0c5d40 con 0x7f307c0c61d0 2024-04-01T16:35:04.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.544+0000 7f3082a00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f307c0726d0 con 0x7f307c0c3fd0 2024-04-01T16:35:04.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.544+0000 7f3082a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f307c15a890 con 0x7f307c0c3bf0 2024-04-01T16:35:04.544 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.545+0000 7f3080a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f307c0c61d0 0x7f307c150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:04.545 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.545+0000 7f3080a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f307c0c61d0 0x7f307c150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:32862/0 (socket says 172.21.15.163:32862) 2024-04-01T16:35:04.545 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.545+0000 7f3080a00640 1 -- 172.21.15.163:0/2472288943 learned_addr learned my addr 172.21.15.163:0/2472288943 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:04.545 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.546+0000 7f307b400640 1 --2- 172.21.15.163:0/2472288943 >> v2:172.21.15.189:3300/0 conn(0x7f307c0c3fd0 0x7f307c15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:04.547 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.548+0000 7f307be00640 1 --2- 172.21.15.163:0/2472288943 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f307c0c3bf0 0x7f307c156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:04.547 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.548+0000 7f3080a00640 1 -- 172.21.15.163:0/2472288943 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f307c0c3bf0 msgr2=0x7f307c156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:04.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.548+0000 7f3080a00640 1 --2- 172.21.15.163:0/2472288943 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f307c0c3bf0 0x7f307c156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:04.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.548+0000 7f3080a00640 1 -- 172.21.15.163:0/2472288943 >> v2:172.21.15.189:3300/0 conn(0x7f307c0c3fd0 msgr2=0x7f307c15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:04.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.548+0000 7f3080a00640 1 --2- 172.21.15.163:0/2472288943 >> v2:172.21.15.189:3300/0 conn(0x7f307c0c3fd0 0x7f307c15a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:04.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.548+0000 7f3080a00640 1 -- 172.21.15.163:0/2472288943 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c0c5a10 con 0x7f307c0c61d0 2024-04-01T16:35:04.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.548+0000 7f307b400640 1 --2- 172.21.15.163:0/2472288943 >> v2:172.21.15.189:3300/0 conn(0x7f307c0c3fd0 0x7f307c15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T16:35:04.550 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.551+0000 7f3080a00640 1 --2- 172.21.15.163:0/2472288943 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f307c0c61d0 0x7f307c150790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f307c071fe0 tx=0x7f307402df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915384acbf0b419f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:04.555 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.555+0000 7f307aa00640 1 -- 172.21.15.163:0/2472288943 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074034070 con 0x7f307c0c61d0 2024-04-01T16:35:04.555 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.555+0000 7f307aa00640 1 -- 172.21.15.163:0/2472288943 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307402ece0 con 0x7f307c0c61d0 2024-04-01T16:35:04.555 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.555+0000 7f307aa00640 1 -- 172.21.15.163:0/2472288943 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074038620 con 0x7f307c0c61d0 2024-04-01T16:35:04.556 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.556+0000 7f3082a00640 1 -- 172.21.15.163:0/2472288943 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f307c0c61d0 msgr2=0x7f307c150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:04.556 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.556+0000 7f3082a00640 1 --2- 172.21.15.163:0/2472288943 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f307c0c61d0 0x7f307c150790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f307c071fe0 tx=0x7f307402df30 comp rx=0 tx=0).stop 2024-04-01T16:35:04.556 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.556+0000 7f3082a00640 1 -- 172.21.15.163:0/2472288943 shutdown_connections 2024-04-01T16:35:04.556 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.556+0000 7f3082a00640 1 --2- 172.21.15.163:0/2472288943 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f307c0c61d0 0x7f307c150790 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:04.556 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.556+0000 7f3082a00640 1 --2- 172.21.15.163:0/2472288943 >> v2:172.21.15.189:3300/0 conn(0x7f307c0c3fd0 0x7f307c15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:04.556 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.556+0000 7f3082a00640 1 --2- 172.21.15.163:0/2472288943 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f307c0c3bf0 0x7f307c156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:04.556 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.556+0000 7f3082a00640 1 -- 172.21.15.163:0/2472288943 >> 172.21.15.163:0/2472288943 conn(0x7f307c0c8f80 msgr2=0x7f307c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:04.556 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.556+0000 7f3082a00640 1 -- 172.21.15.163:0/2472288943 shutdown_connections 2024-04-01T16:35:04.556 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.556+0000 7f3082a00640 1 -- 172.21.15.163:0/2472288943 wait complete. 2024-04-01T16:35:04.557 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.558+0000 7f3082a00640 1 Processor -- start 2024-04-01T16:35:04.557 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.558+0000 7f3082a00640 1 -- start start 2024-04-01T16:35:04.558 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.559+0000 7f3082a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f307c0c3bf0 0x7f307c1f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:04.558 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.559+0000 7f3082a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f307c0c3fd0 0x7f307c140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:04.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.559+0000 7f3082a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f307c0c61d0 0x7f307c158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:04.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.559+0000 7f3082a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f307c15b0f0 con 0x7f307c0c3bf0 2024-04-01T16:35:04.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.559+0000 7f3082a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f307c15ae10 con 0x7f307c0c3fd0 2024-04-01T16:35:04.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.559+0000 7f3082a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f307c06cce0 con 0x7f307c0c61d0 2024-04-01T16:35:04.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.561+0000 7f307be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f307c0c3bf0 0x7f307c1f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:04.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.561+0000 7f307b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f307c0c3fd0 0x7f307c140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:04.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.561+0000 7f307be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f307c0c3bf0 0x7f307c1f0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:32864/0 (socket says 172.21.15.163:32864) 2024-04-01T16:35:04.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.561+0000 7f307be00640 1 -- 172.21.15.163:0/97701667 learned_addr learned my addr 172.21.15.163:0/97701667 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:04.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.561+0000 7f3080a00640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f307c0c61d0 0x7f307c158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:04.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.565+0000 7f307be00640 1 -- 172.21.15.163:0/97701667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f307c0c61d0 msgr2=0x7f307c158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:04.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.565+0000 7f307be00640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f307c0c61d0 0x7f307c158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:04.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.565+0000 7f307be00640 1 -- 172.21.15.163:0/97701667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f307c0c3fd0 msgr2=0x7f307c140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:04.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.565+0000 7f307be00640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f307c0c3fd0 0x7f307c140150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:04.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.565+0000 7f307be00640 1 -- 172.21.15.163:0/97701667 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c1f0f50 con 0x7f307c0c3bf0 2024-04-01T16:35:04.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.567+0000 7f307be00640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f307c0c3bf0 0x7f307c1f0a10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f306c00c820 tx=0x7f306c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:04.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.571+0000 7f3073e00640 1 -- 172.21.15.163:0/97701667 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c015070 con 0x7f307c0c3bf0 2024-04-01T16:35:04.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.571+0000 7f3073e00640 1 -- 172.21.15.163:0/97701667 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306c004220 con 0x7f307c0c3bf0 2024-04-01T16:35:04.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.571+0000 7f3073e00640 1 -- 172.21.15.163:0/97701667 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c00ce10 con 0x7f307c0c3bf0 2024-04-01T16:35:04.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.571+0000 7f3082a00640 1 -- 172.21.15.163:0/97701667 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307c1f36b0 con 0x7f307c0c3bf0 2024-04-01T16:35:04.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.572+0000 7f3082a00640 1 -- 172.21.15.163:0/97701667 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307c1f3c70 con 0x7f307c0c3bf0 2024-04-01T16:35:04.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.573+0000 7f3082a00640 1 -- 172.21.15.163:0/97701667 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307c0756d0 con 0x7f307c0c3bf0 2024-04-01T16:35:04.593 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.594+0000 7f3073e00640 1 -- 172.21.15.163:0/97701667 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f306c007830 con 0x7f307c0c3bf0 2024-04-01T16:35:04.594 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.594+0000 7f3073e00640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f305806c940 0x7f305806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:04.594 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.595+0000 7f307b400640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f305806c940 0x7f305806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:04.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.596+0000 7f307b400640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f305806c940 0x7f305806ee00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f307c0c4ab0 tx=0x7f3064009910 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:04.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.596+0000 7f3073e00640 1 -- 172.21.15.163:0/97701667 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f306c057b60 con 0x7f307c0c3bf0 2024-04-01T16:35:04.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:04.891+0000 7f3073e00640 1 -- 172.21.15.163:0/97701667 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f307c1f0f50 con 0x7f307c0c3bf0 2024-04-01T16:35:05.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.095+0000 7f3082a00640 1 -- 172.21.15.163:0/97701667 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f307c14dff0 con 0x7f305806c940 2024-04-01T16:35:05.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.102+0000 7f3073e00640 1 -- 172.21.15.163:0/97701667 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251834 (secure 0 0 0) 0x7f307c14dff0 con 0x7f305806c940 2024-04-01T16:35:05.105 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:35:05.107 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T16:35:05.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.107+0000 7f3082a00640 1 -- 172.21.15.163:0/97701667 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f305806c940 msgr2=0x7f305806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:05.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.107+0000 7f3082a00640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f305806c940 0x7f305806ee00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f307c0c4ab0 tx=0x7f3064009910 comp rx=0 tx=0).stop 2024-04-01T16:35:05.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.107+0000 7f3082a00640 1 -- 172.21.15.163:0/97701667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f307c0c3bf0 msgr2=0x7f307c1f0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:05.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.107+0000 7f3082a00640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f307c0c3bf0 0x7f307c1f0a10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f306c00c820 tx=0x7f306c00cce0 comp rx=0 tx=0).stop 2024-04-01T16:35:05.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.107+0000 7f3082a00640 1 -- 172.21.15.163:0/97701667 shutdown_connections 2024-04-01T16:35:05.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.107+0000 7f3082a00640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f305806c940 0x7f305806ee00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:05.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.107+0000 7f3082a00640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f307c0c61d0 0x7f307c158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:05.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.107+0000 7f3082a00640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f307c0c3fd0 0x7f307c140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:05.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.107+0000 7f3082a00640 1 --2- 172.21.15.163:0/97701667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f307c0c3bf0 0x7f307c1f0a10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:05.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.107+0000 7f3082a00640 1 -- 172.21.15.163:0/97701667 >> 172.21.15.163:0/97701667 conn(0x7f307c0c8f80 msgr2=0x7f307c14f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:05.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.108+0000 7f3082a00640 1 -- 172.21.15.163:0/97701667 shutdown_connections 2024-04-01T16:35:05.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.108+0000 7f3082a00640 1 -- 172.21.15.163:0/97701667 wait complete. 2024-04-01T16:35:05.127 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-01T16:35:03.793916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219604,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755116,"statfs":{"total":773094113280,"available":772869238784,"internally_reserved":0,"allocated":3514368,"data_stored":2040676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003694"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543600+0000","last_change":"2024-04-01T16:34:34.033508+0000","last_active":"2024-04-01T16:34:54.543600+0000","last_peered":"2024-04-01T16:34:54.543600+0000","last_clean":"2024-04-01T16:34:54.543600+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T16:34:54.543600+0000","last_undegraded":"2024-04-01T16:34:54.543600+0000","last_fullsized":"2024-04-01T16:34:54.543600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507263+0000","last_change":"2024-04-01T16:34:34.065375+0000","last_active":"2024-04-01T16:34:54.507263+0000","last_peered":"2024-04-01T16:34:54.507263+0000","last_clean":"2024-04-01T16:34:54.507263+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T16:34:54.507263+0000","last_undegraded":"2024-04-01T16:34:54.507263+0000","last_fullsized":"2024-04-01T16:34:54.507263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002160+0000","last_change":"2024-04-01T16:34:34.084618+0000","last_active":"2024-04-01T16:34:55.002160+0000","last_peered":"2024-04-01T16:34:55.002160+0000","last_clean":"2024-04-01T16:34:55.002160+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T16:34:55.002160+0000","last_undegraded":"2024-04-01T16:34:55.002160+0000","last_fullsized":"2024-04-01T16:34:55.002160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:43.530081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010013+0000","last_change":"2024-04-01T16:34:34.088694+0000","last_active":"2024-04-01T16:34:55.010013+0000","last_peered":"2024-04-01T16:34:55.010013+0000","last_clean":"2024-04-01T16:34:55.010013+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T16:34:55.010013+0000","last_undegraded":"2024-04-01T16:34:55.010013+0000","last_fullsized":"2024-04-01T16:34:55.010013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542768+0000","last_change":"2024-04-01T16:34:34.085765+0000","last_active":"2024-04-01T16:34:54.542768+0000","last_peered":"2024-04-01T16:34:54.542768+0000","last_clean":"2024-04-01T16:34:54.542768+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T16:34:54.542768+0000","last_undegraded":"2024-04-01T16:34:54.542768+0000","last_fullsized":"2024-04-01T16:34:54.542768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009741+0000","last_change":"2024-04-01T16:34:34.066150+0000","last_active":"2024-04-01T16:34:55.009741+0000","last_peered":"2024-04-01T16:34:55.009741+0000","last_clean":"2024-04-01T16:34:55.009741+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T16:34:55.009741+0000","last_undegraded":"2024-04-01T16:34:55.009741+0000","last_fullsized":"2024-04-01T16:34:55.009741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:08:56.651785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542643+0000","last_change":"2024-04-01T16:34:34.072924+0000","last_active":"2024-04-01T16:34:54.542643+0000","last_peered":"2024-04-01T16:34:54.542643+0000","last_clean":"2024-04-01T16:34:54.542643+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T16:34:54.542643+0000","last_undegraded":"2024-04-01T16:34:54.542643+0000","last_fullsized":"2024-04-01T16:34:54.542643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500391+0000","last_change":"2024-04-01T16:34:34.088361+0000","last_active":"2024-04-01T16:34:54.500391+0000","last_peered":"2024-04-01T16:34:54.500391+0000","last_clean":"2024-04-01T16:34:54.500391+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T16:34:54.500391+0000","last_undegraded":"2024-04-01T16:34:54.500391+0000","last_fullsized":"2024-04-01T16:34:54.500391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543787+0000","last_change":"2024-04-01T16:34:34.038534+0000","last_active":"2024-04-01T16:34:54.543787+0000","last_peered":"2024-04-01T16:34:54.543787+0000","last_clean":"2024-04-01T16:34:54.543787+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T16:34:54.543787+0000","last_undegraded":"2024-04-01T16:34:54.543787+0000","last_fullsized":"2024-04-01T16:34:54.543787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:54.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503700+0000","last_change":"2024-04-01T16:34:34.040513+0000","last_active":"2024-04-01T16:34:54.503700+0000","last_peered":"2024-04-01T16:34:54.503700+0000","last_clean":"2024-04-01T16:34:54.503700+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T16:34:54.503700+0000","last_undegraded":"2024-04-01T16:34:54.503700+0000","last_fullsized":"2024-04-01T16:34:54.503700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503534+0000","last_change":"2024-04-01T16:34:34.038167+0000","last_active":"2024-04-01T16:34:54.503534+0000","last_peered":"2024-04-01T16:34:54.503534+0000","last_clean":"2024-04-01T16:34:54.503534+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T16:34:54.503534+0000","last_undegraded":"2024-04-01T16:34:54.503534+0000","last_fullsized":"2024-04-01T16:34:54.503534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008124+0000","last_change":"2024-04-01T16:34:34.035177+0000","last_active":"2024-04-01T16:34:55.008124+0000","last_peered":"2024-04-01T16:34:55.008124+0000","last_clean":"2024-04-01T16:34:55.008124+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T16:34:55.008124+0000","last_undegraded":"2024-04-01T16:34:55.008124+0000","last_fullsized":"2024-04-01T16:34:55.008124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:37.711846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500735+0000","last_change":"2024-04-01T16:34:34.086031+0000","last_active":"2024-04-01T16:34:54.500735+0000","last_peered":"2024-04-01T16:34:54.500735+0000","last_clean":"2024-04-01T16:34:54.500735+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T16:34:54.500735+0000","last_undegraded":"2024-04-01T16:34:54.500735+0000","last_fullsized":"2024-04-01T16:34:54.500735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.001512+0000","last_change":"2024-04-01T16:34:34.071535+0000","last_active":"2024-04-01T16:34:55.001512+0000","last_peered":"2024-04-01T16:34:55.001512+0000","last_clean":"2024-04-01T16:34:55.001512+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T16:34:55.001512+0000","last_undegraded":"2024-04-01T16:34:55.001512+0000","last_fullsized":"2024-04-01T16:34:55.001512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:45.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507709+0000","last_change":"2024-04-01T16:34:33.904701+0000","last_active":"2024-04-01T16:34:54.507709+0000","last_peered":"2024-04-01T16:34:54.507709+0000","last_clean":"2024-04-01T16:34:54.507709+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T16:34:54.507709+0000","last_undegraded":"2024-04-01T16:34:54.507709+0000","last_fullsized":"2024-04-01T16:34:54.507709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009278+0000","last_change":"2024-04-01T16:34:34.064695+0000","last_active":"2024-04-01T16:34:55.009278+0000","last_peered":"2024-04-01T16:34:55.009278+0000","last_clean":"2024-04-01T16:34:55.009278+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T16:34:55.009278+0000","last_undegraded":"2024-04-01T16:34:55.009278+0000","last_fullsized":"2024-04-01T16:34:55.009278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.798148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010268+0000","last_change":"2024-04-01T16:34:34.032994+0000","last_active":"2024-04-01T16:34:55.010268+0000","last_peered":"2024-04-01T16:34:55.010268+0000","last_clean":"2024-04-01T16:34:55.010268+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T16:34:55.010268+0000","last_undegraded":"2024-04-01T16:34:55.010268+0000","last_fullsized":"2024-04-01T16:34:55.010268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504087+0000","last_change":"2024-04-01T16:34:34.082238+0000","last_active":"2024-04-01T16:34:54.504087+0000","last_peered":"2024-04-01T16:34:54.504087+0000","last_clean":"2024-04-01T16:34:54.504087+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T16:34:54.504087+0000","last_undegraded":"2024-04-01T16:34:54.504087+0000","last_fullsized":"2024-04-01T16:34:54.504087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543579+0000","last_change":"2024-04-01T16:34:34.083056+0000","last_active":"2024-04-01T16:34:54.543579+0000","last_peered":"2024-04-01T16:34:54.543579+0000","last_clean":"2024-04-01T16:34:54.543579+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T16:34:54.543579+0000","last_undegraded":"2024-04-01T16:34:54.543579+0000","last_fullsized":"2024-04-01T16:34:54.543579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503181+0000","last_change":"2024-04-01T16:34:34.034017+0000","last_active":"2024-04-01T16:34:54.503181+0000","last_peered":"2024-04-01T16:34:54.503181+0000","last_clean":"2024-04-01T16:34:54.503181+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T16:34:54.503181+0000","last_undegraded":"2024-04-01T16:34:54.503181+0000","last_fullsized":"2024-04-01T16:34:54.503181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:33.976417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002286+0000","last_change":"2024-04-01T16:34:34.068541+0000","last_active":"2024-04-01T16:34:55.002286+0000","last_peered":"2024-04-01T16:34:55.002286+0000","last_clean":"2024-04-01T16:34:55.002286+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T16:34:55.002286+0000","last_undegraded":"2024-04-01T16:34:55.002286+0000","last_fullsized":"2024-04-01T16:34:55.002286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:29.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009827+0000","last_change":"2024-04-01T16:34:34.031774+0000","last_active":"2024-04-01T16:34:55.009827+0000","last_peered":"2024-04-01T16:34:55.009827+0000","last_clean":"2024-04-01T16:34:55.009827+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T16:34:55.009827+0000","last_undegraded":"2024-04-01T16:34:55.009827+0000","last_fullsized":"2024-04-01T16:34:55.009827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:39.294525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500493+0000","last_change":"2024-04-01T16:34:34.090324+0000","last_active":"2024-04-01T16:34:54.500493+0000","last_peered":"2024-04-01T16:34:54.500493+0000","last_clean":"2024-04-01T16:34:54.500493+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T16:34:54.500493+0000","last_undegraded":"2024-04-01T16:34:54.500493+0000","last_fullsized":"2024-04-01T16:34:54.500493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:55:40.168021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008960+0000","last_change":"2024-04-01T16:34:34.083544+0000","last_active":"2024-04-01T16:34:55.008960+0000","last_peered":"2024-04-01T16:34:55.008960+0000","last_clean":"2024-04-01T16:34:55.008960+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T16:34:55.008960+0000","last_undegraded":"2024-04-01T16:34:55.008960+0000","last_fullsized":"2024-04-01T16:34:55.008960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.501281+0000","last_change":"2024-04-01T16:34:34.090721+0000","last_active":"2024-04-01T16:34:54.501281+0000","last_peered":"2024-04-01T16:34:54.501281+0000","last_clean":"2024-04-01T16:34:54.501281+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T16:34:54.501281+0000","last_undegraded":"2024-04-01T16:34:54.501281+0000","last_fullsized":"2024-04-01T16:34:54.501281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.510600+0000","last_change":"2024-04-01T16:34:54.510600+0000","last_active":"2024-04-01T16:34:54.510600+0000","last_peered":"2024-04-01T16:34:54.510600+0000","last_clean":"2024-04-01T16:34:54.510600+0000","last_became_active":"2024-04-01T16:34:54.510173+0000","last_became_peered":"2024-04-01T16:34:54.510173+0000","last_unstale":"2024-04-01T16:34:54.510600+0000","last_undegraded":"2024-04-01T16:34:54.510600+0000","last_fullsized":"2024-04-01T16:34:54.510600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507313+0000","last_change":"2024-04-01T16:34:34.091911+0000","last_active":"2024-04-01T16:34:54.507313+0000","last_peered":"2024-04-01T16:34:54.507313+0000","last_clean":"2024-04-01T16:34:54.507313+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T16:34:54.507313+0000","last_undegraded":"2024-04-01T16:34:54.507313+0000","last_fullsized":"2024-04-01T16:34:54.507313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500864+0000","last_change":"2024-04-01T16:34:34.091540+0000","last_active":"2024-04-01T16:34:54.500864+0000","last_peered":"2024-04-01T16:34:54.500864+0000","last_clean":"2024-04-01T16:34:54.500864+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T16:34:54.500864+0000","last_undegraded":"2024-04-01T16:34:54.500864+0000","last_fullsized":"2024-04-01T16:34:54.500864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002349+0000","last_change":"2024-04-01T16:34:34.087634+0000","last_active":"2024-04-01T16:34:55.002349+0000","last_peered":"2024-04-01T16:34:55.002349+0000","last_clean":"2024-04-01T16:34:55.002349+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T16:34:55.002349+0000","last_undegraded":"2024-04-01T16:34:55.002349+0000","last_fullsized":"2024-04-01T16:34:55.002349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:12.994756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009994+0000","last_change":"2024-04-01T16:34:34.084026+0000","last_active":"2024-04-01T16:34:55.009994+0000","last_peered":"2024-04-01T16:34:55.009994+0000","last_clean":"2024-04-01T16:34:55.009994+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T16:34:55.009994+0000","last_undegraded":"2024-04-01T16:34:55.009994+0000","last_fullsized":"2024-04-01T16:34:55.009994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503763+0000","last_change":"2024-04-01T16:34:34.088300+0000","last_active":"2024-04-01T16:34:54.503763+0000","last_peered":"2024-04-01T16:34:54.503763+0000","last_clean":"2024-04-01T16:34:54.503763+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T16:34:54.503763+0000","last_undegraded":"2024-04-01T16:34:54.503763+0000","last_fullsized":"2024-04-01T16:34:54.503763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503052+0000","last_change":"2024-04-01T16:34:34.068348+0000","last_active":"2024-04-01T16:34:54.503052+0000","last_peered":"2024-04-01T16:34:54.503052+0000","last_clean":"2024-04-01T16:34:54.503052+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T16:34:54.503052+0000","last_undegraded":"2024-04-01T16:34:54.503052+0000","last_fullsized":"2024-04-01T16:34:54.503052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010349+0000","last_change":"2024-04-01T16:34:33.901019+0000","last_active":"2024-04-01T16:34:55.010349+0000","last_peered":"2024-04-01T16:34:55.010349+0000","last_clean":"2024-04-01T16:34:55.010349+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T16:34:55.010349+0000","last_undegraded":"2024-04-01T16:34:55.010349+0000","last_fullsized":"2024-04-01T16:34:55.010349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:08:37.254438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.501042+0000","last_change":"2024-04-01T16:34:31.489434+0000","last_active":"2024-04-01T16:34:54.501042+0000","last_peered":"2024-04-01T16:34:54.501042+0000","last_clean":"2024-04-01T16:34:54.501042+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T16:34:54.501042+0000","last_undegraded":"2024-04-01T16:34:54.501042+0000","last_fullsized":"2024-04-01T16:34:54.501042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002555+0000","last_change":"2024-04-01T16:34:34.065342+0000","last_active":"2024-04-01T16:34:55.002555+0000","last_peered":"2024-04-01T16:34:55.002555+0000","last_clean":"2024-04-01T16:34:55.002555+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T16:34:55.002555+0000","last_undegraded":"2024-04-01T16:34:55.002555+0000","last_fullsized":"2024-04-01T16:34:55.002555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:56.911106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.502921+0000","last_change":"2024-04-01T16:34:31.530201+0000","last_active":"2024-04-01T16:34:54.502921+0000","last_peered":"2024-04-01T16:34:54.502921+0000","last_clean":"2024-04-01T16:34:54.502921+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T16:34:54.502921+0000","last_undegraded":"2024-04-01T16:34:54.502921+0000","last_fullsized":"2024-04-01T16:34:54.502921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.501594+0000","last_change":"2024-04-01T16:34:31.528238+0000","last_active":"2024-04-01T16:34:54.501594+0000","last_peered":"2024-04-01T16:34:54.501594+0000","last_clean":"2024-04-01T16:34:54.501594+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T16:34:54.501594+0000","last_undegraded":"2024-04-01T16:34:54.501594+0000","last_fullsized":"2024-04-01T16:34:54.501594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500402+0000","last_change":"2024-04-01T16:34:34.091302+0000","last_active":"2024-04-01T16:34:54.500402+0000","last_peered":"2024-04-01T16:34:54.500402+0000","last_clean":"2024-04-01T16:34:54.500402+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T16:34:54.500402+0000","last_undegraded":"2024-04-01T16:34:54.500402+0000","last_fullsized":"2024-04-01T16:34:54.500402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009229+0000","last_change":"2024-04-01T16:34:31.567946+0000","last_active":"2024-04-01T16:34:55.009229+0000","last_peered":"2024-04-01T16:34:55.009229+0000","last_clean":"2024-04-01T16:34:55.009229+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T16:34:55.009229+0000","last_undegraded":"2024-04-01T16:34:55.009229+0000","last_fullsized":"2024-04-01T16:34:55.009229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507905+0000","last_change":"2024-04-01T16:34:34.088894+0000","last_active":"2024-04-01T16:34:54.507905+0000","last_peered":"2024-04-01T16:34:54.507905+0000","last_clean":"2024-04-01T16:34:54.507905+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T16:34:54.507905+0000","last_undegraded":"2024-04-01T16:34:54.507905+0000","last_fullsized":"2024-04-01T16:34:54.507905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504022+0000","last_change":"2024-04-01T16:34:31.566997+0000","last_active":"2024-04-01T16:34:54.504022+0000","last_peered":"2024-04-01T16:34:54.504022+0000","last_clean":"2024-04-01T16:34:54.504022+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T16:34:54.504022+0000","last_undegraded":"2024-04-01T16:34:54.504022+0000","last_fullsized":"2024-04-01T16:34:54.504022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010465+0000","last_change":"2024-04-01T16:34:34.030831+0000","last_active":"2024-04-01T16:34:55.010465+0000","last_peered":"2024-04-01T16:34:55.010465+0000","last_clean":"2024-04-01T16:34:55.010465+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T16:34:55.010465+0000","last_undegraded":"2024-04-01T16:34:55.010465+0000","last_fullsized":"2024-04-01T16:34:55.010465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010568+0000","last_change":"2024-04-01T16:34:31.569927+0000","last_active":"2024-04-01T16:34:55.010568+0000","last_peered":"2024-04-01T16:34:55.010568+0000","last_clean":"2024-04-01T16:34:55.010568+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T16:34:55.010568+0000","last_undegraded":"2024-04-01T16:34:55.010568+0000","last_fullsized":"2024-04-01T16:34:55.010568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:41.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002879+0000","last_change":"2024-04-01T16:34:34.068959+0000","last_active":"2024-04-01T16:34:55.002879+0000","last_peered":"2024-04-01T16:34:55.002879+0000","last_clean":"2024-04-01T16:34:55.002879+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T16:34:55.002879+0000","last_undegraded":"2024-04-01T16:34:55.002879+0000","last_fullsized":"2024-04-01T16:34:55.002879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:58:57.685708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507455+0000","last_change":"2024-04-01T16:34:31.562792+0000","last_active":"2024-04-01T16:34:54.507455+0000","last_peered":"2024-04-01T16:34:54.507455+0000","last_clean":"2024-04-01T16:34:54.507455+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T16:34:54.507455+0000","last_undegraded":"2024-04-01T16:34:54.507455+0000","last_fullsized":"2024-04-01T16:34:54.507455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:55.684911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008845+0000","last_change":"2024-04-01T16:34:33.916652+0000","last_active":"2024-04-01T16:34:55.008845+0000","last_peered":"2024-04-01T16:34:55.008845+0000","last_clean":"2024-04-01T16:34:55.008845+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T16:34:55.008845+0000","last_undegraded":"2024-04-01T16:34:55.008845+0000","last_fullsized":"2024-04-01T16:34:55.008845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503068+0000","last_change":"2024-04-01T16:34:31.531366+0000","last_active":"2024-04-01T16:34:54.503068+0000","last_peered":"2024-04-01T16:34:54.503068+0000","last_clean":"2024-04-01T16:34:54.503068+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T16:34:54.503068+0000","last_undegraded":"2024-04-01T16:34:54.503068+0000","last_fullsized":"2024-04-01T16:34:54.503068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543193+0000","last_change":"2024-04-01T16:34:34.085449+0000","last_active":"2024-04-01T16:34:54.543193+0000","last_peered":"2024-04-01T16:34:54.543193+0000","last_clean":"2024-04-01T16:34:54.543193+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T16:34:54.543193+0000","last_undegraded":"2024-04-01T16:34:54.543193+0000","last_fullsized":"2024-04-01T16:34:54.543193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002803+0000","last_change":"2024-04-01T16:34:31.444458+0000","last_active":"2024-04-01T16:34:55.002803+0000","last_peered":"2024-04-01T16:34:55.002803+0000","last_clean":"2024-04-01T16:34:55.002803+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T16:34:55.002803+0000","last_undegraded":"2024-04-01T16:34:55.002803+0000","last_fullsized":"2024-04-01T16:34:55.002803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.001912+0000","last_change":"2024-04-01T16:34:34.071521+0000","last_active":"2024-04-01T16:34:55.001912+0000","last_peered":"2024-04-01T16:34:55.001912+0000","last_clean":"2024-04-01T16:34:55.001912+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T16:34:55.001912+0000","last_undegraded":"2024-04-01T16:34:55.001912+0000","last_fullsized":"2024-04-01T16:34:55.001912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:36:13.618956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010073+0000","last_change":"2024-04-01T16:34:31.566202+0000","last_active":"2024-04-01T16:34:55.010073+0000","last_peered":"2024-04-01T16:34:55.010073+0000","last_clean":"2024-04-01T16:34:55.010073+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T16:34:55.010073+0000","last_undegraded":"2024-04-01T16:34:55.010073+0000","last_fullsized":"2024-04-01T16:34:55.010073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:54.543283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543363+0000","last_change":"2024-04-01T16:34:33.930561+0000","last_active":"2024-04-01T16:34:54.543363+0000","last_peered":"2024-04-01T16:34:54.543363+0000","last_clean":"2024-04-01T16:34:54.543363+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T16:34:54.543363+0000","last_undegraded":"2024-04-01T16:34:54.543363+0000","last_fullsized":"2024-04-01T16:34:54.543363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.502718+0000","last_change":"2024-04-01T16:34:31.535895+0000","last_active":"2024-04-01T16:34:54.502718+0000","last_peered":"2024-04-01T16:34:54.502718+0000","last_clean":"2024-04-01T16:34:54.502718+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T16:34:54.502718+0000","last_undegraded":"2024-04-01T16:34:54.502718+0000","last_fullsized":"2024-04-01T16:34:54.502718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:36:43.780845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.502790+0000","last_change":"2024-04-01T16:34:34.068194+0000","last_active":"2024-04-01T16:34:54.502790+0000","last_peered":"2024-04-01T16:34:54.502790+0000","last_clean":"2024-04-01T16:34:54.502790+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T16:34:54.502790+0000","last_undegraded":"2024-04-01T16:34:54.502790+0000","last_fullsized":"2024-04-01T16:34:54.502790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503806+0000","last_change":"2024-04-01T16:34:31.515495+0000","last_active":"2024-04-01T16:34:54.503806+0000","last_peered":"2024-04-01T16:34:54.503806+0000","last_clean":"2024-04-01T16:34:54.503806+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T16:34:54.503806+0000","last_undegraded":"2024-04-01T16:34:54.503806+0000","last_fullsized":"2024-04-01T16:34:54.503806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:26:56.217819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542753+0000","last_change":"2024-04-01T16:34:33.926318+0000","last_active":"2024-04-01T16:34:54.542753+0000","last_peered":"2024-04-01T16:34:54.542753+0000","last_clean":"2024-04-01T16:34:54.542753+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T16:34:54.542753+0000","last_undegraded":"2024-04-01T16:34:54.542753+0000","last_fullsized":"2024-04-01T16:34:54.542753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009730+0000","last_change":"2024-04-01T16:34:31.440349+0000","last_active":"2024-04-01T16:34:55.009730+0000","last_peered":"2024-04-01T16:34:55.009730+0000","last_clean":"2024-04-01T16:34:55.009730+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T16:34:55.009730+0000","last_undegraded":"2024-04-01T16:34:55.009730+0000","last_fullsized":"2024-04-01T16:34:55.009730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:29.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542735+0000","last_change":"2024-04-01T16:34:33.931211+0000","last_active":"2024-04-01T16:34:54.542735+0000","last_peered":"2024-04-01T16:34:54.542735+0000","last_clean":"2024-04-01T16:34:54.542735+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T16:34:54.542735+0000","last_undegraded":"2024-04-01T16:34:54.542735+0000","last_fullsized":"2024-04-01T16:34:54.542735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:15:45.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504196+0000","last_change":"2024-04-01T16:34:31.512433+0000","last_active":"2024-04-01T16:34:54.504196+0000","last_peered":"2024-04-01T16:34:54.504196+0000","last_clean":"2024-04-01T16:34:54.504196+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T16:34:54.504196+0000","last_undegraded":"2024-04-01T16:34:54.504196+0000","last_fullsized":"2024-04-01T16:34:54.504196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:16.032012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543722+0000","last_change":"2024-04-01T16:34:33.930791+0000","last_active":"2024-04-01T16:34:54.543722+0000","last_peered":"2024-04-01T16:34:54.543722+0000","last_clean":"2024-04-01T16:34:54.543722+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T16:34:54.543722+0000","last_undegraded":"2024-04-01T16:34:54.543722+0000","last_fullsized":"2024-04-01T16:34:54.543722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:53.102054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.508092+0000","last_change":"2024-04-01T16:34:31.509375+0000","last_active":"2024-04-01T16:34:54.508092+0000","last_peered":"2024-04-01T16:34:54.508092+0000","last_clean":"2024-04-01T16:34:54.508092+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T16:34:54.508092+0000","last_undegraded":"2024-04-01T16:34:54.508092+0000","last_fullsized":"2024-04-01T16:34:54.508092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010186+0000","last_change":"2024-04-01T16:34:34.085219+0000","last_active":"2024-04-01T16:34:55.010186+0000","last_peered":"2024-04-01T16:34:55.010186+0000","last_clean":"2024-04-01T16:34:55.010186+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T16:34:55.010186+0000","last_undegraded":"2024-04-01T16:34:55.010186+0000","last_fullsized":"2024-04-01T16:34:55.010186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504130+0000","last_change":"2024-04-01T16:34:31.562761+0000","last_active":"2024-04-01T16:34:54.504130+0000","last_peered":"2024-04-01T16:34:54.504130+0000","last_clean":"2024-04-01T16:34:54.504130+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T16:34:54.504130+0000","last_undegraded":"2024-04-01T16:34:54.504130+0000","last_fullsized":"2024-04-01T16:34:54.504130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:23:33.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543747+0000","last_change":"2024-04-01T16:34:34.039521+0000","last_active":"2024-04-01T16:34:54.543747+0000","last_peered":"2024-04-01T16:34:54.543747+0000","last_clean":"2024-04-01T16:34:54.543747+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T16:34:54.543747+0000","last_undegraded":"2024-04-01T16:34:54.543747+0000","last_fullsized":"2024-04-01T16:34:54.543747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543415+0000","last_change":"2024-04-01T16:34:08.195697+0000","last_active":"2024-04-01T16:34:54.543415+0000","last_peered":"2024-04-01T16:34:54.543415+0000","last_clean":"2024-04-01T16:34:54.543415+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T16:34:54.543415+0000","last_undegraded":"2024-04-01T16:34:54.543415+0000","last_fullsized":"2024-04-01T16:34:54.543415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_clean_scrub_stamp":"2024-04-01T16:34:06.247737+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:05:51.067541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.009900+0000","last_change":"2024-04-01T16:34:31.569697+0000","last_active":"2024-04-01T16:34:55.009900+0000","last_peered":"2024-04-01T16:34:55.009900+0000","last_clean":"2024-04-01T16:34:55.009900+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T16:34:55.009900+0000","last_undegraded":"2024-04-01T16:34:55.009900+0000","last_fullsized":"2024-04-01T16:34:55.009900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.736852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500620+0000","last_change":"2024-04-01T16:34:34.087298+0000","last_active":"2024-04-01T16:34:54.500620+0000","last_peered":"2024-04-01T16:34:54.500620+0000","last_clean":"2024-04-01T16:34:54.500620+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T16:34:54.500620+0000","last_undegraded":"2024-04-01T16:34:54.500620+0000","last_fullsized":"2024-04-01T16:34:54.500620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542776+0000","last_change":"2024-04-01T16:34:31.509150+0000","last_active":"2024-04-01T16:34:54.542776+0000","last_peered":"2024-04-01T16:34:54.542776+0000","last_clean":"2024-04-01T16:34:54.542776+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T16:34:54.542776+0000","last_undegraded":"2024-04-01T16:34:54.542776+0000","last_fullsized":"2024-04-01T16:34:54.542776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.001494+0000","last_change":"2024-04-01T16:34:34.068444+0000","last_active":"2024-04-01T16:34:55.001494+0000","last_peered":"2024-04-01T16:34:55.001494+0000","last_clean":"2024-04-01T16:34:55.001494+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T16:34:55.001494+0000","last_undegraded":"2024-04-01T16:34:55.001494+0000","last_fullsized":"2024-04-01T16:34:55.001494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:04.104676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.503955+0000","last_change":"2024-04-01T16:34:31.512295+0000","last_active":"2024-04-01T16:34:54.503955+0000","last_peered":"2024-04-01T16:34:54.503955+0000","last_clean":"2024-04-01T16:34:54.503955+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T16:34:54.503955+0000","last_undegraded":"2024-04-01T16:34:54.503955+0000","last_fullsized":"2024-04-01T16:34:54.503955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:35.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507321+0000","last_change":"2024-04-01T16:34:34.083194+0000","last_active":"2024-04-01T16:34:54.507321+0000","last_peered":"2024-04-01T16:34:54.507321+0000","last_clean":"2024-04-01T16:34:54.507321+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T16:34:54.507321+0000","last_undegraded":"2024-04-01T16:34:54.507321+0000","last_fullsized":"2024-04-01T16:34:54.507321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010222+0000","last_change":"2024-04-01T16:34:31.569571+0000","last_active":"2024-04-01T16:34:55.010222+0000","last_peered":"2024-04-01T16:34:55.010222+0000","last_clean":"2024-04-01T16:34:55.010222+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T16:34:55.010222+0000","last_undegraded":"2024-04-01T16:34:55.010222+0000","last_fullsized":"2024-04-01T16:34:55.010222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:10.626933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.008282+0000","last_change":"2024-04-01T16:34:34.063200+0000","last_active":"2024-04-01T16:34:55.008282+0000","last_peered":"2024-04-01T16:34:55.008282+0000","last_clean":"2024-04-01T16:34:55.008282+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T16:34:55.008282+0000","last_undegraded":"2024-04-01T16:34:55.008282+0000","last_fullsized":"2024-04-01T16:34:55.008282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:18.399835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507079+0000","last_change":"2024-04-01T16:34:31.512508+0000","last_active":"2024-04-01T16:34:54.507079+0000","last_peered":"2024-04-01T16:34:54.507079+0000","last_clean":"2024-04-01T16:34:54.507079+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T16:34:54.507079+0000","last_undegraded":"2024-04-01T16:34:54.507079+0000","last_fullsized":"2024-04-01T16:34:54.507079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.515324+0000","last_change":"2024-04-01T16:34:54.510347+0000","last_active":"2024-04-01T16:34:54.515324+0000","last_peered":"2024-04-01T16:34:54.515324+0000","last_clean":"2024-04-01T16:34:54.515324+0000","last_became_active":"2024-04-01T16:34:54.509976+0000","last_became_peered":"2024-04-01T16:34:54.509976+0000","last_unstale":"2024-04-01T16:34:54.515324+0000","last_undegraded":"2024-04-01T16:34:54.515324+0000","last_fullsized":"2024-04-01T16:34:54.515324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:41:48.631612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543670+0000","last_change":"2024-04-01T16:34:31.426647+0000","last_active":"2024-04-01T16:34:54.543670+0000","last_peered":"2024-04-01T16:34:54.543670+0000","last_clean":"2024-04-01T16:34:54.543670+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T16:34:54.543670+0000","last_undegraded":"2024-04-01T16:34:54.543670+0000","last_fullsized":"2024-04-01T16:34:54.543670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:36.926701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.506967+0000","last_change":"2024-04-01T16:34:34.087431+0000","last_active":"2024-04-01T16:34:54.506967+0000","last_peered":"2024-04-01T16:34:54.506967+0000","last_clean":"2024-04-01T16:34:54.506967+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T16:34:54.506967+0000","last_undegraded":"2024-04-01T16:34:54.506967+0000","last_fullsized":"2024-04-01T16:34:54.506967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507371+0000","last_change":"2024-04-01T16:34:31.528790+0000","last_active":"2024-04-01T16:34:54.507371+0000","last_peered":"2024-04-01T16:34:54.507371+0000","last_clean":"2024-04-01T16:34:54.507371+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T16:34:54.507371+0000","last_undegraded":"2024-04-01T16:34:54.507371+0000","last_fullsized":"2024-04-01T16:34:54.507371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.501403+0000","last_change":"2024-04-01T16:34:34.085832+0000","last_active":"2024-04-01T16:34:54.501403+0000","last_peered":"2024-04-01T16:34:54.501403+0000","last_clean":"2024-04-01T16:34:54.501403+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T16:34:54.501403+0000","last_undegraded":"2024-04-01T16:34:54.501403+0000","last_fullsized":"2024-04-01T16:34:54.501403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.504313+0000","last_change":"2024-04-01T16:34:31.534057+0000","last_active":"2024-04-01T16:34:54.504313+0000","last_peered":"2024-04-01T16:34:54.504313+0000","last_clean":"2024-04-01T16:34:54.504313+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T16:34:54.504313+0000","last_undegraded":"2024-04-01T16:34:54.504313+0000","last_fullsized":"2024-04-01T16:34:54.504313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002868+0000","last_change":"2024-04-01T16:34:34.073261+0000","last_active":"2024-04-01T16:34:55.002868+0000","last_peered":"2024-04-01T16:34:55.002868+0000","last_clean":"2024-04-01T16:34:55.002868+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T16:34:55.002868+0000","last_undegraded":"2024-04-01T16:34:55.002868+0000","last_fullsized":"2024-04-01T16:34:55.002868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:38.619969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.542511+0000","last_change":"2024-04-01T16:34:31.423531+0000","last_active":"2024-04-01T16:34:54.542511+0000","last_peered":"2024-04-01T16:34:54.542511+0000","last_clean":"2024-04-01T16:34:54.542511+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T16:34:54.542511+0000","last_undegraded":"2024-04-01T16:34:54.542511+0000","last_fullsized":"2024-04-01T16:34:54.542511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.007775+0000","last_change":"2024-04-01T16:34:34.086029+0000","last_active":"2024-04-01T16:34:55.007775+0000","last_peered":"2024-04-01T16:34:55.007775+0000","last_clean":"2024-04-01T16:34:55.007775+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T16:34:55.007775+0000","last_undegraded":"2024-04-01T16:34:55.007775+0000","last_fullsized":"2024-04-01T16:34:55.007775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.508000+0000","last_change":"2024-04-01T16:34:31.509351+0000","last_active":"2024-04-01T16:34:54.508000+0000","last_peered":"2024-04-01T16:34:54.508000+0000","last_clean":"2024-04-01T16:34:54.508000+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T16:34:54.508000+0000","last_undegraded":"2024-04-01T16:34:54.508000+0000","last_fullsized":"2024-04-01T16:34:54.508000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.500527+0000","last_change":"2024-04-01T16:34:34.091932+0000","last_active":"2024-04-01T16:34:54.500527+0000","last_peered":"2024-04-01T16:34:54.500527+0000","last_clean":"2024-04-01T16:34:54.500527+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T16:34:54.500527+0000","last_undegraded":"2024-04-01T16:34:54.500527+0000","last_fullsized":"2024-04-01T16:34:54.500527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:11:00.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.507136+0000","last_change":"2024-04-01T16:34:31.517513+0000","last_active":"2024-04-01T16:34:54.507136+0000","last_peered":"2024-04-01T16:34:54.507136+0000","last_clean":"2024-04-01T16:34:54.507136+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T16:34:54.507136+0000","last_undegraded":"2024-04-01T16:34:54.507136+0000","last_fullsized":"2024-04-01T16:34:54.507136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:31.608594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.004709+0000","last_change":"2024-04-01T16:34:55.004709+0000","last_active":"2024-04-01T16:34:55.004709+0000","last_peered":"2024-04-01T16:34:55.004709+0000","last_clean":"2024-04-01T16:34:55.004709+0000","last_became_active":"2024-04-01T16:34:55.003987+0000","last_became_peered":"2024-04-01T16:34:55.003987+0000","last_unstale":"2024-04-01T16:34:55.004709+0000","last_undegraded":"2024-04-01T16:34:55.004709+0000","last_fullsized":"2024-04-01T16:34:55.004709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543847+0000","last_change":"2024-04-01T16:34:31.444603+0000","last_active":"2024-04-01T16:34:54.543847+0000","last_peered":"2024-04-01T16:34:54.543847+0000","last_clean":"2024-04-01T16:34:54.543847+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T16:34:54.543847+0000","last_undegraded":"2024-04-01T16:34:54.543847+0000","last_fullsized":"2024-04-01T16:34:54.543847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.502835+0000","last_change":"2024-04-01T16:34:34.034061+0000","last_active":"2024-04-01T16:34:54.502835+0000","last_peered":"2024-04-01T16:34:54.502835+0000","last_clean":"2024-04-01T16:34:54.502835+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T16:34:54.502835+0000","last_undegraded":"2024-04-01T16:34:54.502835+0000","last_fullsized":"2024-04-01T16:34:54.502835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.014117+0000","last_change":"2024-04-01T16:34:55.011962+0000","last_active":"2024-04-01T16:34:55.014117+0000","last_peered":"2024-04-01T16:34:55.014117+0000","last_clean":"2024-04-01T16:34:55.014117+0000","last_became_active":"2024-04-01T16:34:55.011400+0000","last_became_peered":"2024-04-01T16:34:55.011400+0000","last_unstale":"2024-04-01T16:34:55.014117+0000","last_undegraded":"2024-04-01T16:34:55.014117+0000","last_fullsized":"2024-04-01T16:34:55.014117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:14:52.381836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543077+0000","last_change":"2024-04-01T16:34:31.563882+0000","last_active":"2024-04-01T16:34:54.543077+0000","last_peered":"2024-04-01T16:34:54.543077+0000","last_clean":"2024-04-01T16:34:54.543077+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T16:34:54.543077+0000","last_undegraded":"2024-04-01T16:34:54.543077+0000","last_fullsized":"2024-04-01T16:34:54.543077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:27.209535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.010099+0000","last_change":"2024-04-01T16:34:34.034904+0000","last_active":"2024-04-01T16:34:55.010099+0000","last_peered":"2024-04-01T16:34:55.010099+0000","last_clean":"2024-04-01T16:34:55.010099+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T16:34:55.010099+0000","last_undegraded":"2024-04-01T16:34:55.010099+0000","last_fullsized":"2024-04-01T16:34:55.010099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.543474+0000","last_change":"2024-04-01T16:34:31.530246+0000","last_active":"2024-04-01T16:34:54.543474+0000","last_peered":"2024-04-01T16:34:54.543474+0000","last_clean":"2024-04-01T16:34:54.543474+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T16:34:54.543474+0000","last_undegraded":"2024-04-01T16:34:54.543474+0000","last_fullsized":"2024-04-01T16:34:54.543474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:48.430325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.002793+0000","last_change":"2024-04-01T16:34:34.066381+0000","last_active":"2024-04-01T16:34:55.002793+0000","last_peered":"2024-04-01T16:34:55.002793+0000","last_clean":"2024-04-01T16:34:55.002793+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T16:34:55.002793+0000","last_undegraded":"2024-04-01T16:34:55.002793+0000","last_fullsized":"2024-04-01T16:34:55.002793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:10.824493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.501493+0000","last_change":"2024-04-01T16:34:31.490535+0000","last_active":"2024-04-01T16:34:54.501493+0000","last_peered":"2024-04-01T16:34:54.501493+0000","last_clean":"2024-04-01T16:34:54.501493+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T16:34:54.501493+0000","last_undegraded":"2024-04-01T16:34:54.501493+0000","last_fullsized":"2024-04-01T16:34:54.501493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:24.709969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:54.501287+0000","last_change":"2024-04-01T16:34:34.087097+0000","last_active":"2024-04-01T16:34:54.501287+0000","last_peered":"2024-04-01T16:34:54.501287+0000","last_clean":"2024-04-01T16:34:54.501287+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T16:34:54.501287+0000","last_undegraded":"2024-04-01T16:34:54.501287+0000","last_fullsized":"2024-04-01T16:34:54.501287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:17:48.287828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"24'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T16:34:55.003040+0000","last_change":"2024-04-01T16:34:31.420599+0000","last_active":"2024-04-01T16:34:55.003040+0000","last_peered":"2024-04-01T16:34:55.003040+0000","last_clean":"2024-04-01T16:34:55.003040+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T16:34:55.003040+0000","last_undegraded":"2024-04-01T16:34:55.003040+0000","last_fullsized":"2024-04-01T16:34:55.003040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":697840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":106890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":697896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":106980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":107016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":108502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":108502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":107050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T16:35:05.131 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-01T16:35:05.132 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-01T16:35:05.132 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-01T16:35:05.132 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-01T16:35:05.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.371+0000 7f43dd200640 1 Processor -- start 2024-04-01T16:35:05.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.372+0000 7f43dd200640 1 -- start start 2024-04-01T16:35:05.372 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.373+0000 7f43dd200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43d80c2440 0x7f43d815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:05.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.373+0000 7f43dd200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f43d806f040 0x7f43d80c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:05.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.373+0000 7f43dd200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f43d806e130 0x7f43d806e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:05.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.373+0000 7f43dd200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f43d806dca0 con 0x7f43d806f040 2024-04-01T16:35:05.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.373+0000 7f43dd200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f43d806eb00 con 0x7f43d806e130 2024-04-01T16:35:05.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.373+0000 7f43dd200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f43d815df50 con 0x7f43d80c2440 2024-04-01T16:35:05.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.374+0000 7f43cd400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f43d806f040 0x7f43d80c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:05.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.374+0000 7f43cd400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f43d806f040 0x7f43d80c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:32868/0 (socket says 172.21.15.163:32868) 2024-04-01T16:35:05.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.374+0000 7f43cd400640 1 -- 172.21.15.163:0/279182498 learned_addr learned my addr 172.21.15.163:0/279182498 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:05.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.375+0000 7f43d5e00640 1 --2- 172.21.15.163:0/279182498 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43d80c2440 0x7f43d815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:05.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.375+0000 7f43d6800640 1 --2- 172.21.15.163:0/279182498 >> v2:172.21.15.189:3300/0 conn(0x7f43d806e130 0x7f43d806e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:05.376 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.377+0000 7f43cd400640 1 -- 172.21.15.163:0/279182498 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43d80c2440 msgr2=0x7f43d815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:05.376 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.377+0000 7f43cd400640 1 --2- 172.21.15.163:0/279182498 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43d80c2440 0x7f43d815b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:05.376 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.377+0000 7f43cd400640 1 -- 172.21.15.163:0/279182498 >> v2:172.21.15.189:3300/0 conn(0x7f43d806e130 msgr2=0x7f43d806e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:05.376 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.377+0000 7f43cd400640 1 --2- 172.21.15.163:0/279182498 >> v2:172.21.15.189:3300/0 conn(0x7f43d806e130 0x7f43d806e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:05.376 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.377+0000 7f43cd400640 1 -- 172.21.15.163:0/279182498 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d815e230 con 0x7f43d806f040 2024-04-01T16:35:05.378 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.379+0000 7f43cd400640 1 --2- 172.21.15.163:0/279182498 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d806f040 0x7f43d80c2820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f43d80680f0 tx=0x7f43c002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c08e17b062c9c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:05.383 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.384+0000 7f43d5400640 1 -- 172.21.15.163:0/279182498 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0034070 con 0x7f43d806f040 2024-04-01T16:35:05.383 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.384+0000 7f43d5400640 1 -- 172.21.15.163:0/279182498 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c0030850 con 0x7f43d806f040 2024-04-01T16:35:05.383 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.384+0000 7f43d5400640 1 -- 172.21.15.163:0/279182498 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0030c20 con 0x7f43d806f040 2024-04-01T16:35:05.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.384+0000 7f43dd200640 1 -- 172.21.15.163:0/279182498 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d806f040 msgr2=0x7f43d80c2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:05.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.384+0000 7f43dd200640 1 --2- 172.21.15.163:0/279182498 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d806f040 0x7f43d80c2820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f43d80680f0 tx=0x7f43c002b990 comp rx=0 tx=0).stop 2024-04-01T16:35:05.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.385+0000 7f43dd200640 1 -- 172.21.15.163:0/279182498 shutdown_connections 2024-04-01T16:35:05.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.385+0000 7f43dd200640 1 --2- 172.21.15.163:0/279182498 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d806f040 0x7f43d80c2820 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:05.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.385+0000 7f43dd200640 1 --2- 172.21.15.163:0/279182498 >> v2:172.21.15.189:3300/0 conn(0x7f43d806e130 0x7f43d806e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:05.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.385+0000 7f43dd200640 1 --2- 172.21.15.163:0/279182498 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43d80c2440 0x7f43d815b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:05.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.385+0000 7f43dd200640 1 -- 172.21.15.163:0/279182498 >> 172.21.15.163:0/279182498 conn(0x7f43d80c8a00 msgr2=0x7f43d80c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:05.384 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.385+0000 7f43dd200640 1 -- 172.21.15.163:0/279182498 shutdown_connections 2024-04-01T16:35:05.385 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.385+0000 7f43dd200640 1 -- 172.21.15.163:0/279182498 wait complete. 2024-04-01T16:35:05.386 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.386+0000 7f43dd200640 1 Processor -- start 2024-04-01T16:35:05.386 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.387+0000 7f43dd200640 1 -- start start 2024-04-01T16:35:05.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.388+0000 7f43dd200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43d806e130 0x7f43d81e5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:05.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.388+0000 7f43dd200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d80c2440 0x7f43d81f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:05.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.388+0000 7f43dd200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43d814e660 0x7f43d8153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:05.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.388+0000 7f43dd200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f43d815ead0 con 0x7f43d80c2440 2024-04-01T16:35:05.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.388+0000 7f43dd200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f43d815e7f0 con 0x7f43d806e130 2024-04-01T16:35:05.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.388+0000 7f43dd200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f43d8154aa0 con 0x7f43d814e660 2024-04-01T16:35:05.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.389+0000 7f43d5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43d806e130 0x7f43d81e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:05.389 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.389+0000 7f43d6800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43d814e660 0x7f43d8153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:05.389 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.390+0000 7f43d5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43d806e130 0x7f43d81e5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:60094/0 (socket says 172.21.15.163:60094) 2024-04-01T16:35:05.389 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.390+0000 7f43d5e00640 1 -- 172.21.15.163:0/1710365507 learned_addr learned my addr 172.21.15.163:0/1710365507 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:05.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.391+0000 7f43cd400640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d80c2440 0x7f43d81f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:05.394 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.395+0000 7f43cd400640 1 -- 172.21.15.163:0/1710365507 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43d814e660 msgr2=0x7f43d8153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:05.395 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.395+0000 7f43cd400640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43d814e660 0x7f43d8153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:05.395 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.395+0000 7f43cd400640 1 -- 172.21.15.163:0/1710365507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43d806e130 msgr2=0x7f43d81e5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:05.395 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.395+0000 7f43cd400640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43d806e130 0x7f43d81e5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:05.395 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.395+0000 7f43cd400640 1 -- 172.21.15.163:0/1710365507 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d814bd10 con 0x7f43d80c2440 2024-04-01T16:35:05.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.398+0000 7f43cd400640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d80c2440 0x7f43d81f12b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43c0033000 tx=0x7f43c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:05.402 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.402+0000 7f43cea00640 1 -- 172.21.15.163:0/1710365507 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0048070 con 0x7f43d80c2440 2024-04-01T16:35:05.402 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.402+0000 7f43cea00640 1 -- 172.21.15.163:0/1710365507 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c0030650 con 0x7f43d80c2440 2024-04-01T16:35:05.402 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.402+0000 7f43cea00640 1 -- 172.21.15.163:0/1710365507 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0034040 con 0x7f43d80c2440 2024-04-01T16:35:05.402 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.402+0000 7f43dd200640 1 -- 172.21.15.163:0/1710365507 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d814bfb0 con 0x7f43d80c2440 2024-04-01T16:35:05.402 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.402+0000 7f43dd200640 1 -- 172.21.15.163:0/1710365507 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d81f4240 con 0x7f43d80c2440 2024-04-01T16:35:05.403 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.404+0000 7f43dd200640 1 -- 172.21.15.163:0/1710365507 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d80756d0 con 0x7f43d80c2440 2024-04-01T16:35:05.720 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.720+0000 7f43cea00640 1 -- 172.21.15.163:0/1710365507 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43c004b070 con 0x7f43d80c2440 2024-04-01T16:35:05.722 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.723+0000 7f43cea00640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f43b406c970 0x7f43b406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:05.723 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.724+0000 7f43d5e00640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f43b406c970 0x7f43b406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:05.725 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.725+0000 7f43d5e00640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f43b406c970 0x7f43b406ee30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43c8007a60 tx=0x7f43c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:05.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.760+0000 7f43cea00640 1 -- 172.21.15.163:0/1710365507 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f43c0030800 con 0x7f43d80c2440 2024-04-01T16:35:05.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:05.761+0000 7f43cea00640 1 -- 172.21.15.163:0/1710365507 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f43c0052080 con 0x7f43d80c2440 2024-04-01T16:35:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.017+0000 7f43dd200640 1 -- 172.21.15.163:0/1710365507 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f43d8072f60 con 0x7f43d80c2440 2024-04-01T16:35:06.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.029+0000 7f43cea00640 1 -- 172.21.15.163:0/1710365507 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f43c007bd90 con 0x7f43d80c2440 2024-04-01T16:35:06.029 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:35:06.029 INFO:teuthology.orchestra.run.smithi163.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-01T16:35:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.032+0000 7f43dd200640 1 -- 172.21.15.163:0/1710365507 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f43b406c970 msgr2=0x7f43b406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.032+0000 7f43dd200640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f43b406c970 0x7f43b406ee30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43c8007a60 tx=0x7f43c8008040 comp rx=0 tx=0).stop 2024-04-01T16:35:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.032+0000 7f43dd200640 1 -- 172.21.15.163:0/1710365507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d80c2440 msgr2=0x7f43d81f12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.032+0000 7f43dd200640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d80c2440 0x7f43d81f12b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43c0033000 tx=0x7f43c0004730 comp rx=0 tx=0).stop 2024-04-01T16:35:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.032+0000 7f43dd200640 1 -- 172.21.15.163:0/1710365507 shutdown_connections 2024-04-01T16:35:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.032+0000 7f43dd200640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f43b406c970 0x7f43b406ee30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.032+0000 7f43dd200640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f43d814e660 0x7f43d8153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.032+0000 7f43dd200640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43d80c2440 0x7f43d81f12b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.032+0000 7f43dd200640 1 --2- 172.21.15.163:0/1710365507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43d806e130 0x7f43d81e5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.032+0000 7f43dd200640 1 -- 172.21.15.163:0/1710365507 >> 172.21.15.163:0/1710365507 conn(0x7f43d80c8a00 msgr2=0x7f43d814f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.032+0000 7f43dd200640 1 -- 172.21.15.163:0/1710365507 shutdown_connections 2024-04-01T16:35:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.032+0000 7f43dd200640 1 -- 172.21.15.163:0/1710365507 wait complete. 2024-04-01T16:35:06.051 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-01T16:35:06.051 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T16:35:06.258 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.259+0000 7f6c30200640 1 Processor -- start 2024-04-01T16:35:06.259 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.259+0000 7f6c30200640 1 -- start start 2024-04-01T16:35:06.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.261+0000 7f6c30200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6c2806edd0 0x7f6c28163f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:06.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.261+0000 7f6c30200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c281589d0 con 0x7f6c28070010 2024-04-01T16:35:06.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.261+0000 7f6c30200640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c28158cb0 con 0x7f6c28152760 2024-04-01T16:35:06.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.261+0000 7f6c30200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f6c28159550 con 0x7f6c2806edd0 2024-04-01T16:35:06.261 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.262+0000 7f6c2d800640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f6c28152760 0x7f6c280c99a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:60642/0 (socket says 172.21.15.163:60642) 2024-04-01T16:35:06.261 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.262+0000 7f6c2d800640 1 -- 172.21.15.163:0/491149587 learned_addr learned my addr 172.21.15.163:0/491149587 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:35:06.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.314+0000 7f6c2e200640 1 --2- 172.21.15.163:0/491149587 >> v2:172.21.15.163:3300/0 conn(0x7f6c2806edd0 0x7f6c28163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:06.323 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.323+0000 7f6c2e200640 1 -- 172.21.15.163:0/491149587 >> v1:172.21.15.189:6789/0 conn(0x7f6c28152760 legacy=0x7f6c280c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:06.323 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.323+0000 7f6c2e200640 1 -- 172.21.15.163:0/491149587 >> v1:172.21.15.163:6789/0 conn(0x7f6c28070010 legacy=0x7f6c2815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:06.323 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.323+0000 7f6c2e200640 1 -- 172.21.15.163:0/491149587 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c28158f90 con 0x7f6c2806edd0 2024-04-01T16:35:06.336 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.336+0000 7f6c2e200640 1 --2- 172.21.15.163:0/491149587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c2806edd0 0x7f6c28163f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6c281596d0 tx=0x7f6c2002bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64883efdc79f9d24 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:06.346 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.347+0000 7f6c27e00640 1 -- 172.21.15.163:0/491149587 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20039070 con 0x7f6c2806edd0 2024-04-01T16:35:06.346 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.347+0000 7f6c27e00640 1 -- 172.21.15.163:0/491149587 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c2002cce0 con 0x7f6c2806edd0 2024-04-01T16:35:06.347 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.347+0000 7f6c27e00640 1 -- 172.21.15.163:0/491149587 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20034660 con 0x7f6c2806edd0 2024-04-01T16:35:06.347 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.348+0000 7f6c30200640 1 -- 172.21.15.163:0/491149587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c2806edd0 msgr2=0x7f6c28163f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:06.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.348+0000 7f6c30200640 1 --2- 172.21.15.163:0/491149587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c2806edd0 0x7f6c28163f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6c281596d0 tx=0x7f6c2002bf30 comp rx=0 tx=0).stop 2024-04-01T16:35:06.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.348+0000 7f6c30200640 1 -- 172.21.15.163:0/491149587 shutdown_connections 2024-04-01T16:35:06.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.348+0000 7f6c30200640 1 --2- 172.21.15.163:0/491149587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c2806edd0 0x7f6c28163f20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:06.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.348+0000 7f6c30200640 1 -- 172.21.15.163:0/491149587 >> 172.21.15.163:0/491149587 conn(0x7f6c2806c650 msgr2=0x7f6c2806ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:06.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.349+0000 7f6c30200640 1 -- 172.21.15.163:0/491149587 shutdown_connections 2024-04-01T16:35:06.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.349+0000 7f6c30200640 1 -- 172.21.15.163:0/491149587 wait complete. 2024-04-01T16:35:06.352 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.352+0000 7f6c30200640 1 Processor -- start 2024-04-01T16:35:06.352 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.352+0000 7f6c30200640 1 -- start start 2024-04-01T16:35:06.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.354+0000 7f6c30200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c2806edd0 0x7f6c2814eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:06.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.354+0000 7f6c30200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c28070010 0x7f6c281f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:06.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.354+0000 7f6c30200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c28152760 0x7f6c281f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:06.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.354+0000 7f6c30200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6c28071910 con 0x7f6c28070010 2024-04-01T16:35:06.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.354+0000 7f6c30200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2815bcb0 con 0x7f6c28152760 2024-04-01T16:35:06.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.354+0000 7f6c30200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6c280ca0b0 con 0x7f6c2806edd0 2024-04-01T16:35:06.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.355+0000 7f6c2ce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c28070010 0x7f6c281f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:06.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.356+0000 7f6c2ce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c28070010 0x7f6c281f1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:32908/0 (socket says 172.21.15.163:32908) 2024-04-01T16:35:06.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.356+0000 7f6c2ce00640 1 -- 172.21.15.163:0/2428040806 learned_addr learned my addr 172.21.15.163:0/2428040806 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:06.359 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.360+0000 7f6c2ce00640 1 -- 172.21.15.163:0/2428040806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c2806edd0 msgr2=0x7f6c2814eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:06.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.360+0000 7f6c2ce00640 1 --2- 172.21.15.163:0/2428040806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c2806edd0 0x7f6c2814eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:06.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.360+0000 7f6c2ce00640 1 -- 172.21.15.163:0/2428040806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c28152760 msgr2=0x7f6c281f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:06.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.360+0000 7f6c2ce00640 1 --2- 172.21.15.163:0/2428040806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c28152760 0x7f6c281f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:06.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.360+0000 7f6c2ce00640 1 -- 172.21.15.163:0/2428040806 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c280c7180 con 0x7f6c28070010 2024-04-01T16:35:06.362 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.363+0000 7f6c2ce00640 1 --2- 172.21.15.163:0/2428040806 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c28070010 0x7f6c281f1f30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c430 tx=0x7f6c1400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:06.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.369+0000 7f6c25600640 1 -- 172.21.15.163:0/2428040806 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c140052d0 con 0x7f6c28070010 2024-04-01T16:35:06.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.369+0000 7f6c25600640 1 -- 172.21.15.163:0/2428040806 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c14005470 con 0x7f6c28070010 2024-04-01T16:35:06.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.369+0000 7f6c25600640 1 -- 172.21.15.163:0/2428040806 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14007260 con 0x7f6c28070010 2024-04-01T16:35:06.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.369+0000 7f6c30200640 1 -- 172.21.15.163:0/2428040806 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c281f1600 con 0x7f6c28070010 2024-04-01T16:35:06.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.370+0000 7f6c30200640 1 -- 172.21.15.163:0/2428040806 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2814f480 con 0x7f6c28070010 2024-04-01T16:35:06.370 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.371+0000 7f6c30200640 1 -- 172.21.15.163:0/2428040806 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c2806d5e0 con 0x7f6c28070010 2024-04-01T16:35:06.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.406+0000 7f6c25600640 1 -- 172.21.15.163:0/2428040806 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c14007400 con 0x7f6c28070010 2024-04-01T16:35:06.407 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.407+0000 7f6c25600640 1 --2- 172.21.15.163:0/2428040806 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6c0806c940 0x7f6c0806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:06.407 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.408+0000 7f6c2d800640 1 --2- 172.21.15.163:0/2428040806 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6c0806c940 0x7f6c0806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:06.409 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.410+0000 7f6c2d800640 1 --2- 172.21.15.163:0/2428040806 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6c0806c940 0x7f6c0806ee00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0015f0 tx=0x7f6c1c007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:06.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.418+0000 7f6c25600640 1 -- 172.21.15.163:0/2428040806 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f6c14057290 con 0x7f6c28070010 2024-04-01T16:35:06.746 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.746+0000 7f6c25600640 1 -- 172.21.15.163:0/2428040806 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6c140598f0 con 0x7f6c28070010 2024-04-01T16:35:06.976 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:06.976+0000 7f6c30200640 1 -- 172.21.15.163:0/2428040806 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c2806d1e0 con 0x7f6c28070010 2024-04-01T16:35:07.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.118+0000 7f6c25600640 1 -- 172.21.15.163:0/2428040806 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+16901 (secure 0 0 0) 0x7f6c2806d1e0 con 0x7f6c28070010 2024-04-01T16:35:07.119 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:35:07.119 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":27,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:53.160271+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T16:34:29.028272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T16:34:31.534879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:35:07.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.123+0000 7f6c30200640 1 -- 172.21.15.163:0/2428040806 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6c0806c940 msgr2=0x7f6c0806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:07.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.123+0000 7f6c30200640 1 --2- 172.21.15.163:0/2428040806 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6c0806c940 0x7f6c0806ee00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0015f0 tx=0x7f6c1c007a40 comp rx=0 tx=0).stop 2024-04-01T16:35:07.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.123+0000 7f6c30200640 1 -- 172.21.15.163:0/2428040806 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c28070010 msgr2=0x7f6c281f1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:07.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.123+0000 7f6c30200640 1 --2- 172.21.15.163:0/2428040806 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c28070010 0x7f6c281f1f30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c430 tx=0x7f6c1400c8f0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.123+0000 7f6c30200640 1 -- 172.21.15.163:0/2428040806 shutdown_connections 2024-04-01T16:35:07.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.123+0000 7f6c30200640 1 --2- 172.21.15.163:0/2428040806 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6c0806c940 0x7f6c0806ee00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.123+0000 7f6c30200640 1 --2- 172.21.15.163:0/2428040806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c28152760 0x7f6c281f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.123+0000 7f6c30200640 1 --2- 172.21.15.163:0/2428040806 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c28070010 0x7f6c281f1f30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.123+0000 7f6c30200640 1 --2- 172.21.15.163:0/2428040806 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6c2806edd0 0x7f6c2814eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.123+0000 7f6c30200640 1 -- 172.21.15.163:0/2428040806 >> 172.21.15.163:0/2428040806 conn(0x7f6c2806c650 msgr2=0x7f6c28150720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:07.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.123+0000 7f6c30200640 1 -- 172.21.15.163:0/2428040806 shutdown_connections 2024-04-01T16:35:07.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.123+0000 7f6c30200640 1 -- 172.21.15.163:0/2428040806 wait complete. 2024-04-01T16:35:07.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T16:34:05.291874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T16:34:29.028272+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T16:34:31.534879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T16:35:07.147 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T16:35:07.363 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.363+0000 7f1f5a800640 1 Processor -- start 2024-04-01T16:35:07.363 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.363+0000 7f1f5a800640 1 -- start start 2024-04-01T16:35:07.364 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.365+0000 7f1f5a800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5406eec0 0x7f1f54158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:07.364 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.365+0000 7f1f5a800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f540c7620 con 0x7f1f54158bb0 2024-04-01T16:35:07.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.365+0000 7f1f5a800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f54152df0 con 0x7f1f54152a10 2024-04-01T16:35:07.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.365+0000 7f1f5a800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5406f320 con 0x7f1f5406eec0 2024-04-01T16:35:07.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.366+0000 7f1f53400640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f1f54152a10 0x7f1f540c4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:60654/0 (socket says 172.21.15.163:60654) 2024-04-01T16:35:07.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.366+0000 7f1f53400640 1 -- 172.21.15.163:0/1082175365 learned_addr learned my addr 172.21.15.163:0/1082175365 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:35:07.366 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.367+0000 7f1f4aa00640 1 --2- 172.21.15.163:0/1082175365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5406eec0 0x7f1f54158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:07.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.369+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819674429 0 0) 0x7f1f540c7620 con 0x7f1f54158bb0 2024-04-01T16:35:07.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.369+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f38003520 con 0x7f1f54158bb0 2024-04-01T16:35:07.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.373+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 144078529 0 0) 0x7f1f54152df0 con 0x7f1f54152a10 2024-04-01T16:35:07.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.373+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f540c7620 con 0x7f1f54152a10 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3981143060 0 0) 0x7f1f38003520 con 0x7f1f54158bb0 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5406eec0 msgr2=0x7f1f54158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 --2- 172.21.15.163:0/1082175365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5406eec0 0x7f1f54158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 >> v1:172.21.15.189:6789/0 conn(0x7f1f54152a10 legacy=0x7f1f540c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5406ead0 con 0x7f1f54158bb0 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7f1f4c001670 con 0x7f1f54158bb0 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 >> v1:172.21.15.163:6789/0 conn(0x7f1f54158bb0 legacy=0x7f1f54162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 --2- 172.21.15.163:0/1082175365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5406eec0 0x7f1f38003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 --2- 172.21.15.163:0/1082175365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f38004120 0x7f1f38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 --2- 172.21.15.163:0/1082175365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f38004d40 0x7f1f380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5406f320 con 0x7f1f38004d40 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3800bb00 con 0x7f1f38004120 2024-04-01T16:35:07.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.374+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3800bd00 con 0x7f1f5406eec0 2024-04-01T16:35:07.376 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.377+0000 7f1f53e00640 1 --2- 172.21.15.163:0/1082175365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f38004d40 0x7f1f380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:07.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.380+0000 7f1f53e00640 1 -- 172.21.15.163:0/1082175365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5406eec0 msgr2=0x7f1f38003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:07.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.380+0000 7f1f53e00640 1 --2- 172.21.15.163:0/1082175365 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f5406eec0 0x7f1f38003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.380+0000 7f1f53e00640 1 -- 172.21.15.163:0/1082175365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f38004120 msgr2=0x7f1f38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:07.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.380+0000 7f1f53e00640 1 --2- 172.21.15.163:0/1082175365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f38004120 0x7f1f38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.380+0000 7f1f53e00640 1 -- 172.21.15.163:0/1082175365 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f38003520 con 0x7f1f38004d40 2024-04-01T16:35:07.382 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.383+0000 7f1f53e00640 1 --2- 172.21.15.163:0/1082175365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f38004d40 0x7f1f380051c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c007ef0 tx=0x7f1f38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed274bcba92e750 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:07.386 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.387+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c039070 con 0x7f1f38004d40 2024-04-01T16:35:07.386 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.387+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4c02c8e0 con 0x7f1f38004d40 2024-04-01T16:35:07.386 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.387+0000 7f1f52a00640 1 -- 172.21.15.163:0/1082175365 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c007b10 con 0x7f1f38004d40 2024-04-01T16:35:07.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.388+0000 7f1f5a800640 1 -- 172.21.15.163:0/1082175365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f38004d40 msgr2=0x7f1f380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:07.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.388+0000 7f1f5a800640 1 --2- 172.21.15.163:0/1082175365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f38004d40 0x7f1f380051c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c007ef0 tx=0x7f1f38005830 comp rx=0 tx=0).stop 2024-04-01T16:35:07.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.388+0000 7f1f53e00640 1 -- 172.21.15.163:0/1082175365 reap_dead start 2024-04-01T16:35:07.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.388+0000 7f1f5a800640 1 -- 172.21.15.163:0/1082175365 shutdown_connections 2024-04-01T16:35:07.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.388+0000 7f1f5a800640 1 -- 172.21.15.163:0/1082175365 >> 172.21.15.163:0/1082175365 conn(0x7f1f540c8a00 msgr2=0x7f1f540c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:07.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.388+0000 7f1f5a800640 1 -- 172.21.15.163:0/1082175365 shutdown_connections 2024-04-01T16:35:07.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.388+0000 7f1f5a800640 1 -- 172.21.15.163:0/1082175365 wait complete. 2024-04-01T16:35:07.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.391+0000 7f1f5a800640 1 Processor -- start 2024-04-01T16:35:07.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.391+0000 7f1f5a800640 1 -- start start 2024-04-01T16:35:07.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.392+0000 7f1f5a800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f38004d40 0x7f1f541e7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:07.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.392+0000 7f1f5a800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f54073390 0x7f1f541f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:07.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.393+0000 7f1f5a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f541f0210 0x7f1f541f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:07.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.393+0000 7f1f5a800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1f540c7e50 con 0x7f1f38004d40 2024-04-01T16:35:07.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.393+0000 7f1f5a800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f540c7b70 con 0x7f1f541f0210 2024-04-01T16:35:07.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.393+0000 7f1f5a800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1f540c8130 con 0x7f1f54073390 2024-04-01T16:35:07.393 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.393+0000 7f1f53400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f38004d40 0x7f1f541e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:07.393 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.394+0000 7f1f53400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f38004d40 0x7f1f541e7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:32932/0 (socket says 172.21.15.163:32932) 2024-04-01T16:35:07.393 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.394+0000 7f1f53400640 1 -- 172.21.15.163:0/1688565249 learned_addr learned my addr 172.21.15.163:0/1688565249 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:07.393 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.394+0000 7f1f4aa00640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f54073390 0x7f1f541f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:07.394 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.394+0000 7f1f53e00640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f541f0210 0x7f1f541f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:07.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.397+0000 7f1f53400640 1 -- 172.21.15.163:0/1688565249 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f54073390 msgr2=0x7f1f541f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:07.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.397+0000 7f1f53400640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f54073390 0x7f1f541f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.398+0000 7f1f53400640 1 -- 172.21.15.163:0/1688565249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f541f0210 msgr2=0x7f1f541f43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:07.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.398+0000 7f1f53400640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f541f0210 0x7f1f541f43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.398+0000 7f1f53400640 1 -- 172.21.15.163:0/1688565249 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f541f06a0 con 0x7f1f38004d40 2024-04-01T16:35:07.400 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.401+0000 7f1f53400640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f38004d40 0x7f1f541e7160 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1f44001f60 tx=0x7f1f4400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:07.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.405+0000 7f1f4be00640 1 -- 172.21.15.163:0/1688565249 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44017070 con 0x7f1f38004d40 2024-04-01T16:35:07.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.405+0000 7f1f4be00640 1 -- 172.21.15.163:0/1688565249 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f440020b0 con 0x7f1f38004d40 2024-04-01T16:35:07.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.405+0000 7f1f4be00640 1 -- 172.21.15.163:0/1688565249 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44012600 con 0x7f1f38004d40 2024-04-01T16:35:07.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.405+0000 7f1f5a800640 1 -- 172.21.15.163:0/1688565249 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f541f0980 con 0x7f1f38004d40 2024-04-01T16:35:07.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.405+0000 7f1f5a800640 1 -- 172.21.15.163:0/1688565249 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f541f0f40 con 0x7f1f38004d40 2024-04-01T16:35:07.406 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.407+0000 7f1f5a800640 1 -- 172.21.15.163:0/1688565249 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f540756d0 con 0x7f1f38004d40 2024-04-01T16:35:07.427 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.427+0000 7f1f4be00640 1 -- 172.21.15.163:0/1688565249 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f4401a070 con 0x7f1f38004d40 2024-04-01T16:35:07.428 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.429+0000 7f1f4be00640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1f3006c940 0x7f1f3006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:07.429 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.429+0000 7f1f4aa00640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1f3006c940 0x7f1f3006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:07.429 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.430+0000 7f1f4be00640 1 -- 172.21.15.163:0/1688565249 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f1f44057d20 con 0x7f1f38004d40 2024-04-01T16:35:07.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.431+0000 7f1f4aa00640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1f3006c940 0x7f1f3006ee00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1f540b0ae0 tx=0x7f1f3c006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:07.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.730+0000 7f1f4be00640 1 -- 172.21.15.163:0/1688565249 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1f44059c80 con 0x7f1f38004d40 2024-04-01T16:35:07.942 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.942+0000 7f1f5a800640 1 -- 172.21.15.163:0/1688565249 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1f541f1140 con 0x7f1f38004d40 2024-04-01T16:35:07.983 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.983+0000 7f1f4be00640 1 -- 172.21.15.163:0/1688565249 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f1f4405df80 con 0x7f1f38004d40 2024-04-01T16:35:07.983 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2024-04-01T16:35:07.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.987+0000 7f1f5a800640 1 -- 172.21.15.163:0/1688565249 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1f3006c940 msgr2=0x7f1f3006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:07.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.987+0000 7f1f5a800640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1f3006c940 0x7f1f3006ee00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1f540b0ae0 tx=0x7f1f3c006a20 comp rx=0 tx=0).stop 2024-04-01T16:35:07.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.987+0000 7f1f5a800640 1 -- 172.21.15.163:0/1688565249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f38004d40 msgr2=0x7f1f541e7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:07.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.987+0000 7f1f5a800640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f38004d40 0x7f1f541e7160 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1f44001f60 tx=0x7f1f4400a430 comp rx=0 tx=0).stop 2024-04-01T16:35:07.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.987+0000 7f1f5a800640 1 -- 172.21.15.163:0/1688565249 shutdown_connections 2024-04-01T16:35:07.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.987+0000 7f1f5a800640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1f3006c940 0x7f1f3006ee00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.987+0000 7f1f5a800640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f541f0210 0x7f1f541f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.987+0000 7f1f5a800640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1f54073390 0x7f1f541f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.987+0000 7f1f5a800640 1 --2- 172.21.15.163:0/1688565249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f38004d40 0x7f1f541e7160 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:07.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.987+0000 7f1f5a800640 1 -- 172.21.15.163:0/1688565249 >> 172.21.15.163:0/1688565249 conn(0x7f1f540c8a00 msgr2=0x7f1f540c9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:07.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.987+0000 7f1f5a800640 1 -- 172.21.15.163:0/1688565249 shutdown_connections 2024-04-01T16:35:07.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:07.987+0000 7f1f5a800640 1 -- 172.21.15.163:0/1688565249 wait complete. 2024-04-01T16:35:08.009 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T16:35:08.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.221+0000 7f1279c00640 1 Processor -- start 2024-04-01T16:35:08.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.221+0000 7f1279c00640 1 -- start start 2024-04-01T16:35:08.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.222+0000 7f1279c00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f127406b540 0x7f12740c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:08.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.222+0000 7f1279c00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f127415e650 0x7f1274073260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:08.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.222+0000 7f1279c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12740c78f0 con 0x7f1274154870 2024-04-01T16:35:08.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.222+0000 7f1279c00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f12740c7bd0 con 0x7f127415e650 2024-04-01T16:35:08.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.222+0000 7f1279c00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f12740c7eb0 con 0x7f127406b540 2024-04-01T16:35:08.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.223+0000 7f1273e00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f1274154870 0x7f1274072640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:54642/0 (socket says 172.21.15.163:54642) 2024-04-01T16:35:08.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.223+0000 7f1273e00640 1 -- 172.21.15.163:0/2362075218 learned_addr learned my addr 172.21.15.163:0/2362075218 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:35:08.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.224+0000 7f1279200640 1 --2- 172.21.15.163:0/2362075218 >> v2:172.21.15.189:3300/0 conn(0x7f127415e650 0x7f1274073260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:08.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.224+0000 7f1273400640 1 --2- 172.21.15.163:0/2362075218 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f127406b540 0x7f12740c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:08.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.226+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772011695 0 0) 0x7f12740c78f0 con 0x7f1274154870 2024-04-01T16:35:08.226 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.226+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1258003520 con 0x7f1274154870 2024-04-01T16:35:08.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.230+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1265699919 0 0) 0x7f1258003520 con 0x7f1274154870 2024-04-01T16:35:08.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.230+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f127406b540 msgr2=0x7f12740c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:08.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.230+0000 7f1272a00640 1 --2- 172.21.15.163:0/2362075218 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f127406b540 0x7f12740c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.230+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 >> v2:172.21.15.189:3300/0 conn(0x7f127415e650 msgr2=0x7f1274073260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.230+0000 7f1272a00640 1 --2- 172.21.15.163:0/2362075218 >> v2:172.21.15.189:3300/0 conn(0x7f127415e650 0x7f1274073260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.230+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12740c8190 con 0x7f1274154870 2024-04-01T16:35:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.230+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7f1264001670 con 0x7f1274154870 2024-04-01T16:35:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.230+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 >> v1:172.21.15.163:6789/0 conn(0x7f1274154870 legacy=0x7f1274072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.230+0000 7f1272a00640 1 --2- 172.21.15.163:0/2362075218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12580039b0 0x7f1258003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.230+0000 7f1272a00640 1 --2- 172.21.15.163:0/2362075218 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1258004800 0x7f1258004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.231+0000 7f1272a00640 1 --2- 172.21.15.163:0/2362075218 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f127406b540 0x7f12580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.231+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f12740c7bd0 con 0x7f1258004800 2024-04-01T16:35:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.231+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f12740c7eb0 con 0x7f12580039b0 2024-04-01T16:35:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.231+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f125800b9f0 con 0x7f127406b540 2024-04-01T16:35:08.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.233+0000 7f1273400640 1 --2- 172.21.15.163:0/2362075218 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1258004800 0x7f1258004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:08.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.238+0000 7f1273400640 1 -- 172.21.15.163:0/2362075218 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f127406b540 msgr2=0x7f12580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:08.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.238+0000 7f1273400640 1 --2- 172.21.15.163:0/2362075218 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f127406b540 0x7f12580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:08.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.238+0000 7f1273400640 1 -- 172.21.15.163:0/2362075218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12580039b0 msgr2=0x7f1258003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:08.238 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.238+0000 7f1273400640 1 --2- 172.21.15.163:0/2362075218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12580039b0 0x7f1258003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:08.238 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.238+0000 7f1273400640 1 -- 172.21.15.163:0/2362075218 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1258003520 con 0x7f1258004800 2024-04-01T16:35:08.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.242+0000 7f1273400640 1 --2- 172.21.15.163:0/2362075218 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1258004800 0x7f1258004c80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1260009ac0 tx=0x7f1258005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d61d8883016e129 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:08.247 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.248+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260039070 con 0x7f1258004800 2024-04-01T16:35:08.247 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.248+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126002c710 con 0x7f1258004800 2024-04-01T16:35:08.247 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.248+0000 7f1272a00640 1 -- 172.21.15.163:0/2362075218 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260009690 con 0x7f1258004800 2024-04-01T16:35:08.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.249+0000 7f1279c00640 1 -- 172.21.15.163:0/2362075218 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1258004800 msgr2=0x7f1258004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:08.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.249+0000 7f1279c00640 1 --2- 172.21.15.163:0/2362075218 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1258004800 0x7f1258004c80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1260009ac0 tx=0x7f1258005830 comp rx=0 tx=0).stop 2024-04-01T16:35:08.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.249+0000 7f1279200640 1 -- 172.21.15.163:0/2362075218 reap_dead start 2024-04-01T16:35:08.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.249+0000 7f1279c00640 1 -- 172.21.15.163:0/2362075218 shutdown_connections 2024-04-01T16:35:08.249 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.249+0000 7f1279c00640 1 -- 172.21.15.163:0/2362075218 >> 172.21.15.163:0/2362075218 conn(0x7f1274070130 msgr2=0x7f1274070540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:08.249 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.249+0000 7f1279c00640 1 -- 172.21.15.163:0/2362075218 shutdown_connections 2024-04-01T16:35:08.249 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.249+0000 7f1279c00640 1 -- 172.21.15.163:0/2362075218 wait complete. 2024-04-01T16:35:08.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.251+0000 7f1279c00640 1 Processor -- start 2024-04-01T16:35:08.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.252+0000 7f1279c00640 1 -- start start 2024-04-01T16:35:08.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.253+0000 7f1279c00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1258004800 0x7f127414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:08.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.253+0000 7f1279c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12740c5700 0x7f12741f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:08.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.253+0000 7f1279c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12741f44d0 0x7f12740cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:08.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.253+0000 7f1279c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1274072d50 con 0x7f12740c5700 2024-04-01T16:35:08.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.253+0000 7f1279c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f127415eae0 con 0x7f12741f44d0 2024-04-01T16:35:08.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.253+0000 7f1279c00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1274154c50 con 0x7f1258004800 2024-04-01T16:35:08.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.254+0000 7f1273400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12740c5700 0x7f12741f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:08.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.254+0000 7f1273e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1258004800 0x7f127414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:08.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.255+0000 7f1273400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12740c5700 0x7f12741f3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:32954/0 (socket says 172.21.15.163:32954) 2024-04-01T16:35:08.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.255+0000 7f1273400640 1 -- 172.21.15.163:0/3413940933 learned_addr learned my addr 172.21.15.163:0/3413940933 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:08.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.255+0000 7f1279200640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12741f44d0 0x7f12740cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:08.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.260+0000 7f1273400640 1 -- 172.21.15.163:0/3413940933 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1258004800 msgr2=0x7f127414bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:08.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.260+0000 7f1273400640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1258004800 0x7f127414bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:08.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.260+0000 7f1273400640 1 -- 172.21.15.163:0/3413940933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12741f44d0 msgr2=0x7f12740cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:08.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.260+0000 7f1273400640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12741f44d0 0x7f12740cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:08.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.260+0000 7f1273400640 1 -- 172.21.15.163:0/3413940933 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12741f49d0 con 0x7f12740c5700 2024-04-01T16:35:08.263 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.264+0000 7f1273400640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12740c5700 0x7f12741f3f90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1260009be0 tx=0x7f1260004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:08.268 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.269+0000 7f126be00640 1 -- 172.21.15.163:0/3413940933 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260042020 con 0x7f12740c5700 2024-04-01T16:35:08.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.269+0000 7f126be00640 1 -- 172.21.15.163:0/3413940933 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126003a040 con 0x7f12740c5700 2024-04-01T16:35:08.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.269+0000 7f126be00640 1 -- 172.21.15.163:0/3413940933 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260039070 con 0x7f12740c5700 2024-04-01T16:35:08.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.269+0000 7f1279c00640 1 -- 172.21.15.163:0/3413940933 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12741f4cb0 con 0x7f12740c5700 2024-04-01T16:35:08.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.269+0000 7f1279c00640 1 -- 172.21.15.163:0/3413940933 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12740ca890 con 0x7f12740c5700 2024-04-01T16:35:08.270 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.271+0000 7f1279c00640 1 -- 172.21.15.163:0/3413940933 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12740756d0 con 0x7f12740c5700 2024-04-01T16:35:08.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.291+0000 7f126be00640 1 -- 172.21.15.163:0/3413940933 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1260045020 con 0x7f12740c5700 2024-04-01T16:35:08.292 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.292+0000 7f126be00640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f125406c940 0x7f125406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:08.292 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.293+0000 7f1273e00640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f125406c940 0x7f125406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:08.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.294+0000 7f1273e00640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f125406c940 0x7f125406ee00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1264004c60 tx=0x7f1264001e70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:08.294 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.294+0000 7f126be00640 1 -- 172.21.15.163:0/3413940933 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f1260079000 con 0x7f12740c5700 2024-04-01T16:35:08.579 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.579+0000 7f126be00640 1 -- 172.21.15.163:0/3413940933 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f126004c070 con 0x7f12740c5700 2024-04-01T16:35:08.803 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.804+0000 7f1279c00640 1 -- 172.21.15.163:0/3413940933 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f12740c3250 con 0x7f12740c5700 2024-04-01T16:35:08.824 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.825+0000 7f126be00640 1 -- 172.21.15.163:0/3413940933 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f126007af60 con 0x7f12740c5700 2024-04-01T16:35:08.825 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2024-04-01T16:35:08.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.828+0000 7f1279c00640 1 -- 172.21.15.163:0/3413940933 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f125406c940 msgr2=0x7f125406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:08.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.828+0000 7f1279c00640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f125406c940 0x7f125406ee00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1264004c60 tx=0x7f1264001e70 comp rx=0 tx=0).stop 2024-04-01T16:35:08.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.828+0000 7f1279c00640 1 -- 172.21.15.163:0/3413940933 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12740c5700 msgr2=0x7f12741f3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:08.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.828+0000 7f1279c00640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12740c5700 0x7f12741f3f90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1260009be0 tx=0x7f1260004730 comp rx=0 tx=0).stop 2024-04-01T16:35:08.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.828+0000 7f1279c00640 1 -- 172.21.15.163:0/3413940933 shutdown_connections 2024-04-01T16:35:08.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.828+0000 7f1279c00640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f125406c940 0x7f125406ee00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:08.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.828+0000 7f1279c00640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12741f44d0 0x7f12740cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:08.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.828+0000 7f1279c00640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12740c5700 0x7f12741f3f90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:08.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.828+0000 7f1279c00640 1 --2- 172.21.15.163:0/3413940933 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1258004800 0x7f127414bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:08.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.828+0000 7f1279c00640 1 -- 172.21.15.163:0/3413940933 >> 172.21.15.163:0/3413940933 conn(0x7f1274070130 msgr2=0x7f12740c4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:08.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.828+0000 7f1279c00640 1 -- 172.21.15.163:0/3413940933 shutdown_connections 2024-04-01T16:35:08.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:08.828+0000 7f1279c00640 1 -- 172.21.15.163:0/3413940933 wait complete. 2024-04-01T16:35:08.852 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T16:35:09.072 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.072+0000 7fe3b3800640 1 Processor -- start 2024-04-01T16:35:09.072 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.072+0000 7fe3b3800640 1 -- start start 2024-04-01T16:35:09.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.074+0000 7fe3b3800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe3ac151170 0x7fe3ac0c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:09.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.074+0000 7fe3b3800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ac0c87a0 con 0x7fe3ac0c7710 2024-04-01T16:35:09.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.074+0000 7fe3b3800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ac0c7d00 con 0x7fe3ac06f140 2024-04-01T16:35:09.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.074+0000 7fe3b3800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fe3ac0c10a0 con 0x7fe3ac151170 2024-04-01T16:35:09.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.075+0000 7fe3b0e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe3ac151170 0x7fe3ac0c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:09.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.075+0000 7fe3b1800640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fe3ac0c7710 0x7fe3ac0b1730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:54654/0 (socket says 172.21.15.163:54654) 2024-04-01T16:35:09.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.075+0000 7fe3b1800640 1 -- 172.21.15.163:0/359772397 learned_addr learned my addr 172.21.15.163:0/359772397 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:35:09.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.079+0000 7fe3b0e00640 1 -- 172.21.15.163:0/359772397 >> v1:172.21.15.189:6789/0 conn(0x7fe3ac06f140 legacy=0x7fe3ac0c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:09.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.079+0000 7fe3b0e00640 1 -- 172.21.15.163:0/359772397 >> v1:172.21.15.163:6789/0 conn(0x7fe3ac0c7710 legacy=0x7fe3ac0b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:09.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.079+0000 7fe3b0e00640 1 -- 172.21.15.163:0/359772397 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ac0c1360 con 0x7fe3ac151170 2024-04-01T16:35:09.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.084+0000 7fe3b0e00640 1 --2- 172.21.15.163:0/359772397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3ac151170 0x7fe3ac0c2cc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00a940 tx=0x7fe39c02cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa58290b7ab14c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:09.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.090+0000 7fe3ab400640 1 -- 172.21.15.163:0/359772397 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c03a070 con 0x7fe3ac151170 2024-04-01T16:35:09.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.090+0000 7fe3ab400640 1 -- 172.21.15.163:0/359772397 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c02db40 con 0x7fe3ac151170 2024-04-01T16:35:09.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.090+0000 7fe3ab400640 1 -- 172.21.15.163:0/359772397 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00b040 con 0x7fe3ac151170 2024-04-01T16:35:09.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.091+0000 7fe3b3800640 1 -- 172.21.15.163:0/359772397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3ac151170 msgr2=0x7fe3ac0c2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:09.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.091+0000 7fe3b3800640 1 --2- 172.21.15.163:0/359772397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3ac151170 0x7fe3ac0c2cc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00a940 tx=0x7fe39c02cd90 comp rx=0 tx=0).stop 2024-04-01T16:35:09.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.091+0000 7fe3b3800640 1 -- 172.21.15.163:0/359772397 shutdown_connections 2024-04-01T16:35:09.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.091+0000 7fe3b3800640 1 --2- 172.21.15.163:0/359772397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3ac151170 0x7fe3ac0c2cc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:09.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.091+0000 7fe3b3800640 1 -- 172.21.15.163:0/359772397 >> 172.21.15.163:0/359772397 conn(0x7fe3ac0c8a00 msgr2=0x7fe3ac0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:09.091 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.091+0000 7fe3b3800640 1 -- 172.21.15.163:0/359772397 shutdown_connections 2024-04-01T16:35:09.091 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.091+0000 7fe3b3800640 1 -- 172.21.15.163:0/359772397 wait complete. 2024-04-01T16:35:09.092 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.093+0000 7fe3b3800640 1 Processor -- start 2024-04-01T16:35:09.092 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.093+0000 7fe3b3800640 1 -- start start 2024-04-01T16:35:09.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.094+0000 7fe3b3800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3ac06f140 0x7fe3ac1550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:09.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.094+0000 7fe3b3800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3ac0c7710 0x7fe3ac1f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:09.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.094+0000 7fe3b3800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3ac1f1420 0x7fe3ac0ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:09.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.094+0000 7fe3b3800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac0c7010 con 0x7fe3ac0c7710 2024-04-01T16:35:09.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.094+0000 7fe3b3800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac0c8280 con 0x7fe3ac1f1420 2024-04-01T16:35:09.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.094+0000 7fe3b3800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe3ac0c1640 con 0x7fe3ac06f140 2024-04-01T16:35:09.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.095+0000 7fe3abe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3ac0c7710 0x7fe3ac1f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:09.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.095+0000 7fe3abe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3ac0c7710 0x7fe3ac1f1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:32974/0 (socket says 172.21.15.163:32974) 2024-04-01T16:35:09.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.095+0000 7fe3abe00640 1 -- 172.21.15.163:0/2997911198 learned_addr learned my addr 172.21.15.163:0/2997911198 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:09.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.099+0000 7fe3abe00640 1 -- 172.21.15.163:0/2997911198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3ac06f140 msgr2=0x7fe3ac1550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:09.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.099+0000 7fe3abe00640 1 --2- 172.21.15.163:0/2997911198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3ac06f140 0x7fe3ac1550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:09.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.099+0000 7fe3abe00640 1 -- 172.21.15.163:0/2997911198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3ac1f1420 msgr2=0x7fe3ac0ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:09.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.099+0000 7fe3abe00640 1 --2- 172.21.15.163:0/2997911198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3ac1f1420 0x7fe3ac0ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:09.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.099+0000 7fe3abe00640 1 -- 172.21.15.163:0/2997911198 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ac156d00 con 0x7fe3ac0c7710 2024-04-01T16:35:09.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.101+0000 7fe3abe00640 1 --2- 172.21.15.163:0/2997911198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3ac0c7710 0x7fe3ac1f1ba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe39400c430 tx=0x7fe39400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:09.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.106+0000 7fe3a8c00640 1 -- 172.21.15.163:0/2997911198 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe394017070 con 0x7fe3ac0c7710 2024-04-01T16:35:09.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.106+0000 7fe3a8c00640 1 -- 172.21.15.163:0/2997911198 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3940035f0 con 0x7fe3ac0c7710 2024-04-01T16:35:09.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.106+0000 7fe3a8c00640 1 -- 172.21.15.163:0/2997911198 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3940039e0 con 0x7fe3ac0c7710 2024-04-01T16:35:09.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.106+0000 7fe3b3800640 1 -- 172.21.15.163:0/2997911198 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ac1558f0 con 0x7fe3ac0c7710 2024-04-01T16:35:09.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.106+0000 7fe3b3800640 1 -- 172.21.15.163:0/2997911198 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ac1f0940 con 0x7fe3ac0c7710 2024-04-01T16:35:09.106 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.107+0000 7fe3b3800640 1 -- 172.21.15.163:0/2997911198 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3ac1f0730 con 0x7fe3ac0c7710 2024-04-01T16:35:09.409 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.410+0000 7fe3a8c00640 1 -- 172.21.15.163:0/2997911198 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe39401a070 con 0x7fe3ac0c7710 2024-04-01T16:35:09.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.410+0000 7fe3a8c00640 1 --2- 172.21.15.163:0/2997911198 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe38806c940 0x7fe38806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:09.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.411+0000 7fe3b0e00640 1 --2- 172.21.15.163:0/2997911198 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe38806c940 0x7fe38806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:09.412 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.413+0000 7fe3b0e00640 1 --2- 172.21.15.163:0/2997911198 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe38806c940 0x7fe38806ee00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe39c037000 tx=0x7fe39c02f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:09.446 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.446+0000 7fe3a8c00640 1 -- 172.21.15.163:0/2997911198 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fe3940575d0 con 0x7fe3ac0c7710 2024-04-01T16:35:09.446 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.447+0000 7fe3a8c00640 1 -- 172.21.15.163:0/2997911198 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe394089e20 con 0x7fe3ac0c7710 2024-04-01T16:35:09.665 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.665+0000 7fe3b3800640 1 -- 172.21.15.163:0/2997911198 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe3ac0b2020 con 0x7fe3ac0c7710 2024-04-01T16:35:09.676 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.677+0000 7fe3a8c00640 1 -- 172.21.15.163:0/2997911198 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fe394059530 con 0x7fe3ac0c7710 2024-04-01T16:35:09.677 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2024-04-01T16:35:09.680 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.680+0000 7fe3b3800640 1 -- 172.21.15.163:0/2997911198 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe38806c940 msgr2=0x7fe38806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:09.680 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.680+0000 7fe3b3800640 1 --2- 172.21.15.163:0/2997911198 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe38806c940 0x7fe38806ee00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe39c037000 tx=0x7fe39c02f000 comp rx=0 tx=0).stop 2024-04-01T16:35:09.680 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.680+0000 7fe3b3800640 1 -- 172.21.15.163:0/2997911198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3ac0c7710 msgr2=0x7fe3ac1f1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:09.680 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.680+0000 7fe3b3800640 1 --2- 172.21.15.163:0/2997911198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3ac0c7710 0x7fe3ac1f1ba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe39400c430 tx=0x7fe39400c8f0 comp rx=0 tx=0).stop 2024-04-01T16:35:09.680 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.680+0000 7fe3b3800640 1 -- 172.21.15.163:0/2997911198 shutdown_connections 2024-04-01T16:35:09.680 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.680+0000 7fe3b3800640 1 --2- 172.21.15.163:0/2997911198 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe38806c940 0x7fe38806ee00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:09.681 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.680+0000 7fe3b3800640 1 --2- 172.21.15.163:0/2997911198 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3ac1f1420 0x7fe3ac0ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:09.681 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.680+0000 7fe3b3800640 1 --2- 172.21.15.163:0/2997911198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3ac0c7710 0x7fe3ac1f1ba0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:09.681 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.680+0000 7fe3b3800640 1 --2- 172.21.15.163:0/2997911198 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe3ac06f140 0x7fe3ac1550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:09.681 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.680+0000 7fe3b3800640 1 -- 172.21.15.163:0/2997911198 >> 172.21.15.163:0/2997911198 conn(0x7fe3ac0c8a00 msgr2=0x7fe3ac150480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:09.681 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.680+0000 7fe3b3800640 1 -- 172.21.15.163:0/2997911198 shutdown_connections 2024-04-01T16:35:09.681 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.680+0000 7fe3b3800640 1 -- 172.21.15.163:0/2997911198 wait complete. 2024-04-01T16:35:09.698 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T16:35:09.902 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.903+0000 7fad5ce00640 1 Processor -- start 2024-04-01T16:35:09.902 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.903+0000 7fad5ce00640 1 -- start start 2024-04-01T16:35:09.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.904+0000 7fad5ce00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fad580cc7f0 0x7fad580ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:09.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.904+0000 7fad5ce00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fad5815bac0 0x7fad5815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:09.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.904+0000 7fad5ce00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad580cad10 con 0x7fad580ca760 2024-04-01T16:35:09.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.904+0000 7fad5ce00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fad5815d9c0 con 0x7fad580cc7f0 2024-04-01T16:35:09.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.904+0000 7fad5ce00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fad5815b610 con 0x7fad5815bac0 2024-04-01T16:35:09.908 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.908+0000 7fad56a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fad5815bac0 0x7fad5815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:09.908 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.909+0000 7fad56a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fad5815bac0 0x7fad5815b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:60174/0 (socket says 172.21.15.163:60174) 2024-04-01T16:35:09.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.909+0000 7fad56a00640 1 -- 172.21.15.163:0/3518456338 learned_addr learned my addr 172.21.15.163:0/3518456338 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:09.912 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.912+0000 7fad56a00640 1 -- 172.21.15.163:0/3518456338 >> v2:172.21.15.163:3300/0 conn(0x7fad580cc7f0 msgr2=0x7fad580ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:09.912 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.912+0000 7fad56a00640 1 --2- 172.21.15.163:0/3518456338 >> v2:172.21.15.163:3300/0 conn(0x7fad580cc7f0 0x7fad580ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:09.912 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.912+0000 7fad56a00640 1 -- 172.21.15.163:0/3518456338 >> v1:172.21.15.163:6789/0 conn(0x7fad580ca760 legacy=0x7fad5806d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:09.912 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.912+0000 7fad56a00640 1 -- 172.21.15.163:0/3518456338 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5806ca80 con 0x7fad5815bac0 2024-04-01T16:35:09.916 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:09.917+0000 7fad56a00640 1 --2- 172.21.15.163:0/3518456338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad5815bac0 0x7fad5815b0d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fad58154f90 tx=0x7fad4402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=987f983cdfcba09a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:10.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.013+0000 7fad56000640 1 -- 172.21.15.163:0/3518456338 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4402e070 con 0x7fad5815bac0 2024-04-01T16:35:10.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.013+0000 7fad56000640 1 -- 172.21.15.163:0/3518456338 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad44037070 con 0x7fad5815bac0 2024-04-01T16:35:10.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.013+0000 7fad56000640 1 -- 172.21.15.163:0/3518456338 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44031a00 con 0x7fad5815bac0 2024-04-01T16:35:10.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.014+0000 7fad5ce00640 1 -- 172.21.15.163:0/3518456338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad5815bac0 msgr2=0x7fad5815b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:10.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.014+0000 7fad5ce00640 1 --2- 172.21.15.163:0/3518456338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad5815bac0 0x7fad5815b0d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fad58154f90 tx=0x7fad4402b880 comp rx=0 tx=0).stop 2024-04-01T16:35:10.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.015+0000 7fad5ce00640 1 -- 172.21.15.163:0/3518456338 shutdown_connections 2024-04-01T16:35:10.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.015+0000 7fad5ce00640 1 --2- 172.21.15.163:0/3518456338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad5815bac0 0x7fad5815b0d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:10.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.015+0000 7fad5ce00640 1 --2- 172.21.15.163:0/3518456338 >> v2:172.21.15.163:3300/0 conn(0x7fad580cc7f0 0x7fad580ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:10.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.015+0000 7fad5ce00640 1 -- 172.21.15.163:0/3518456338 >> 172.21.15.163:0/3518456338 conn(0x7fad580b1910 msgr2=0x7fad580b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:10.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.015+0000 7fad5ce00640 1 -- 172.21.15.163:0/3518456338 shutdown_connections 2024-04-01T16:35:10.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.015+0000 7fad5ce00640 1 -- 172.21.15.163:0/3518456338 wait complete. 2024-04-01T16:35:10.019 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.020+0000 7fad5ce00640 1 Processor -- start 2024-04-01T16:35:10.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.020+0000 7fad5ce00640 1 -- start start 2024-04-01T16:35:10.023 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.023+0000 7fad5ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad580ca760 0x7fad58150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:10.023 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.023+0000 7fad5ce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad580cc7f0 0x7fad580af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:10.023 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.023+0000 7fad5ce00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad5815bac0 0x7fad580afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:10.023 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.023+0000 7fad5ce00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fad5806d040 con 0x7fad580cc7f0 2024-04-01T16:35:10.023 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.023+0000 7fad5ce00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad580caff0 con 0x7fad580ca760 2024-04-01T16:35:10.023 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.023+0000 7fad5ce00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fad5806d320 con 0x7fad5815bac0 2024-04-01T16:35:10.023 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.024+0000 7fad56a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad580cc7f0 0x7fad580af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:10.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.025+0000 7fad57e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad5815bac0 0x7fad580afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:10.025 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.025+0000 7fad56a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad580cc7f0 0x7fad580af9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:32998/0 (socket says 172.21.15.163:32998) 2024-04-01T16:35:10.025 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.025+0000 7fad56a00640 1 -- 172.21.15.163:0/3515067305 learned_addr learned my addr 172.21.15.163:0/3515067305 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:10.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.030+0000 7fad57400640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad580ca760 0x7fad58150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:10.034 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.035+0000 7fad56a00640 1 -- 172.21.15.163:0/3515067305 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad5815bac0 msgr2=0x7fad580afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:10.034 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.035+0000 7fad56a00640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad5815bac0 0x7fad580afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:10.034 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.035+0000 7fad56a00640 1 -- 172.21.15.163:0/3515067305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad580ca760 msgr2=0x7fad58150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:10.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.035+0000 7fad56a00640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad580ca760 0x7fad58150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:10.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.035+0000 7fad56a00640 1 -- 172.21.15.163:0/3515067305 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad581e3a80 con 0x7fad580cc7f0 2024-04-01T16:35:10.043 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.044+0000 7fad56a00640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad580cc7f0 0x7fad580af9b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad44000c00 tx=0x7fad440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:10.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.141+0000 7fad4f400640 1 -- 172.21.15.163:0/3515067305 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44032880 con 0x7fad580cc7f0 2024-04-01T16:35:10.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.141+0000 7fad4f400640 1 -- 172.21.15.163:0/3515067305 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad44032a20 con 0x7fad580cc7f0 2024-04-01T16:35:10.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.141+0000 7fad4f400640 1 -- 172.21.15.163:0/3515067305 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44032e10 con 0x7fad580cc7f0 2024-04-01T16:35:10.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.141+0000 7fad5ce00640 1 -- 172.21.15.163:0/3515067305 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad581e3d20 con 0x7fad580cc7f0 2024-04-01T16:35:10.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.142+0000 7fad5ce00640 1 -- 172.21.15.163:0/3515067305 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad581e42e0 con 0x7fad580cc7f0 2024-04-01T16:35:10.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.143+0000 7fad5ce00640 1 -- 172.21.15.163:0/3515067305 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad580756d0 con 0x7fad580cc7f0 2024-04-01T16:35:10.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.191+0000 7fad4f400640 1 -- 172.21.15.163:0/3515067305 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad440453f0 con 0x7fad580cc7f0 2024-04-01T16:35:10.192 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.193+0000 7fad4f400640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fad3806c940 0x7fad3806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:10.193 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.193+0000 7fad57400640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fad3806c940 0x7fad3806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:10.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.195+0000 7fad57400640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fad3806c940 0x7fad3806ee00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fad480098e0 tx=0x7fad48009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:10.199 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.200+0000 7fad4f400640 1 -- 172.21.15.163:0/3515067305 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fad44079d20 con 0x7fad580cc7f0 2024-04-01T16:35:10.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.534+0000 7fad4f400640 1 -- 172.21.15.163:0/3515067305 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fad44053080 con 0x7fad580cc7f0 2024-04-01T16:35:10.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.809+0000 7fad5ce00640 1 -- 172.21.15.163:0/3515067305 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad5806e3e0 con 0x7fad580cc7f0 2024-04-01T16:35:10.845 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.846+0000 7fad4f400640 1 -- 172.21.15.163:0/3515067305 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6839 (secure 0 0 0) 0x7fad44040070 con 0x7fad580cc7f0 2024-04-01T16:35:10.846 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:35:10.846 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/220229466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":220229466},{"type":"v1","addr":"172.21.15.189:6834","nonce":220229466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/1149566111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1149566111},{"type":"v1","addr":"172.21.15.163:6839","nonce":1149566111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2556471418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2556471418},{"type":"v1","addr":"172.21.15.163:6835","nonce":2556471418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1010688449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1010688449},{"type":"v1","addr":"172.21.15.163:6837","nonce":1010688449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1685366427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1685366427},{"type":"v1","addr":"172.21.15.189:6837","nonce":1685366427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T16:34:34.157633+0000","modified":"2024-04-01T16:34:41.924119+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.189:6835/2672478403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2672478403},{"type":"v1","addr":"172.21.15.189:6835","nonce":2672478403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-04-01T16:35:10.846 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 8 2024-04-01T16:35:10.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.849+0000 7fad5ce00640 1 -- 172.21.15.163:0/3515067305 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fad3806c940 msgr2=0x7fad3806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:10.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.849+0000 7fad5ce00640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fad3806c940 0x7fad3806ee00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fad480098e0 tx=0x7fad48009060 comp rx=0 tx=0).stop 2024-04-01T16:35:10.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.849+0000 7fad5ce00640 1 -- 172.21.15.163:0/3515067305 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad580cc7f0 msgr2=0x7fad580af9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:10.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.849+0000 7fad5ce00640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad580cc7f0 0x7fad580af9b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad44000c00 tx=0x7fad440046c0 comp rx=0 tx=0).stop 2024-04-01T16:35:10.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.850+0000 7fad5ce00640 1 -- 172.21.15.163:0/3515067305 shutdown_connections 2024-04-01T16:35:10.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.850+0000 7fad5ce00640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fad3806c940 0x7fad3806ee00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:10.850 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.850+0000 7fad5ce00640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fad5815bac0 0x7fad580afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:10.850 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.850+0000 7fad5ce00640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fad580cc7f0 0x7fad580af9b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:10.850 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.850+0000 7fad5ce00640 1 --2- 172.21.15.163:0/3515067305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad580ca760 0x7fad58150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:10.850 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.850+0000 7fad5ce00640 1 -- 172.21.15.163:0/3515067305 >> 172.21.15.163:0/3515067305 conn(0x7fad580b1910 msgr2=0x7fad58154340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:10.850 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.850+0000 7fad5ce00640 1 -- 172.21.15.163:0/3515067305 shutdown_connections 2024-04-01T16:35:10.850 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:10.850+0000 7fad5ce00640 1 -- 172.21.15.163:0/3515067305 wait complete. 2024-04-01T16:35:10.869 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T16:35:11.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.075+0000 7f5488e00640 1 Processor -- start 2024-04-01T16:35:11.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.076+0000 7f5488e00640 1 -- start start 2024-04-01T16:35:11.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.077+0000 7f5488e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5484151670 0x7f54840c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:11.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.077+0000 7f5488e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f54840c7350 0x7f54840731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:11.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.078+0000 7f5488e00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54840c6100 con 0x7f54840c8730 2024-04-01T16:35:11.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.078+0000 7f5488e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f5484067280 con 0x7f5484151670 2024-04-01T16:35:11.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.078+0000 7f5488e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f54841582e0 con 0x7f54840c7350 2024-04-01T16:35:11.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.078+0000 7f5481e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5484151670 0x7f54840c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:11.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.079+0000 7f5481e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5484151670 0x7f54840c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37062/0 (socket says 172.21.15.163:37062) 2024-04-01T16:35:11.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.079+0000 7f5481e00640 1 -- 172.21.15.163:0/819324008 learned_addr learned my addr 172.21.15.163:0/819324008 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:11.081 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.081+0000 7f5481e00640 1 -- 172.21.15.163:0/819324008 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f54840c7350 msgr2=0x7f54840731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:11.081 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.081+0000 7f5481e00640 1 --2- 172.21.15.163:0/819324008 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f54840c7350 0x7f54840731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:11.081 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.081+0000 7f5481e00640 1 -- 172.21.15.163:0/819324008 >> v1:172.21.15.189:6789/0 conn(0x7f54840c8730 legacy=0x7f548415aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:11.081 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.081+0000 7f5481e00640 1 -- 172.21.15.163:0/819324008 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54840674d0 con 0x7f5484151670 2024-04-01T16:35:11.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.084+0000 7f5481e00640 1 --2- 172.21.15.163:0/819324008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5484151670 0x7f54840c6e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5474009870 tx=0x7f547402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a4a426419af4bc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:11.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.088+0000 7f5481400640 1 -- 172.21.15.163:0/819324008 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474034070 con 0x7f5484151670 2024-04-01T16:35:11.088 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.089+0000 7f5481400640 1 -- 172.21.15.163:0/819324008 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5474030840 con 0x7f5484151670 2024-04-01T16:35:11.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.089+0000 7f5481400640 1 -- 172.21.15.163:0/819324008 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474030c10 con 0x7f5484151670 2024-04-01T16:35:11.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.090+0000 7f5488e00640 1 -- 172.21.15.163:0/819324008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5484151670 msgr2=0x7f54840c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:11.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.090+0000 7f5488e00640 1 --2- 172.21.15.163:0/819324008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5484151670 0x7f54840c6e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5474009870 tx=0x7f547402b980 comp rx=0 tx=0).stop 2024-04-01T16:35:11.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.090+0000 7f5488e00640 1 -- 172.21.15.163:0/819324008 shutdown_connections 2024-04-01T16:35:11.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.090+0000 7f5488e00640 1 --2- 172.21.15.163:0/819324008 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f54840c7350 0x7f54840731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:11.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.090+0000 7f5488e00640 1 --2- 172.21.15.163:0/819324008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5484151670 0x7f54840c6e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:11.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.090+0000 7f5488e00640 1 -- 172.21.15.163:0/819324008 >> 172.21.15.163:0/819324008 conn(0x7f54840726d0 msgr2=0x7f5484072ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:11.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.090+0000 7f5488e00640 1 -- 172.21.15.163:0/819324008 shutdown_connections 2024-04-01T16:35:11.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.090+0000 7f5488e00640 1 -- 172.21.15.163:0/819324008 wait complete. 2024-04-01T16:35:11.091 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.092+0000 7f5488e00640 1 Processor -- start 2024-04-01T16:35:11.091 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.092+0000 7f5488e00640 1 -- start start 2024-04-01T16:35:11.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.093+0000 7f5488e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54840c8730 0x7f54841e6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:11.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.093+0000 7f5488e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5484151670 0x7f54841550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:11.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.094+0000 7f5488e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f548414ae50 0x7f5484149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:11.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.094+0000 7f5488e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f54840c6890 con 0x7f54840c8730 2024-04-01T16:35:11.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.094+0000 7f5488e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f54840c6370 con 0x7f548414ae50 2024-04-01T16:35:11.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.094+0000 7f5488e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f54840c8bf0 con 0x7f5484151670 2024-04-01T16:35:11.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.095+0000 7f5482800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f548414ae50 0x7f5484149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:11.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.095+0000 7f547be00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5484151670 0x7f54841550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:11.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.096+0000 7f5482800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f548414ae50 0x7f5484149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:45404/0 (socket says 172.21.15.163:45404) 2024-04-01T16:35:11.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.096+0000 7f5482800640 1 -- 172.21.15.163:0/625692256 learned_addr learned my addr 172.21.15.163:0/625692256 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:11.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.100+0000 7f5481e00640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54840c8730 0x7f54841e6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:11.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.106+0000 7f5481e00640 1 -- 172.21.15.163:0/625692256 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5484151670 msgr2=0x7f54841550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:11.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.106+0000 7f5481e00640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5484151670 0x7f54841550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:11.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.106+0000 7f5481e00640 1 -- 172.21.15.163:0/625692256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f548414ae50 msgr2=0x7f5484149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:11.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.106+0000 7f5481e00640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f548414ae50 0x7f5484149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:11.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.106+0000 7f5481e00640 1 -- 172.21.15.163:0/625692256 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54841f0e00 con 0x7f54840c8730 2024-04-01T16:35:11.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.108+0000 7f5481e00640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54840c8730 0x7f54841e6770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5474033000 tx=0x7f54740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:11.189 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.189+0000 7f547a000640 1 -- 172.21.15.163:0/625692256 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474034040 con 0x7f54840c8730 2024-04-01T16:35:11.189 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.189+0000 7f547a000640 1 -- 172.21.15.163:0/625692256 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5474039d90 con 0x7f54840c8730 2024-04-01T16:35:11.189 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.189+0000 7f547a000640 1 -- 172.21.15.163:0/625692256 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474043630 con 0x7f54840c8730 2024-04-01T16:35:11.189 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.189+0000 7f5488e00640 1 -- 172.21.15.163:0/625692256 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54841f1070 con 0x7f54840c8730 2024-04-01T16:35:11.189 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.189+0000 7f5488e00640 1 -- 172.21.15.163:0/625692256 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54841e5190 con 0x7f54840c8730 2024-04-01T16:35:11.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.191+0000 7f5488e00640 1 -- 172.21.15.163:0/625692256 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54840756d0 con 0x7f54840c8730 2024-04-01T16:35:11.237 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.238+0000 7f547a000640 1 -- 172.21.15.163:0/625692256 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f547404a060 con 0x7f54840c8730 2024-04-01T16:35:11.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.240+0000 7f547a000640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f546006c970 0x7f546006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:11.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.241+0000 7f547be00640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f546006c970 0x7f546006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:11.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.243+0000 7f547be00640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f546006c970 0x7f546006ee30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f54841e6700 tx=0x7f546c009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:11.246 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.246+0000 7f547a000640 1 -- 172.21.15.163:0/625692256 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f5474079d40 con 0x7f54840c8730 2024-04-01T16:35:11.625 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.626+0000 7f547a000640 1 -- 172.21.15.163:0/625692256 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f547403e070 con 0x7f54840c8730 2024-04-01T16:35:11.840 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.840+0000 7f5488e00640 1 -- 172.21.15.163:0/625692256 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54840c7eb0 con 0x7f54840c8730 2024-04-01T16:35:11.915 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.915+0000 7f547a000640 1 -- 172.21.15.163:0/625692256 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+16901 (secure 0 0 0) 0x7f547407c3a0 con 0x7f54840c8730 2024-04-01T16:35:11.915 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:35:11.915 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":27,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:53.160271+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T16:34:29.028272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T16:34:31.534879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:35:11.918 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.918+0000 7f5488e00640 1 -- 172.21.15.163:0/625692256 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f546006c970 msgr2=0x7f546006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:11.918 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.918+0000 7f5488e00640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f546006c970 0x7f546006ee30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f54841e6700 tx=0x7f546c009110 comp rx=0 tx=0).stop 2024-04-01T16:35:11.918 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.918+0000 7f5488e00640 1 -- 172.21.15.163:0/625692256 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54840c8730 msgr2=0x7f54841e6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:11.918 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.918+0000 7f5488e00640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54840c8730 0x7f54841e6770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5474033000 tx=0x7f54740046c0 comp rx=0 tx=0).stop 2024-04-01T16:35:11.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.919+0000 7f5488e00640 1 -- 172.21.15.163:0/625692256 shutdown_connections 2024-04-01T16:35:11.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.919+0000 7f5488e00640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f546006c970 0x7f546006ee30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:11.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.919+0000 7f5488e00640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f548414ae50 0x7f5484149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:11.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.919+0000 7f5488e00640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5484151670 0x7f54841550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:11.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.919+0000 7f5488e00640 1 --2- 172.21.15.163:0/625692256 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54840c8730 0x7f54841e6770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:11.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.919+0000 7f5488e00640 1 -- 172.21.15.163:0/625692256 >> 172.21.15.163:0/625692256 conn(0x7f54840726d0 msgr2=0x7f548406c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:11.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.919+0000 7f5488e00640 1 -- 172.21.15.163:0/625692256 shutdown_connections 2024-04-01T16:35:11.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:11.919+0000 7f5488e00640 1 -- 172.21.15.163:0/625692256 wait complete. 2024-04-01T16:35:11.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T16:34:05.291874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T16:34:29.028272+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T16:34:31.534879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T16:35:11.939 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T16:35:12.155 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.155+0000 7fdc3f800640 1 Processor -- start 2024-04-01T16:35:12.155 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.156+0000 7fdc3f800640 1 -- start start 2024-04-01T16:35:12.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.157+0000 7fdc3f800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdc381547a0 0x7fdc380cb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:12.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.157+0000 7fdc3f800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fdc380c87d0 0x7fdc38071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:12.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.157+0000 7fdc3f800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc3815dea0 con 0x7fdc38072120 2024-04-01T16:35:12.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.157+0000 7fdc3f800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fdc3815dc70 con 0x7fdc381547a0 2024-04-01T16:35:12.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.157+0000 7fdc3f800640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fdc3806c650 con 0x7fdc380c87d0 2024-04-01T16:35:12.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.215+0000 7fdc3ce00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdc381547a0 0x7fdc380cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:12.217 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.217+0000 7fdc3ce00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdc381547a0 0x7fdc380cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37086/0 (socket says 172.21.15.163:37086) 2024-04-01T16:35:12.217 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.217+0000 7fdc3ce00640 1 -- 172.21.15.163:0/2323928060 learned_addr learned my addr 172.21.15.163:0/2323928060 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:12.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.220+0000 7fdc2fe00640 1 --2- 172.21.15.163:0/2323928060 >> v2:172.21.15.189:3300/0 conn(0x7fdc380c87d0 0x7fdc38071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:12.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.224+0000 7fdc3ce00640 1 -- 172.21.15.163:0/2323928060 >> v2:172.21.15.189:3300/0 conn(0x7fdc380c87d0 msgr2=0x7fdc38071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:12.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.224+0000 7fdc3ce00640 1 --2- 172.21.15.163:0/2323928060 >> v2:172.21.15.189:3300/0 conn(0x7fdc380c87d0 0x7fdc38071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:12.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.224+0000 7fdc3ce00640 1 -- 172.21.15.163:0/2323928060 >> v1:172.21.15.189:6789/0 conn(0x7fdc38072120 legacy=0x7fdc3806cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:12.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.224+0000 7fdc3ce00640 1 -- 172.21.15.163:0/2323928060 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3815e180 con 0x7fdc381547a0 2024-04-01T16:35:12.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.231+0000 7fdc3ce00640 1 --2- 172.21.15.163:0/2323928060 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc381547a0 0x7fdc380cb220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdc38070d10 tx=0x7fdc2802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d351e0e9ff462b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:12.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.253+0000 7fdc37e00640 1 -- 172.21.15.163:0/2323928060 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2802e070 con 0x7fdc381547a0 2024-04-01T16:35:12.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.254+0000 7fdc37e00640 1 -- 172.21.15.163:0/2323928060 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc28037070 con 0x7fdc381547a0 2024-04-01T16:35:12.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.254+0000 7fdc37e00640 1 -- 172.21.15.163:0/2323928060 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc28031a00 con 0x7fdc381547a0 2024-04-01T16:35:12.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.255+0000 7fdc3f800640 1 -- 172.21.15.163:0/2323928060 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc381547a0 msgr2=0x7fdc380cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:12.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.255+0000 7fdc3f800640 1 --2- 172.21.15.163:0/2323928060 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc381547a0 0x7fdc380cb220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdc38070d10 tx=0x7fdc2802b880 comp rx=0 tx=0).stop 2024-04-01T16:35:12.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.255+0000 7fdc3f800640 1 -- 172.21.15.163:0/2323928060 shutdown_connections 2024-04-01T16:35:12.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.255+0000 7fdc3f800640 1 --2- 172.21.15.163:0/2323928060 >> v2:172.21.15.189:3300/0 conn(0x7fdc380c87d0 0x7fdc38071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:12.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.255+0000 7fdc3f800640 1 --2- 172.21.15.163:0/2323928060 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc381547a0 0x7fdc380cb220 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:12.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.255+0000 7fdc3f800640 1 -- 172.21.15.163:0/2323928060 >> 172.21.15.163:0/2323928060 conn(0x7fdc3806b930 msgr2=0x7fdc380702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:12.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.255+0000 7fdc3f800640 1 -- 172.21.15.163:0/2323928060 shutdown_connections 2024-04-01T16:35:12.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.255+0000 7fdc3f800640 1 -- 172.21.15.163:0/2323928060 wait complete. 2024-04-01T16:35:12.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.258+0000 7fdc3f800640 1 Processor -- start 2024-04-01T16:35:12.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.258+0000 7fdc3f800640 1 -- start start 2024-04-01T16:35:12.259 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.260+0000 7fdc3f800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc38072120 0x7fdc380c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:12.259 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.260+0000 7fdc3f800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc380c87d0 0x7fdc381f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:12.259 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.260+0000 7fdc3f800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc381547a0 0x7fdc3814f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:12.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.260+0000 7fdc3f800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3815e740 con 0x7fdc380c87d0 2024-04-01T16:35:12.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.260+0000 7fdc3f800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdc38154b80 con 0x7fdc38072120 2024-04-01T16:35:12.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.260+0000 7fdc3f800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdc3815ea20 con 0x7fdc381547a0 2024-04-01T16:35:12.261 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.262+0000 7fdc3d800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc381547a0 0x7fdc3814f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:12.261 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.262+0000 7fdc3ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc38072120 0x7fdc380c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:12.262 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.262+0000 7fdc3ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc38072120 0x7fdc380c3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:45430/0 (socket says 172.21.15.163:45430) 2024-04-01T16:35:12.262 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.262+0000 7fdc3ce00640 1 -- 172.21.15.163:0/1051270411 learned_addr learned my addr 172.21.15.163:0/1051270411 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:12.262 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.263+0000 7fdc2fe00640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc380c87d0 0x7fdc381f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:12.268 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.268+0000 7fdc3ce00640 1 -- 172.21.15.163:0/1051270411 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc381547a0 msgr2=0x7fdc3814f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:12.268 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.268+0000 7fdc3ce00640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc381547a0 0x7fdc3814f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:12.268 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.268+0000 7fdc3ce00640 1 -- 172.21.15.163:0/1051270411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc380c87d0 msgr2=0x7fdc381f0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:12.268 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.268+0000 7fdc3ce00640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc380c87d0 0x7fdc381f0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:12.268 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.268+0000 7fdc3ce00640 1 -- 172.21.15.163:0/1051270411 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc380b3190 con 0x7fdc38072120 2024-04-01T16:35:12.272 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.273+0000 7fdc3ce00640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc38072120 0x7fdc380c3470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdc2802b8c0 tx=0x7fdc280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:12.281 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.282+0000 7fdc35600640 1 -- 172.21.15.163:0/1051270411 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc28032880 con 0x7fdc38072120 2024-04-01T16:35:12.281 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.282+0000 7fdc35600640 1 -- 172.21.15.163:0/1051270411 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc28032a20 con 0x7fdc38072120 2024-04-01T16:35:12.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.282+0000 7fdc35600640 1 -- 172.21.15.163:0/1051270411 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc28032e10 con 0x7fdc38072120 2024-04-01T16:35:12.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.282+0000 7fdc3f800640 1 -- 172.21.15.163:0/1051270411 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc381522a0 con 0x7fdc38072120 2024-04-01T16:35:12.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.282+0000 7fdc3f800640 1 -- 172.21.15.163:0/1051270411 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc381e6070 con 0x7fdc38072120 2024-04-01T16:35:12.283 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.284+0000 7fdc3f800640 1 -- 172.21.15.163:0/1051270411 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc381527c0 con 0x7fdc38072120 2024-04-01T16:35:12.635 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.635+0000 7fdc35600640 1 -- 172.21.15.163:0/1051270411 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdc280453f0 con 0x7fdc38072120 2024-04-01T16:35:12.637 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.638+0000 7fdc35600640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdc1406c970 0x7fdc1406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:12.638 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.638+0000 7fdc2fe00640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdc1406c970 0x7fdc1406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:12.638 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.639+0000 7fdc35600640 1 -- 172.21.15.163:0/1051270411 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fdc28079c30 con 0x7fdc38072120 2024-04-01T16:35:12.639 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.640+0000 7fdc2fe00640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdc1406c970 0x7fdc1406ee30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc380c3d50 tx=0x7fdc20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:12.658 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.659+0000 7fdc35600640 1 -- 172.21.15.163:0/1051270411 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fdc28040070 con 0x7fdc38072120 2024-04-01T16:35:12.880 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.880+0000 7fdc3f800640 1 -- 172.21.15.163:0/1051270411 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdc380756d0 con 0x7fdc38072120 2024-04-01T16:35:12.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.938+0000 7fdc35600640 1 -- 172.21.15.163:0/1051270411 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fdc2807bb90 con 0x7fdc38072120 2024-04-01T16:35:12.938 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2024-04-01T16:35:12.940 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.941+0000 7fdc3f800640 1 -- 172.21.15.163:0/1051270411 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdc1406c970 msgr2=0x7fdc1406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:12.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.941+0000 7fdc3f800640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdc1406c970 0x7fdc1406ee30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc380c3d50 tx=0x7fdc20008040 comp rx=0 tx=0).stop 2024-04-01T16:35:12.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.941+0000 7fdc3f800640 1 -- 172.21.15.163:0/1051270411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc38072120 msgr2=0x7fdc380c3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:12.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.941+0000 7fdc3f800640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc38072120 0x7fdc380c3470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdc2802b8c0 tx=0x7fdc280046c0 comp rx=0 tx=0).stop 2024-04-01T16:35:12.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.941+0000 7fdc3f800640 1 -- 172.21.15.163:0/1051270411 shutdown_connections 2024-04-01T16:35:12.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.941+0000 7fdc3f800640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fdc1406c970 0x7fdc1406ee30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:12.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.941+0000 7fdc3f800640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdc381547a0 0x7fdc3814f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:12.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.941+0000 7fdc3f800640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdc380c87d0 0x7fdc381f0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:12.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.941+0000 7fdc3f800640 1 --2- 172.21.15.163:0/1051270411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdc38072120 0x7fdc380c3470 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:12.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.941+0000 7fdc3f800640 1 -- 172.21.15.163:0/1051270411 >> 172.21.15.163:0/1051270411 conn(0x7fdc3806b930 msgr2=0x7fdc380c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:12.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.941+0000 7fdc3f800640 1 -- 172.21.15.163:0/1051270411 shutdown_connections 2024-04-01T16:35:12.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:12.941+0000 7fdc3f800640 1 -- 172.21.15.163:0/1051270411 wait complete. 2024-04-01T16:35:12.962 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T16:35:13.181 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.182+0000 7fb6dbe00640 1 Processor -- start 2024-04-01T16:35:13.182 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.182+0000 7fb6dbe00640 1 -- start start 2024-04-01T16:35:13.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.184+0000 7fb6dbe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6dc073450 0x7fb6dc0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:13.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.184+0000 7fb6dbe00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb6dc0c7cf0 0x7fb6dc0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:13.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.184+0000 7fb6dbe00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6dc0c73a0 con 0x7fb6dc151880 2024-04-01T16:35:13.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.184+0000 7fb6dbe00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb6dc157460 con 0x7fb6dc0c7cf0 2024-04-01T16:35:13.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.184+0000 7fb6dbe00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb6dc0739b0 con 0x7fb6dc073450 2024-04-01T16:35:13.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.185+0000 7fb6da000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6dc073450 0x7fb6dc0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:13.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.186+0000 7fb6daa00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb6dc151880 0x7fb6dc071c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:59972/0 (socket says 172.21.15.163:59972) 2024-04-01T16:35:13.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.186+0000 7fb6daa00640 1 -- 172.21.15.163:0/1433172988 learned_addr learned my addr 172.21.15.163:0/1433172988 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:35:13.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.186+0000 7fb6db400640 1 --2- 172.21.15.163:0/1433172988 >> v2:172.21.15.189:3300/0 conn(0x7fb6dc0c7cf0 0x7fb6dc0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:13.192 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.193+0000 7fb6da000640 1 -- 172.21.15.163:0/1433172988 >> v2:172.21.15.189:3300/0 conn(0x7fb6dc0c7cf0 msgr2=0x7fb6dc0c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:13.192 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.193+0000 7fb6da000640 1 --2- 172.21.15.163:0/1433172988 >> v2:172.21.15.189:3300/0 conn(0x7fb6dc0c7cf0 0x7fb6dc0c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:13.193 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.193+0000 7fb6da000640 1 -- 172.21.15.163:0/1433172988 >> v1:172.21.15.189:6789/0 conn(0x7fb6dc151880 legacy=0x7fb6dc071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:13.193 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.193+0000 7fb6d9600640 1 -- 172.21.15.163:0/1433172988 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076656896 0 0) 0x7fb6dc0c73a0 con 0x7fb6dc151880 2024-04-01T16:35:13.193 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.193+0000 7fb6da000640 1 -- 172.21.15.163:0/1433172988 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6dc157720 con 0x7fb6dc073450 2024-04-01T16:35:13.199 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.200+0000 7fb6da000640 1 --2- 172.21.15.163:0/1433172988 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6dc073450 0x7fb6dc0c85e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80097a0 tx=0x7fb6c802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dd4371e778d4d09 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:13.206 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.207+0000 7fb6d9600640 1 -- 172.21.15.163:0/1433172988 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8035020 con 0x7fb6dc073450 2024-04-01T16:35:13.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.211+0000 7fb6d9600640 1 -- 172.21.15.163:0/1433172988 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c8031830 con 0x7fb6dc073450 2024-04-01T16:35:13.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.211+0000 7fb6d9600640 1 -- 172.21.15.163:0/1433172988 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8031c00 con 0x7fb6dc073450 2024-04-01T16:35:13.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.212+0000 7fb6dbe00640 1 -- 172.21.15.163:0/1433172988 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6dc073450 msgr2=0x7fb6dc0c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:13.211 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.212+0000 7fb6dbe00640 1 --2- 172.21.15.163:0/1433172988 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6dc073450 0x7fb6dc0c85e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80097a0 tx=0x7fb6c802b8d0 comp rx=0 tx=0).stop 2024-04-01T16:35:13.212 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.212+0000 7fb6dbe00640 1 -- 172.21.15.163:0/1433172988 shutdown_connections 2024-04-01T16:35:13.212 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.212+0000 7fb6dbe00640 1 --2- 172.21.15.163:0/1433172988 >> v2:172.21.15.189:3300/0 conn(0x7fb6dc0c7cf0 0x7fb6dc0c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:13.212 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.212+0000 7fb6dbe00640 1 --2- 172.21.15.163:0/1433172988 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6dc073450 0x7fb6dc0c85e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:13.212 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.212+0000 7fb6dbe00640 1 -- 172.21.15.163:0/1433172988 >> 172.21.15.163:0/1433172988 conn(0x7fb6dc06b540 msgr2=0x7fb6dc06b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:13.212 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.212+0000 7fb6dbe00640 1 -- 172.21.15.163:0/1433172988 shutdown_connections 2024-04-01T16:35:13.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.212+0000 7fb6dbe00640 1 -- 172.21.15.163:0/1433172988 wait complete. 2024-04-01T16:35:13.214 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.215+0000 7fb6dbe00640 1 Processor -- start 2024-04-01T16:35:13.214 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.215+0000 7fb6dbe00640 1 -- start start 2024-04-01T16:35:13.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.216+0000 7fb6dbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6dc073450 0x7fb6dc0cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:13.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.216+0000 7fb6dbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6dc0c7cf0 0x7fb6dc163a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:13.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.216+0000 7fb6dbe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6dc151880 0x7fb6dc1f0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:13.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.216+0000 7fb6dbe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc157fc0 con 0x7fb6dc073450 2024-04-01T16:35:13.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.216+0000 7fb6dbe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc157ce0 con 0x7fb6dc0c7cf0 2024-04-01T16:35:13.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.216+0000 7fb6dbe00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb6dc072350 con 0x7fb6dc151880 2024-04-01T16:35:13.217 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.218+0000 7fb6da000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6dc0c7cf0 0x7fb6dc163a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:13.217 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.218+0000 7fb6db400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6dc151880 0x7fb6dc1f0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:13.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.219+0000 7fb6da000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6dc0c7cf0 0x7fb6dc163a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:45462/0 (socket says 172.21.15.163:45462) 2024-04-01T16:35:13.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.219+0000 7fb6da000640 1 -- 172.21.15.163:0/53426516 learned_addr learned my addr 172.21.15.163:0/53426516 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:13.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.228+0000 7fb6db400640 1 -- 172.21.15.163:0/53426516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6dc0c7cf0 msgr2=0x7fb6dc163a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:13.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.228+0000 7fb6db400640 1 --2- 172.21.15.163:0/53426516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6dc0c7cf0 0x7fb6dc163a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:13.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.228+0000 7fb6db400640 1 -- 172.21.15.163:0/53426516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6dc073450 msgr2=0x7fb6dc0cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:13.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.228+0000 7fb6db400640 1 --2- 172.21.15.163:0/53426516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6dc073450 0x7fb6dc0cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:13.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.228+0000 7fb6db400640 1 -- 172.21.15.163:0/53426516 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6dc1f3d10 con 0x7fb6dc151880 2024-04-01T16:35:13.233 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.234+0000 7fb6db400640 1 --2- 172.21.15.163:0/53426516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6dc151880 0x7fb6dc1f0aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400e7f0 tx=0x7fb6d400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:13.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.240+0000 7fb6d2a00640 1 -- 172.21.15.163:0/53426516 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4017070 con 0x7fb6dc151880 2024-04-01T16:35:13.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.240+0000 7fb6dbe00640 1 -- 172.21.15.163:0/53426516 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6dc1f3ff0 con 0x7fb6dc151880 2024-04-01T16:35:13.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.240+0000 7fb6dbe00640 1 -- 172.21.15.163:0/53426516 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6dc1f45b0 con 0x7fb6dc151880 2024-04-01T16:35:13.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.242+0000 7fb6dbe00640 1 -- 172.21.15.163:0/53426516 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6dc0756d0 con 0x7fb6dc151880 2024-04-01T16:35:13.244 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.245+0000 7fb6d2a00640 1 -- 172.21.15.163:0/53426516 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d4004020 con 0x7fb6dc151880 2024-04-01T16:35:13.244 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.245+0000 7fb6d2a00640 1 -- 172.21.15.163:0/53426516 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4021060 con 0x7fb6dc151880 2024-04-01T16:35:13.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.573+0000 7fb6d2a00640 1 -- 172.21.15.163:0/53426516 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6d401a070 con 0x7fb6dc151880 2024-04-01T16:35:13.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.575+0000 7fb6d2a00640 1 --2- 172.21.15.163:0/53426516 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb6bc06c8f0 0x7fb6bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:13.575 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.576+0000 7fb6d2a00640 1 -- 172.21.15.163:0/53426516 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fb6d4008030 con 0x7fb6dc151880 2024-04-01T16:35:13.575 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.576+0000 7fb6daa00640 1 --2- 172.21.15.163:0/53426516 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb6bc06c8f0 0x7fb6bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:13.577 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.577+0000 7fb6daa00640 1 --2- 172.21.15.163:0/53426516 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb6bc06c8f0 0x7fb6bc06edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc001560 tx=0x7fb6cc007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:13.588 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.588+0000 7fb6d2a00640 1 -- 172.21.15.163:0/53426516 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb6d4059e40 con 0x7fb6dc151880 2024-04-01T16:35:13.817 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.818+0000 7fb6dbe00640 1 -- 172.21.15.163:0/53426516 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb6dc0c6550 con 0x7fb6dc151880 2024-04-01T16:35:13.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.834+0000 7fb6d2a00640 1 -- 172.21.15.163:0/53426516 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fb6d405e140 con 0x7fb6dc151880 2024-04-01T16:35:13.835 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2024-04-01T16:35:13.838 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.837+0000 7fb6dbe00640 1 -- 172.21.15.163:0/53426516 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb6bc06c8f0 msgr2=0x7fb6bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:13.838 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.837+0000 7fb6dbe00640 1 --2- 172.21.15.163:0/53426516 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb6bc06c8f0 0x7fb6bc06edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc001560 tx=0x7fb6cc007ca0 comp rx=0 tx=0).stop 2024-04-01T16:35:13.838 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.837+0000 7fb6dbe00640 1 -- 172.21.15.163:0/53426516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6dc151880 msgr2=0x7fb6dc1f0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:13.838 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.837+0000 7fb6dbe00640 1 --2- 172.21.15.163:0/53426516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6dc151880 0x7fb6dc1f0aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400e7f0 tx=0x7fb6d400ecb0 comp rx=0 tx=0).stop 2024-04-01T16:35:13.838 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.837+0000 7fb6dbe00640 1 -- 172.21.15.163:0/53426516 shutdown_connections 2024-04-01T16:35:13.838 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.837+0000 7fb6dbe00640 1 --2- 172.21.15.163:0/53426516 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb6bc06c8f0 0x7fb6bc06edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:13.839 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.837+0000 7fb6dbe00640 1 --2- 172.21.15.163:0/53426516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb6dc151880 0x7fb6dc1f0aa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:13.839 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.837+0000 7fb6dbe00640 1 --2- 172.21.15.163:0/53426516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6dc0c7cf0 0x7fb6dc163a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:13.839 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.837+0000 7fb6dbe00640 1 --2- 172.21.15.163:0/53426516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6dc073450 0x7fb6dc0cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:13.839 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.837+0000 7fb6dbe00640 1 -- 172.21.15.163:0/53426516 >> 172.21.15.163:0/53426516 conn(0x7fb6dc06b540 msgr2=0x7fb6dc155180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:13.839 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.837+0000 7fb6dbe00640 1 -- 172.21.15.163:0/53426516 shutdown_connections 2024-04-01T16:35:13.839 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:13.837+0000 7fb6dbe00640 1 -- 172.21.15.163:0/53426516 wait complete. 2024-04-01T16:35:13.860 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T16:35:14.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.072+0000 7fdaa6600640 1 Processor -- start 2024-04-01T16:35:14.072 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.072+0000 7fdaa6600640 1 -- start start 2024-04-01T16:35:14.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.073+0000 7fdaa6600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdaa0070030 0x7fdaa00c1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:14.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.073+0000 7fdaa6600640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fdaa00c18d0 0x7fdaa015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:14.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.073+0000 7fdaa6600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa0158800 con 0x7fdaa0152870 2024-04-01T16:35:14.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.073+0000 7fdaa6600640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa0152c50 con 0x7fdaa00c18d0 2024-04-01T16:35:14.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.073+0000 7fdaa6600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa0159390 con 0x7fdaa0070030 2024-04-01T16:35:14.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.074+0000 7fdaa5200640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fdaa0152870 0x7fdaa00c5260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:58878/0 (socket says 172.21.15.163:58878) 2024-04-01T16:35:14.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.074+0000 7fdaa5200640 1 -- 172.21.15.163:0/3972194288 learned_addr learned my addr 172.21.15.163:0/3972194288 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:35:14.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.075+0000 7fdaa5c00640 1 --2- 172.21.15.163:0/3972194288 >> v2:172.21.15.189:3300/0 conn(0x7fdaa00c18d0 0x7fdaa015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:14.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.075+0000 7fda9fe00640 1 --2- 172.21.15.163:0/3972194288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdaa0070030 0x7fdaa00c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:14.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.077+0000 7fda9f400640 1 -- 172.21.15.163:0/3972194288 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445961494 0 0) 0x7fdaa0158800 con 0x7fdaa0152870 2024-04-01T16:35:14.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.077+0000 7fda9f400640 1 -- 172.21.15.163:0/3972194288 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda88003520 con 0x7fdaa0152870 2024-04-01T16:35:14.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.079+0000 7fdaa5c00640 1 -- 172.21.15.163:0/3972194288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdaa0070030 msgr2=0x7fdaa00c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:14.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.079+0000 7fdaa5c00640 1 --2- 172.21.15.163:0/3972194288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdaa0070030 0x7fdaa00c1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:14.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.079+0000 7fdaa5c00640 1 -- 172.21.15.163:0/3972194288 >> v1:172.21.15.163:6789/0 conn(0x7fdaa0152870 legacy=0x7fdaa00c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:14.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.079+0000 7fdaa5c00640 1 -- 172.21.15.163:0/3972194288 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa0158aa0 con 0x7fdaa00c18d0 2024-04-01T16:35:14.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.083+0000 7fdaa5c00640 1 --2- 172.21.15.163:0/3972194288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdaa00c18d0 0x7fdaa015bc50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fda98009d90 tx=0x7fda9802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41f4524f16bf8216 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:14.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.093+0000 7fda9f400640 1 -- 172.21.15.163:0/3972194288 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98039070 con 0x7fdaa00c18d0 2024-04-01T16:35:14.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.093+0000 7fda9f400640 1 -- 172.21.15.163:0/3972194288 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9802cc60 con 0x7fdaa00c18d0 2024-04-01T16:35:14.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.093+0000 7fda9f400640 1 -- 172.21.15.163:0/3972194288 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98034660 con 0x7fdaa00c18d0 2024-04-01T16:35:14.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.094+0000 7fdaa6600640 1 -- 172.21.15.163:0/3972194288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdaa00c18d0 msgr2=0x7fdaa015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:14.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.094+0000 7fdaa6600640 1 --2- 172.21.15.163:0/3972194288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdaa00c18d0 0x7fdaa015bc50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fda98009d90 tx=0x7fda9802beb0 comp rx=0 tx=0).stop 2024-04-01T16:35:14.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.094+0000 7fdaa6600640 1 -- 172.21.15.163:0/3972194288 shutdown_connections 2024-04-01T16:35:14.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.094+0000 7fdaa6600640 1 --2- 172.21.15.163:0/3972194288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdaa00c18d0 0x7fdaa015bc50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:14.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.094+0000 7fdaa6600640 1 --2- 172.21.15.163:0/3972194288 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdaa0070030 0x7fdaa00c1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:14.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.094+0000 7fdaa6600640 1 -- 172.21.15.163:0/3972194288 >> 172.21.15.163:0/3972194288 conn(0x7fdaa006b540 msgr2=0x7fdaa006b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:14.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.094+0000 7fdaa6600640 1 -- 172.21.15.163:0/3972194288 shutdown_connections 2024-04-01T16:35:14.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.094+0000 7fdaa6600640 1 -- 172.21.15.163:0/3972194288 wait complete. 2024-04-01T16:35:14.097 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.096+0000 7fdaa6600640 1 Processor -- start 2024-04-01T16:35:14.097 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.097+0000 7fdaa6600640 1 -- start start 2024-04-01T16:35:14.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.098+0000 7fdaa6600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdaa0070030 0x7fdaa00c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:14.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.098+0000 7fdaa6600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdaa00c18d0 0x7fdaa00c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:14.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.098+0000 7fdaa6600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdaa0152870 0x7fdaa01482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:14.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.098+0000 7fdaa6600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa01584f0 con 0x7fdaa0070030 2024-04-01T16:35:14.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.098+0000 7fdaa6600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa0159020 con 0x7fdaa00c18d0 2024-04-01T16:35:14.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.098+0000 7fdaa6600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa00c5970 con 0x7fdaa0152870 2024-04-01T16:35:14.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.099+0000 7fdaa5200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdaa0070030 0x7fdaa00c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:14.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.100+0000 7fdaa5200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdaa0070030 0x7fdaa00c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37100/0 (socket says 172.21.15.163:37100) 2024-04-01T16:35:14.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.100+0000 7fdaa5200640 1 -- 172.21.15.163:0/1012389884 learned_addr learned my addr 172.21.15.163:0/1012389884 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:14.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.100+0000 7fda9fe00640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdaa00c18d0 0x7fdaa00c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:14.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.100+0000 7fdaa5c00640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdaa0152870 0x7fdaa01482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:14.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.105+0000 7fdaa5200640 1 -- 172.21.15.163:0/1012389884 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdaa0152870 msgr2=0x7fdaa01482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:14.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.105+0000 7fdaa5200640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdaa0152870 0x7fdaa01482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:14.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.105+0000 7fdaa5200640 1 -- 172.21.15.163:0/1012389884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdaa00c18d0 msgr2=0x7fdaa00c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:14.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.105+0000 7fdaa5200640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdaa00c18d0 0x7fdaa00c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:14.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.105+0000 7fdaa5200640 1 -- 172.21.15.163:0/1012389884 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa00c3840 con 0x7fdaa0070030 2024-04-01T16:35:14.108 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.108+0000 7fdaa5200640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdaa0070030 0x7fdaa00c42e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda9400c3c0 tx=0x7fda9400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:14.114 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.115+0000 7fda9cc00640 1 -- 172.21.15.163:0/1012389884 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94017070 con 0x7fdaa0070030 2024-04-01T16:35:14.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.115+0000 7fda9cc00640 1 -- 172.21.15.163:0/1012389884 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda94005ce0 con 0x7fdaa0070030 2024-04-01T16:35:14.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.115+0000 7fda9cc00640 1 -- 172.21.15.163:0/1012389884 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda940072f0 con 0x7fdaa0070030 2024-04-01T16:35:14.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.115+0000 7fdaa6600640 1 -- 172.21.15.163:0/1012389884 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa00ae870 con 0x7fdaa0070030 2024-04-01T16:35:14.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.115+0000 7fdaa6600640 1 -- 172.21.15.163:0/1012389884 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa00c3ae0 con 0x7fdaa0070030 2024-04-01T16:35:14.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.117+0000 7fdaa6600640 1 -- 172.21.15.163:0/1012389884 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa00756d0 con 0x7fdaa0070030 2024-04-01T16:35:14.302 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:35:14.310 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:35:14.431 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.432+0000 7fda9cc00640 1 -- 172.21.15.163:0/1012389884 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda9401a070 con 0x7fdaa0070030 2024-04-01T16:35:14.433 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.434+0000 7fda9cc00640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fda8006c970 0x7fda8006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:14.433 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.434+0000 7fda9fe00640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fda8006c970 0x7fda8006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:14.435 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.436+0000 7fda9fe00640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fda8006c970 0x7fda8006ee30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0156590 tx=0x7fda8c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:14.458 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.458+0000 7fda9cc00640 1 -- 172.21.15.163:0/1012389884 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fda94057100 con 0x7fdaa0070030 2024-04-01T16:35:14.459 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.460+0000 7fda9cc00640 1 -- 172.21.15.163:0/1012389884 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fda94021020 con 0x7fdaa0070030 2024-04-01T16:35:14.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.693+0000 7fdaa6600640 1 -- 172.21.15.163:0/1012389884 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdaa0070560 con 0x7fdaa0070030 2024-04-01T16:35:14.725 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.725+0000 7fda9cc00640 1 -- 172.21.15.163:0/1012389884 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fda94059060 con 0x7fdaa0070030 2024-04-01T16:35:14.725 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2024-04-01T16:35:14.729 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.729+0000 7fdaa6600640 1 -- 172.21.15.163:0/1012389884 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fda8006c970 msgr2=0x7fda8006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:14.729 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.729+0000 7fdaa6600640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fda8006c970 0x7fda8006ee30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0156590 tx=0x7fda8c009190 comp rx=0 tx=0).stop 2024-04-01T16:35:14.729 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.729+0000 7fdaa6600640 1 -- 172.21.15.163:0/1012389884 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdaa0070030 msgr2=0x7fdaa00c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:14.729 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.729+0000 7fdaa6600640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdaa0070030 0x7fdaa00c42e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda9400c3c0 tx=0x7fda9400c880 comp rx=0 tx=0).stop 2024-04-01T16:35:14.729 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.729+0000 7fdaa6600640 1 -- 172.21.15.163:0/1012389884 shutdown_connections 2024-04-01T16:35:14.729 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.729+0000 7fdaa6600640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fda8006c970 0x7fda8006ee30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:14.729 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.729+0000 7fdaa6600640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fdaa0152870 0x7fdaa01482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:14.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.729+0000 7fdaa6600640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdaa00c18d0 0x7fdaa00c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:14.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.729+0000 7fdaa6600640 1 --2- 172.21.15.163:0/1012389884 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdaa0070030 0x7fdaa00c42e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:14.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.729+0000 7fdaa6600640 1 -- 172.21.15.163:0/1012389884 >> 172.21.15.163:0/1012389884 conn(0x7fdaa006b540 msgr2=0x7fdaa00724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:14.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.729+0000 7fdaa6600640 1 -- 172.21.15.163:0/1012389884 shutdown_connections 2024-04-01T16:35:14.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:14.730+0000 7fdaa6600640 1 -- 172.21.15.163:0/1012389884 wait complete. 2024-04-01T16:35:14.750 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T16:35:15.002 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.002+0000 7f24e6e00640 1 Processor -- start 2024-04-01T16:35:15.002 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.002+0000 7f24e6e00640 1 -- start start 2024-04-01T16:35:15.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.004+0000 7f24e6e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f24e0154b30 0x7f24e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:15.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.004+0000 7f24e6e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f24e0070070 0x7f24e015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:15.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.004+0000 7f24e6e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24e015dc50 con 0x7f24e015b380 2024-04-01T16:35:15.004 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.004+0000 7f24e6e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f24e00c3480 con 0x7f24e0070070 2024-04-01T16:35:15.004 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.004+0000 7f24e6e00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f24e015a660 con 0x7f24e0154b30 2024-04-01T16:35:15.004 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.005+0000 7f24df400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f24e0070070 0x7f24e015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:15.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.005+0000 7f24df400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f24e0070070 0x7f24e015ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37114/0 (socket says 172.21.15.163:37114) 2024-04-01T16:35:15.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.005+0000 7f24df400640 1 -- 172.21.15.163:0/1600241188 learned_addr learned my addr 172.21.15.163:0/1600241188 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:15.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.008+0000 7f24df400640 1 -- 172.21.15.163:0/1600241188 >> v2:172.21.15.189:3300/0 conn(0x7f24e0154b30 msgr2=0x7f24e006edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:15.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.008+0000 7f24df400640 1 --2- 172.21.15.163:0/1600241188 >> v2:172.21.15.189:3300/0 conn(0x7f24e0154b30 0x7f24e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:15.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.008+0000 7f24df400640 1 -- 172.21.15.163:0/1600241188 >> v1:172.21.15.163:6789/0 conn(0x7f24e015b380 legacy=0x7f24e006b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:15.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.008+0000 7f24df400640 1 -- 172.21.15.163:0/1600241188 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e00c3740 con 0x7f24e0070070 2024-04-01T16:35:15.012 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.013+0000 7f24df400640 1 --2- 172.21.15.163:0/1600241188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24e0070070 0x7f24e015ae40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f24e0071af0 tx=0x7f24c802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78022bb44cffc305 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:15.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.044+0000 7f24dea00640 1 -- 172.21.15.163:0/1600241188 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c802f850 con 0x7f24e0070070 2024-04-01T16:35:15.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.044+0000 7f24dea00640 1 -- 172.21.15.163:0/1600241188 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c802f9f0 con 0x7f24e0070070 2024-04-01T16:35:15.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.044+0000 7f24dea00640 1 -- 172.21.15.163:0/1600241188 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c802fdc0 con 0x7f24e0070070 2024-04-01T16:35:15.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.045+0000 7f24e6e00640 1 -- 172.21.15.163:0/1600241188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24e0070070 msgr2=0x7f24e015ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:15.045 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.045+0000 7f24e6e00640 1 --2- 172.21.15.163:0/1600241188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24e0070070 0x7f24e015ae40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f24e0071af0 tx=0x7f24c802ba30 comp rx=0 tx=0).stop 2024-04-01T16:35:15.045 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.046+0000 7f24e6e00640 1 -- 172.21.15.163:0/1600241188 shutdown_connections 2024-04-01T16:35:15.045 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.046+0000 7f24e6e00640 1 --2- 172.21.15.163:0/1600241188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24e0070070 0x7f24e015ae40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:15.045 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.046+0000 7f24e6e00640 1 --2- 172.21.15.163:0/1600241188 >> v2:172.21.15.189:3300/0 conn(0x7f24e0154b30 0x7f24e006edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:15.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.046+0000 7f24e6e00640 1 -- 172.21.15.163:0/1600241188 >> 172.21.15.163:0/1600241188 conn(0x7f24e00ccf80 msgr2=0x7f24e00cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:15.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.046+0000 7f24e6e00640 1 -- 172.21.15.163:0/1600241188 shutdown_connections 2024-04-01T16:35:15.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.046+0000 7f24e6e00640 1 -- 172.21.15.163:0/1600241188 wait complete. 2024-04-01T16:35:15.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.048+0000 7f24e6e00640 1 Processor -- start 2024-04-01T16:35:15.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.048+0000 7f24e6e00640 1 -- start start 2024-04-01T16:35:15.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.049+0000 7f24e6e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24e0070070 0x7f24e01f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:15.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.049+0000 7f24e6e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24e0154b30 0x7f24e0151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:15.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.049+0000 7f24e6e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24e015b380 0x7f24e00c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:15.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.049+0000 7f24e6e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f24e00c3fe0 con 0x7f24e0154b30 2024-04-01T16:35:15.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.049+0000 7f24e6e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f24e00c3d00 con 0x7f24e0070070 2024-04-01T16:35:15.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.049+0000 7f24e6e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f24e015a920 con 0x7f24e015b380 2024-04-01T16:35:15.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.050+0000 7f24df400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24e0154b30 0x7f24e0151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:15.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.050+0000 7f24df400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24e0154b30 0x7f24e0151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37120/0 (socket says 172.21.15.163:37120) 2024-04-01T16:35:15.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.050+0000 7f24df400640 1 -- 172.21.15.163:0/4112153758 learned_addr learned my addr 172.21.15.163:0/4112153758 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:15.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.051+0000 7f24e4e00640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24e015b380 0x7f24e00c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:15.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.054+0000 7f24df400640 1 -- 172.21.15.163:0/4112153758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24e015b380 msgr2=0x7f24e00c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:15.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.054+0000 7f24df400640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24e015b380 0x7f24e00c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:15.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.054+0000 7f24df400640 1 -- 172.21.15.163:0/4112153758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24e0070070 msgr2=0x7f24e01f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:15.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.054+0000 7f24df400640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24e0070070 0x7f24e01f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:15.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.054+0000 7f24df400640 1 -- 172.21.15.163:0/4112153758 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e01e41d0 con 0x7f24e0154b30 2024-04-01T16:35:15.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.057+0000 7f24df400640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24e0154b30 0x7f24e0151e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f24c8000c00 tx=0x7f24c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:15.059 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.059+0000 7f24d7e00640 1 -- 172.21.15.163:0/4112153758 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c802f840 con 0x7f24e0154b30 2024-04-01T16:35:15.059 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.060+0000 7f24e6e00640 1 -- 172.21.15.163:0/4112153758 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e01e4490 con 0x7f24e0154b30 2024-04-01T16:35:15.059 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.060+0000 7f24e6e00640 1 -- 172.21.15.163:0/4112153758 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e01e4a50 con 0x7f24e0154b30 2024-04-01T16:35:15.060 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.061+0000 7f24e6e00640 1 -- 172.21.15.163:0/4112153758 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e01546e0 con 0x7f24e0154b30 2024-04-01T16:35:15.061 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.061+0000 7f24d7e00640 1 -- 172.21.15.163:0/4112153758 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c8046070 con 0x7f24e0154b30 2024-04-01T16:35:15.061 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.061+0000 7f24d7e00640 1 -- 172.21.15.163:0/4112153758 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c804b660 con 0x7f24e0154b30 2024-04-01T16:35:15.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.357+0000 7f24d7e00640 1 -- 172.21.15.163:0/4112153758 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24c8040070 con 0x7f24e0154b30 2024-04-01T16:35:15.358 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.358+0000 7f24d7e00640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f24bc06ca90 0x7f24bc06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:15.358 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.359+0000 7f24dfe00640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f24bc06ca90 0x7f24bc06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:15.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.361+0000 7f24dfe00640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f24bc06ca90 0x7f24bc06ef50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009710 tx=0x7f24d0006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:15.438 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.438+0000 7f24d7e00640 1 -- 172.21.15.163:0/4112153758 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f24c807ad50 con 0x7f24e0154b30 2024-04-01T16:35:15.439 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.439+0000 7f24d7e00640 1 -- 172.21.15.163:0/4112153758 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f24e01546e0 con 0x7f24e0154b30 2024-04-01T16:35:15.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.691+0000 7f24e6e00640 1 -- 172.21.15.163:0/4112153758 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24e00b2ec0 con 0x7f24e0154b30 2024-04-01T16:35:15.803 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.804+0000 7f24d7e00640 1 -- 172.21.15.163:0/4112153758 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6839 (secure 0 0 0) 0x7f24c8033030 con 0x7f24e0154b30 2024-04-01T16:35:15.804 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:35:15.804 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/220229466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":220229466},{"type":"v1","addr":"172.21.15.189:6834","nonce":220229466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/1149566111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1149566111},{"type":"v1","addr":"172.21.15.163:6839","nonce":1149566111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2556471418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2556471418},{"type":"v1","addr":"172.21.15.163:6835","nonce":2556471418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1010688449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1010688449},{"type":"v1","addr":"172.21.15.163:6837","nonce":1010688449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1685366427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1685366427},{"type":"v1","addr":"172.21.15.189:6837","nonce":1685366427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T16:34:34.157633+0000","modified":"2024-04-01T16:34:41.924119+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.189:6835/2672478403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2672478403},{"type":"v1","addr":"172.21.15.189:6835","nonce":2672478403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-04-01T16:35:15.804 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 8 2024-04-01T16:35:15.807 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.808+0000 7f24e6e00640 1 -- 172.21.15.163:0/4112153758 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f24bc06ca90 msgr2=0x7f24bc06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:15.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.808+0000 7f24e6e00640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f24bc06ca90 0x7f24bc06ef50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009710 tx=0x7f24d0006c90 comp rx=0 tx=0).stop 2024-04-01T16:35:15.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.808+0000 7f24e6e00640 1 -- 172.21.15.163:0/4112153758 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24e0154b30 msgr2=0x7f24e0151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:15.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.808+0000 7f24e6e00640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24e0154b30 0x7f24e0151e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f24c8000c00 tx=0x7f24c8004730 comp rx=0 tx=0).stop 2024-04-01T16:35:15.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.808+0000 7f24e6e00640 1 -- 172.21.15.163:0/4112153758 shutdown_connections 2024-04-01T16:35:15.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.808+0000 7f24e6e00640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f24bc06ca90 0x7f24bc06ef50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:15.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.808+0000 7f24e6e00640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f24e015b380 0x7f24e00c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:15.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.808+0000 7f24e6e00640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24e0154b30 0x7f24e0151e10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:15.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.808+0000 7f24e6e00640 1 --2- 172.21.15.163:0/4112153758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24e0070070 0x7f24e01f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:15.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.808+0000 7f24e6e00640 1 -- 172.21.15.163:0/4112153758 >> 172.21.15.163:0/4112153758 conn(0x7f24e00ccf80 msgr2=0x7f24e0152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:15.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.808+0000 7f24e6e00640 1 -- 172.21.15.163:0/4112153758 shutdown_connections 2024-04-01T16:35:15.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:15.808+0000 7f24e6e00640 1 -- 172.21.15.163:0/4112153758 wait complete. 2024-04-01T16:35:15.828 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T16:35:16.033 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.034+0000 7f6178e00640 1 Processor -- start 2024-04-01T16:35:16.034 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.034+0000 7f6178e00640 1 -- start start 2024-04-01T16:35:16.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.036+0000 7f6178e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f617406de00 0x7f617415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:16.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.036+0000 7f6178e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f61740cbe80 0x7f61740cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:16.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.036+0000 7f6178e00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61740cc830 con 0x7f6174154a30 2024-04-01T16:35:16.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.036+0000 7f6178e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f617415ec60 con 0x7f617406de00 2024-04-01T16:35:16.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.036+0000 7f6178e00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f61740cd820 con 0x7f61740cbe80 2024-04-01T16:35:16.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.037+0000 7f6171400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f617406de00 0x7f617415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:16.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.037+0000 7f6172800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f61740cbe80 0x7f61740cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:16.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.037+0000 7f6171400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f617406de00 0x7f617415b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37130/0 (socket says 172.21.15.163:37130) 2024-04-01T16:35:16.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.037+0000 7f6171400640 1 -- 172.21.15.163:0/3995539490 learned_addr learned my addr 172.21.15.163:0/3995539490 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:16.039 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.040+0000 7f6171400640 1 -- 172.21.15.163:0/3995539490 >> v2:172.21.15.189:3300/0 conn(0x7f61740cbe80 msgr2=0x7f61740cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:16.039 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.040+0000 7f6171400640 1 --2- 172.21.15.163:0/3995539490 >> v2:172.21.15.189:3300/0 conn(0x7f61740cbe80 0x7f61740cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.039 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.040+0000 7f6171400640 1 -- 172.21.15.163:0/3995539490 >> v1:172.21.15.189:6789/0 conn(0x7f6174154a30 legacy=0x7f61740cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:16.039 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.040+0000 7f6171400640 1 -- 172.21.15.163:0/3995539490 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617415e140 con 0x7f617406de00 2024-04-01T16:35:16.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.042+0000 7f6171400640 1 --2- 172.21.15.163:0/3995539490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f617406de00 0x7f617415b1b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f617406e310 tx=0x7f616002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd1a56ebc420eb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:16.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.047+0000 7f6170a00640 1 -- 172.21.15.163:0/3995539490 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160035020 con 0x7f617406de00 2024-04-01T16:35:16.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.047+0000 7f6170a00640 1 -- 172.21.15.163:0/3995539490 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616002d040 con 0x7f617406de00 2024-04-01T16:35:16.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.047+0000 7f6170a00640 1 -- 172.21.15.163:0/3995539490 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160031a80 con 0x7f617406de00 2024-04-01T16:35:16.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.047+0000 7f6178e00640 1 -- 172.21.15.163:0/3995539490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f617406de00 msgr2=0x7f617415b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:16.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.047+0000 7f6178e00640 1 --2- 172.21.15.163:0/3995539490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f617406de00 0x7f617415b1b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f617406e310 tx=0x7f616002b900 comp rx=0 tx=0).stop 2024-04-01T16:35:16.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.047+0000 7f6178e00640 1 -- 172.21.15.163:0/3995539490 shutdown_connections 2024-04-01T16:35:16.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.047+0000 7f6178e00640 1 --2- 172.21.15.163:0/3995539490 >> v2:172.21.15.189:3300/0 conn(0x7f61740cbe80 0x7f61740cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.047+0000 7f6178e00640 1 --2- 172.21.15.163:0/3995539490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f617406de00 0x7f617415b1b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.047+0000 7f6178e00640 1 -- 172.21.15.163:0/3995539490 >> 172.21.15.163:0/3995539490 conn(0x7f617408c730 msgr2=0x7f6174067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:16.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.048+0000 7f6178e00640 1 -- 172.21.15.163:0/3995539490 shutdown_connections 2024-04-01T16:35:16.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.048+0000 7f6178e00640 1 -- 172.21.15.163:0/3995539490 wait complete. 2024-04-01T16:35:16.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.049+0000 7f6178e00640 1 Processor -- start 2024-04-01T16:35:16.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.049+0000 7f6178e00640 1 -- start start 2024-04-01T16:35:16.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.050+0000 7f6178e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f617406de00 0x7f61740b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:16.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.050+0000 7f6178e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61740cbe80 0x7f61741f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:16.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.050+0000 7f6178e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6174154a30 0x7f61741f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:16.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.050+0000 7f6178e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f617415e980 con 0x7f6174154a30 2024-04-01T16:35:16.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.050+0000 7f6178e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f617415e6a0 con 0x7f61740cbe80 2024-04-01T16:35:16.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.050+0000 7f6178e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6174154e10 con 0x7f617406de00 2024-04-01T16:35:16.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.051+0000 7f6172800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6174154a30 0x7f61741f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:16.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.051+0000 7f6172800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6174154a30 0x7f61741f25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37138/0 (socket says 172.21.15.163:37138) 2024-04-01T16:35:16.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.051+0000 7f6172800640 1 -- 172.21.15.163:0/2948001560 learned_addr learned my addr 172.21.15.163:0/2948001560 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:16.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.052+0000 7f6171e00640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f617406de00 0x7f61740b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:16.053 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.054+0000 7f6171400640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61740cbe80 0x7f61741f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:16.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.055+0000 7f6172800640 1 -- 172.21.15.163:0/2948001560 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f617406de00 msgr2=0x7f61740b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:16.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.055+0000 7f6172800640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f617406de00 0x7f61740b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.055+0000 7f6172800640 1 -- 172.21.15.163:0/2948001560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61740cbe80 msgr2=0x7f61741f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:16.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.055+0000 7f6172800640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61740cbe80 0x7f61741f2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.055+0000 7f6172800640 1 -- 172.21.15.163:0/2948001560 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61741f3ec0 con 0x7f6174154a30 2024-04-01T16:35:16.057 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.058+0000 7f6172800640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6174154a30 0x7f61741f25b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f616c00efc0 tx=0x7f616c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:16.061 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.061+0000 7f616a000640 1 -- 172.21.15.163:0/2948001560 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c018020 con 0x7f6174154a30 2024-04-01T16:35:16.061 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.062+0000 7f616a000640 1 -- 172.21.15.163:0/2948001560 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616c014480 con 0x7f6174154a30 2024-04-01T16:35:16.061 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.062+0000 7f616a000640 1 -- 172.21.15.163:0/2948001560 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c014870 con 0x7f6174154a30 2024-04-01T16:35:16.061 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.062+0000 7f6178e00640 1 -- 172.21.15.163:0/2948001560 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61741f4160 con 0x7f6174154a30 2024-04-01T16:35:16.061 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.062+0000 7f6178e00640 1 -- 172.21.15.163:0/2948001560 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61741f4720 con 0x7f6174154a30 2024-04-01T16:35:16.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.063+0000 7f6178e00640 1 -- 172.21.15.163:0/2948001560 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6174073bb0 con 0x7f6174154a30 2024-04-01T16:35:16.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.357+0000 7f616a000640 1 -- 172.21.15.163:0/2948001560 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f616c005d10 con 0x7f6174154a30 2024-04-01T16:35:16.358 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.359+0000 7f616a000640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f615406c970 0x7f615406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:16.359 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.360+0000 7f6171e00640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f615406c970 0x7f615406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:16.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.361+0000 7f6171e00640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f615406c970 0x7f615406ee30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6164006fd0 tx=0x7f6164009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:16.393 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.394+0000 7f616a000640 1 -- 172.21.15.163:0/2948001560 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f616c058c90 con 0x7f6174154a30 2024-04-01T16:35:16.394 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.394+0000 7f616a000640 1 -- 172.21.15.163:0/2948001560 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f616c022030 con 0x7f6174154a30 2024-04-01T16:35:16.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.599+0000 7f6178e00640 1 -- 172.21.15.163:0/2948001560 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61740c6d70 con 0x7f6174154a30 2024-04-01T16:35:16.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.644+0000 7f616a000640 1 -- 172.21.15.163:0/2948001560 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+16901 (secure 0 0 0) 0x7f61740c6d70 con 0x7f6174154a30 2024-04-01T16:35:16.644 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:35:16.644 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":27,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:53.160271+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T16:34:29.028272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T16:34:31.534879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T16:35:16.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.647+0000 7f6178e00640 1 -- 172.21.15.163:0/2948001560 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f615406c970 msgr2=0x7f615406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:16.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.647+0000 7f6178e00640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f615406c970 0x7f615406ee30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6164006fd0 tx=0x7f6164009060 comp rx=0 tx=0).stop 2024-04-01T16:35:16.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.647+0000 7f6178e00640 1 -- 172.21.15.163:0/2948001560 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6174154a30 msgr2=0x7f61741f25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:16.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.647+0000 7f6178e00640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6174154a30 0x7f61741f25b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f616c00efc0 tx=0x7f616c00c490 comp rx=0 tx=0).stop 2024-04-01T16:35:16.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.647+0000 7f6178e00640 1 -- 172.21.15.163:0/2948001560 shutdown_connections 2024-04-01T16:35:16.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.647+0000 7f6178e00640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f615406c970 0x7f615406ee30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.647+0000 7f6178e00640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6174154a30 0x7f61741f25b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.647+0000 7f6178e00640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61740cbe80 0x7f61741f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.647+0000 7f6178e00640 1 --2- 172.21.15.163:0/2948001560 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f617406de00 0x7f61740b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.647+0000 7f6178e00640 1 -- 172.21.15.163:0/2948001560 >> 172.21.15.163:0/2948001560 conn(0x7f617408c730 msgr2=0x7f617414aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:16.648 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.647+0000 7f6178e00640 1 -- 172.21.15.163:0/2948001560 shutdown_connections 2024-04-01T16:35:16.648 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.647+0000 7f6178e00640 1 -- 172.21.15.163:0/2948001560 wait complete. 2024-04-01T16:35:16.666 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T16:35:16.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.867+0000 7f3cd3000640 1 Processor -- start 2024-04-01T16:35:16.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.868+0000 7f3cd3000640 1 -- start start 2024-04-01T16:35:16.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.869+0000 7f3cd3000640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f3ccc070100 0x7f3ccc15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:16.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.869+0000 7f3cd3000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 0x7f3ccc0c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:16.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.869+0000 7f3cd3000640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ccc15b040 con 0x7f3ccc151700 2024-04-01T16:35:16.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.869+0000 7f3cd3000640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3ccc0c3060 con 0x7f3ccc070100 2024-04-01T16:35:16.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.869+0000 7f3cd3000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3ccc15b8e0 con 0x7f3ccc0c8160 2024-04-01T16:35:16.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.911+0000 7f3cd1000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 0x7f3ccc0c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:16.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.911+0000 7f3cd1000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 0x7f3ccc0c0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:46990/0 (socket says 172.21.15.163:46990) 2024-04-01T16:35:16.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.911+0000 7f3cd1000640 1 -- 172.21.15.163:0/4020740504 learned_addr learned my addr 172.21.15.163:0/4020740504 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:16.915 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.915+0000 7f3cd1000640 1 -- 172.21.15.163:0/4020740504 >> v2:172.21.15.189:3300/0 conn(0x7f3ccc070100 msgr2=0x7f3ccc15aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:16.915 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.915+0000 7f3cd1000640 1 --2- 172.21.15.163:0/4020740504 >> v2:172.21.15.189:3300/0 conn(0x7f3ccc070100 0x7f3ccc15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.915 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.915+0000 7f3cd1000640 1 -- 172.21.15.163:0/4020740504 >> v1:172.21.15.189:6789/0 conn(0x7f3ccc151700 legacy=0x7f3ccc0c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:16.915 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.915+0000 7f3cd1000640 1 -- 172.21.15.163:0/4020740504 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ccc15b320 con 0x7f3ccc0c8160 2024-04-01T16:35:16.918 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.919+0000 7f3cd1000640 1 --2- 172.21.15.163:0/4020740504 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 0x7f3ccc0c0eb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009e50 tx=0x7f3cc402e0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2f646b5a1659c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:16.927 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.927+0000 7f3ccb400640 1 -- 172.21.15.163:0/4020740504 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc402ec80 con 0x7f3ccc0c8160 2024-04-01T16:35:16.927 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.927+0000 7f3ccb400640 1 -- 172.21.15.163:0/4020740504 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc402ee20 con 0x7f3ccc0c8160 2024-04-01T16:35:16.927 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.927+0000 7f3ccb400640 1 -- 172.21.15.163:0/4020740504 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4036610 con 0x7f3ccc0c8160 2024-04-01T16:35:16.928 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.928+0000 7f3cd3000640 1 -- 172.21.15.163:0/4020740504 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 msgr2=0x7f3ccc0c0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:16.928 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.928+0000 7f3cd3000640 1 --2- 172.21.15.163:0/4020740504 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 0x7f3ccc0c0eb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009e50 tx=0x7f3cc402e0e0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.928 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.929+0000 7f3cd3000640 1 -- 172.21.15.163:0/4020740504 shutdown_connections 2024-04-01T16:35:16.928 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.929+0000 7f3cd3000640 1 --2- 172.21.15.163:0/4020740504 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 0x7f3ccc0c0eb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.929+0000 7f3cd3000640 1 --2- 172.21.15.163:0/4020740504 >> v2:172.21.15.189:3300/0 conn(0x7f3ccc070100 0x7f3ccc15aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.929+0000 7f3cd3000640 1 -- 172.21.15.163:0/4020740504 >> 172.21.15.163:0/4020740504 conn(0x7f3ccc0cbe20 msgr2=0x7f3ccc0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:16.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.929+0000 7f3cd3000640 1 -- 172.21.15.163:0/4020740504 shutdown_connections 2024-04-01T16:35:16.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.929+0000 7f3cd3000640 1 -- 172.21.15.163:0/4020740504 wait complete. 2024-04-01T16:35:16.931 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.932+0000 7f3cd3000640 1 Processor -- start 2024-04-01T16:35:16.931 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.932+0000 7f3cd3000640 1 -- start start 2024-04-01T16:35:16.933 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.934+0000 7f3cd3000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ccc070100 0x7f3ccc151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:16.933 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.934+0000 7f3cd3000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 0x7f3ccc144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:16.934 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.934+0000 7f3cd3000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ccc151700 0x7f3ccc14df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:16.934 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.934+0000 7f3cd3000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc0c7020 con 0x7f3ccc151700 2024-04-01T16:35:16.934 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.934+0000 7f3cd3000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc0c7390 con 0x7f3ccc070100 2024-04-01T16:35:16.934 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.934+0000 7f3cd3000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3ccc151ae0 con 0x7f3ccc0c8160 2024-04-01T16:35:16.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.937+0000 7f3cd1000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ccc151700 0x7f3ccc14df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:16.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.937+0000 7f3cc3400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 0x7f3ccc144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:16.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.938+0000 7f3cd1000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ccc151700 0x7f3ccc14df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37146/0 (socket says 172.21.15.163:37146) 2024-04-01T16:35:16.938 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.938+0000 7f3cd1000640 1 -- 172.21.15.163:0/2736079026 learned_addr learned my addr 172.21.15.163:0/2736079026 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:16.942 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.943+0000 7f3ccbe00640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ccc070100 0x7f3ccc151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:16.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.947+0000 7f3cc3400640 1 -- 172.21.15.163:0/2736079026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ccc070100 msgr2=0x7f3ccc151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:16.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.947+0000 7f3cc3400640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ccc070100 0x7f3ccc151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.947+0000 7f3cc3400640 1 -- 172.21.15.163:0/2736079026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ccc151700 msgr2=0x7f3ccc14df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:16.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.947+0000 7f3cc3400640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ccc151700 0x7f3ccc14df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:16.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.947+0000 7f3cc3400640 1 -- 172.21.15.163:0/2736079026 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ccc145150 con 0x7f3ccc0c8160 2024-04-01T16:35:16.953 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.954+0000 7f3cc3400640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 0x7f3ccc144c10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400b410 tx=0x7f3cb400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:16.959 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.959+0000 7f3cc8c00640 1 -- 172.21.15.163:0/2736079026 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4015020 con 0x7f3ccc0c8160 2024-04-01T16:35:16.959 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.960+0000 7f3cd3000640 1 -- 172.21.15.163:0/2736079026 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ccc14d820 con 0x7f3ccc0c8160 2024-04-01T16:35:16.959 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.960+0000 7f3cd3000640 1 -- 172.21.15.163:0/2736079026 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ccc0c3c00 con 0x7f3ccc0c8160 2024-04-01T16:35:16.960 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.961+0000 7f3cd3000640 1 -- 172.21.15.163:0/2736079026 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ccc0756d0 con 0x7f3ccc0c8160 2024-04-01T16:35:16.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.964+0000 7f3cc8c00640 1 -- 172.21.15.163:0/2736079026 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb4011830 con 0x7f3ccc0c8160 2024-04-01T16:35:16.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:16.964+0000 7f3cc8c00640 1 -- 172.21.15.163:0/2736079026 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4011c00 con 0x7f3ccc0c8160 2024-04-01T16:35:17.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.312+0000 7f3cc8c00640 1 -- 172.21.15.163:0/2736079026 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3cb4018020 con 0x7f3ccc0c8160 2024-04-01T16:35:17.313 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.314+0000 7f3cc8c00640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3ca806c8f0 0x7f3ca806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:17.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.314+0000 7f3ccbe00640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3ca806c8f0 0x7f3ca806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:17.315 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.316+0000 7f3ccbe00640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3ca806c8f0 0x7f3ca806edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc007fd0 tx=0x7f3cbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:17.318 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.318+0000 7f3cc8c00640 1 -- 172.21.15.163:0/2736079026 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f3cb4057d00 con 0x7f3ccc0c8160 2024-04-01T16:35:17.347 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.348+0000 7f3cc8c00640 1 -- 172.21.15.163:0/2736079026 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3cb401f020 con 0x7f3ccc0c8160 2024-04-01T16:35:17.600 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.600+0000 7f3cd3000640 1 -- 172.21.15.163:0/2736079026 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ccc14dce0 con 0x7f3ccc0c8160 2024-04-01T16:35:17.669 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.670+0000 7f3cc8c00640 1 -- 172.21.15.163:0/2736079026 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6839 (secure 0 0 0) 0x7f3ccc145150 con 0x7f3ccc0c8160 2024-04-01T16:35:17.669 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T16:35:17.669 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/220229466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":220229466},{"type":"v1","addr":"172.21.15.189:6834","nonce":220229466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/1149566111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1149566111},{"type":"v1","addr":"172.21.15.163:6839","nonce":1149566111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2556471418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2556471418},{"type":"v1","addr":"172.21.15.163:6835","nonce":2556471418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1010688449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1010688449},{"type":"v1","addr":"172.21.15.163:6837","nonce":1010688449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1685366427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1685366427},{"type":"v1","addr":"172.21.15.189:6837","nonce":1685366427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T16:34:34.157633+0000","modified":"2024-04-01T16:34:41.924119+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.189:6835/2672478403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2672478403},{"type":"v1","addr":"172.21.15.189:6835","nonce":2672478403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-04-01T16:35:17.670 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 8 2024-04-01T16:35:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.672+0000 7f3cd3000640 1 -- 172.21.15.163:0/2736079026 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3ca806c8f0 msgr2=0x7f3ca806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.673+0000 7f3cd3000640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3ca806c8f0 0x7f3ca806edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc007fd0 tx=0x7f3cbc009040 comp rx=0 tx=0).stop 2024-04-01T16:35:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.673+0000 7f3cd3000640 1 -- 172.21.15.163:0/2736079026 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 msgr2=0x7f3ccc144c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.673+0000 7f3cd3000640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 0x7f3ccc144c10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400b410 tx=0x7f3cb400b8d0 comp rx=0 tx=0).stop 2024-04-01T16:35:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.673+0000 7f3cd3000640 1 -- 172.21.15.163:0/2736079026 shutdown_connections 2024-04-01T16:35:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.673+0000 7f3cd3000640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f3ca806c8f0 0x7f3ca806edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.673+0000 7f3cd3000640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ccc151700 0x7f3ccc14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.673+0000 7f3cd3000640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f3ccc0c8160 0x7f3ccc144c10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.673+0000 7f3cd3000640 1 --2- 172.21.15.163:0/2736079026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ccc070100 0x7f3ccc151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.673+0000 7f3cd3000640 1 -- 172.21.15.163:0/2736079026 >> 172.21.15.163:0/2736079026 conn(0x7f3ccc0cbe20 msgr2=0x7f3ccc150990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.673+0000 7f3cd3000640 1 -- 172.21.15.163:0/2736079026 shutdown_connections 2024-04-01T16:35:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:17.673+0000 7f3cd3000640 1 -- 172.21.15.163:0/2736079026 wait complete. 2024-04-01T16:35:18.298 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-01T16:34:34.157633+0000', 'modified': '2024-04-01T16:34:41.924119+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.189:6835/2672478403', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6833', 'nonce': 2672478403}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 2672478403}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4270, 'qdb_cluster': [4270]} 2024-04-01T16:35:18.298 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-01T16:35:18.298 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-01T16:35:18.520 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.521+0000 7fa766600640 1 Processor -- start 2024-04-01T16:35:18.520 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.521+0000 7fa766600640 1 -- start start 2024-04-01T16:35:18.522 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.522+0000 7fa766600640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa76015c160 0x7fa760163df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:18.522 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.522+0000 7fa766600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7600737f0 con 0x7fa760152830 2024-04-01T16:35:18.522 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.522+0000 7fa766600640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7600c72d0 con 0x7fa7600c6b30 2024-04-01T16:35:18.522 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.522+0000 7fa766600640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa760152c10 con 0x7fa76015c160 2024-04-01T16:35:18.522 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.523+0000 7fa75f400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fa760152830 0x7fa760072900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:58896/0 (socket says 172.21.15.163:58896) 2024-04-01T16:35:18.523 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.523+0000 7fa75f400640 1 -- 172.21.15.163:0/779913255 learned_addr learned my addr 172.21.15.163:0/779913255 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:35:18.523 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.524+0000 7fa75fe00640 1 --2- 172.21.15.163:0/779913255 >> v2:172.21.15.189:3300/0 conn(0x7fa76015c160 0x7fa760163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:18.525 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.526+0000 7fa75ea00640 1 -- 172.21.15.163:0/779913255 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92608692 0 0) 0x7fa7600737f0 con 0x7fa760152830 2024-04-01T16:35:18.526 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.526+0000 7fa75ea00640 1 -- 172.21.15.163:0/779913255 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa744003520 con 0x7fa760152830 2024-04-01T16:35:18.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.530+0000 7fa75fe00640 1 -- 172.21.15.163:0/779913255 >> v1:172.21.15.189:6789/0 conn(0x7fa7600c6b30 legacy=0x7fa76015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:18.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.530+0000 7fa75fe00640 1 -- 172.21.15.163:0/779913255 >> v1:172.21.15.163:6789/0 conn(0x7fa760152830 legacy=0x7fa760072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:18.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.530+0000 7fa75fe00640 1 -- 172.21.15.163:0/779913255 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7600c75b0 con 0x7fa76015c160 2024-04-01T16:35:18.538 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.539+0000 7fa75fe00640 1 --2- 172.21.15.163:0/779913255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa76015c160 0x7fa760163df0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa758009d90 tx=0x7fa75802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ea87312ef965a5e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:18.547 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.547+0000 7fa75ea00640 1 -- 172.21.15.163:0/779913255 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758039070 con 0x7fa76015c160 2024-04-01T16:35:18.547 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.547+0000 7fa75ea00640 1 -- 172.21.15.163:0/779913255 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75802cd00 con 0x7fa76015c160 2024-04-01T16:35:18.547 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.547+0000 7fa75ea00640 1 -- 172.21.15.163:0/779913255 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758034660 con 0x7fa76015c160 2024-04-01T16:35:18.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.548+0000 7fa766600640 1 -- 172.21.15.163:0/779913255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa76015c160 msgr2=0x7fa760163df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:18.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.548+0000 7fa766600640 1 --2- 172.21.15.163:0/779913255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa76015c160 0x7fa760163df0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa758009d90 tx=0x7fa75802bf50 comp rx=0 tx=0).stop 2024-04-01T16:35:18.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.548+0000 7fa766600640 1 -- 172.21.15.163:0/779913255 shutdown_connections 2024-04-01T16:35:18.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.548+0000 7fa766600640 1 --2- 172.21.15.163:0/779913255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa76015c160 0x7fa760163df0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:18.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.548+0000 7fa766600640 1 -- 172.21.15.163:0/779913255 >> 172.21.15.163:0/779913255 conn(0x7fa7600cbe20 msgr2=0x7fa7600cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:18.548 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.549+0000 7fa766600640 1 -- 172.21.15.163:0/779913255 shutdown_connections 2024-04-01T16:35:18.549 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.549+0000 7fa766600640 1 -- 172.21.15.163:0/779913255 wait complete. 2024-04-01T16:35:18.550 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.551+0000 7fa766600640 1 Processor -- start 2024-04-01T16:35:18.550 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.551+0000 7fa766600640 1 -- start start 2024-04-01T16:35:18.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.552+0000 7fa766600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7600c6b30 0x7fa7601ec5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:18.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.552+0000 7fa766600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa760152830 0x7fa76014ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:18.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.552+0000 7fa766600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa76014e580 0x7fa76014f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:18.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.552+0000 7fa766600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa760073a90 con 0x7fa76014e580 2024-04-01T16:35:18.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.552+0000 7fa766600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7600c7b70 con 0x7fa760152830 2024-04-01T16:35:18.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.552+0000 7fa766600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa7600707f0 con 0x7fa7600c6b30 2024-04-01T16:35:18.552 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.553+0000 7fa75fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa76014e580 0x7fa76014f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:18.553 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.554+0000 7fa75fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa76014e580 0x7fa76014f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37154/0 (socket says 172.21.15.163:37154) 2024-04-01T16:35:18.553 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.554+0000 7fa75fe00640 1 -- 172.21.15.163:0/3758048277 learned_addr learned my addr 172.21.15.163:0/3758048277 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:18.553 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.554+0000 7fa75f400640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7600c6b30 0x7fa7601ec5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:18.554 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.554+0000 7fa756a00640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa760152830 0x7fa76014ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:18.557 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.557+0000 7fa75fe00640 1 -- 172.21.15.163:0/3758048277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7600c6b30 msgr2=0x7fa7601ec5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:18.557 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.557+0000 7fa75fe00640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7600c6b30 0x7fa7601ec5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:18.557 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.558+0000 7fa75fe00640 1 -- 172.21.15.163:0/3758048277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa760152830 msgr2=0x7fa76014ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:18.557 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.558+0000 7fa75fe00640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa760152830 0x7fa76014ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:18.557 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.558+0000 7fa75fe00640 1 -- 172.21.15.163:0/3758048277 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76006fab0 con 0x7fa76014e580 2024-04-01T16:35:18.562 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.562+0000 7fa75fe00640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa76014e580 0x7fa76014f210 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa75802c560 tx=0x7fa758004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:18.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.567+0000 7fa757e00640 1 -- 172.21.15.163:0/3758048277 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758044020 con 0x7fa76014e580 2024-04-01T16:35:18.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.567+0000 7fa757e00640 1 -- 172.21.15.163:0/3758048277 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75803f470 con 0x7fa76014e580 2024-04-01T16:35:18.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.567+0000 7fa757e00640 1 -- 172.21.15.163:0/3758048277 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758039040 con 0x7fa76014e580 2024-04-01T16:35:18.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.567+0000 7fa766600640 1 -- 172.21.15.163:0/3758048277 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76006fd90 con 0x7fa76014e580 2024-04-01T16:35:18.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.567+0000 7fa766600640 1 -- 172.21.15.163:0/3758048277 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa760159620 con 0x7fa76014e580 2024-04-01T16:35:18.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.571+0000 7fa769382740 1 Processor -- start 2024-04-01T16:35:18.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.571+0000 7fa769382740 1 -- start start 2024-04-01T16:35:18.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.572+0000 7fa769382740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccd73f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:18.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.572+0000 7fa769382740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdbd9b0 0x5639ccd74450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:18.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.572+0000 7fa769382740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccd72590 0x5639ccdb3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:18.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.572+0000 7fa769382740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5639ccd35ab0 con 0x5639ccd72590 2024-04-01T16:35:18.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.572+0000 7fa769382740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5639cccd7fa0 con 0x5639ccdbd9b0 2024-04-01T16:35:18.572 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.572+0000 7fa769382740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5639ccc80560 con 0x5639ccd73b30 2024-04-01T16:35:18.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.574+0000 7fa75f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdbd9b0 0x5639ccd74450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:18.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.574+0000 7fa756a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccd73f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:18.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.574+0000 7fa75f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdbd9b0 0x5639ccd74450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:45564/0 (socket says 172.21.15.163:45564) 2024-04-01T16:35:18.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.574+0000 7fa75f400640 1 -- 172.21.15.163:0/3081331749 learned_addr learned my addr 172.21.15.163:0/3081331749 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:18.579 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.579+0000 7fa75f400640 1 -- 172.21.15.163:0/3081331749 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 msgr2=0x5639ccd73f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:18.579 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.579+0000 7fa75f400640 1 --2- 172.21.15.163:0/3081331749 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccd73f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:18.579 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.579+0000 7fa75f400640 1 -- 172.21.15.163:0/3081331749 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccd72590 msgr2=0x5639ccdb3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:18.579 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.579+0000 7fa75f400640 1 --2- 172.21.15.163:0/3081331749 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccd72590 0x5639ccdb3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:18.579 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.579+0000 7fa75f400640 1 -- 172.21.15.163:0/3081331749 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639cc9ec2d0 con 0x5639ccdbd9b0 2024-04-01T16:35:18.584 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.584+0000 7fa75f400640 1 --2- 172.21.15.163:0/3081331749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdbd9b0 0x5639ccd74450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa750001900 tx=0x7fa750000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbcbc17e2cecc9f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:18.588 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.589+0000 7fa757e00640 1 -- 172.21.15.163:0/3758048277 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa758047020 con 0x7fa76014e580 2024-04-01T16:35:18.589 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.590+0000 7fa757e00640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa73c06c940 0x7fa73c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:18.590 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.590+0000 7fa756a00640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa73c06c940 0x7fa73c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:18.590 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.591+0000 7fa756a00640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa73c06c940 0x7fa73c06ee00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa7600c3c50 tx=0x7fa748009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:18.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.593+0000 7fa757e00640 1 -- 172.21.15.163:0/3758048277 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fa75807a2d0 con 0x7fa76014e580 2024-04-01T16:35:18.593 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.594+0000 7fa74fe00640 1 -- 172.21.15.163:0/3081331749 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750005ac0 con 0x5639ccdbd9b0 2024-04-01T16:35:18.593 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.594+0000 7fa74fe00640 1 -- 172.21.15.163:0/3081331749 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa750018070 con 0x5639ccdbd9b0 2024-04-01T16:35:18.593 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.594+0000 7fa74fe00640 1 -- 172.21.15.163:0/3081331749 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75000f870 con 0x5639ccdbd9b0 2024-04-01T16:35:18.594 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.595+0000 7fa769382740 1 -- 172.21.15.163:0/3081331749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdbd9b0 msgr2=0x5639ccd74450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:18.594 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.595+0000 7fa769382740 1 --2- 172.21.15.163:0/3081331749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdbd9b0 0x5639ccd74450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa750001900 tx=0x7fa750000bc0 comp rx=0 tx=0).stop 2024-04-01T16:35:18.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.595+0000 7fa769382740 1 -- 172.21.15.163:0/3081331749 shutdown_connections 2024-04-01T16:35:18.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.595+0000 7fa769382740 1 --2- 172.21.15.163:0/3081331749 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccd72590 0x5639ccdb3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:18.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.595+0000 7fa769382740 1 --2- 172.21.15.163:0/3081331749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdbd9b0 0x5639ccd74450 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:18.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.595+0000 7fa769382740 1 --2- 172.21.15.163:0/3081331749 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccd73f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:18.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.595+0000 7fa769382740 1 -- 172.21.15.163:0/3081331749 >> 172.21.15.163:0/3081331749 conn(0x5639ccd702a0 msgr2=0x5639ccd72be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:18.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.595+0000 7fa769382740 1 -- 172.21.15.163:0/3081331749 shutdown_connections 2024-04-01T16:35:18.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.595+0000 7fa769382740 1 -- 172.21.15.163:0/3081331749 wait complete. 2024-04-01T16:35:18.595 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.596+0000 7fa769382740 1 -- start start 2024-04-01T16:35:18.596 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.596+0000 7fa769382740 1 Processor -- start 2024-04-01T16:35:18.596 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.597+0000 7fa769382740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccd73b30 0x5639ccdb02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:18.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.597+0000 7fa769382740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccdbc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:18.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.597+0000 7fa769382740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccdc7ef0 0x5639ccdb0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:18.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.597+0000 7fa769382740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5639ccc93920 con 0x5639ccdbd9b0 2024-04-01T16:35:18.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.597+0000 7fa769382740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5639cccd3f50 con 0x5639ccd73b30 2024-04-01T16:35:18.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.597+0000 7fa769382740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5639ccd99090 con 0x5639ccdc7ef0 2024-04-01T16:35:18.597 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.597+0000 7fa769382740 10 client.0 _ll_register_callbacks cb 0x5639ccc93310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T16:35:18.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.598+0000 7fa756a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccdbc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:18.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.598+0000 7fa75fe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccdc7ef0 0x5639ccdb0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:18.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.598+0000 7fa756a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccdbc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37186/0 (socket says 172.21.15.163:37186) 2024-04-01T16:35:18.598 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.598+0000 7fa756a00640 1 -- 172.21.15.163:0/2140355938 learned_addr learned my addr 172.21.15.163:0/2140355938 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:18.600 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.601+0000 7fa75f400640 1 --2- 172.21.15.163:0/2140355938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccd73b30 0x5639ccdb02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:18.601 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.601+0000 7fa756a00640 1 -- 172.21.15.163:0/2140355938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccdc7ef0 msgr2=0x5639ccdb0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:18.601 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.601+0000 7fa756a00640 1 --2- 172.21.15.163:0/2140355938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccdc7ef0 0x5639ccdb0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:18.601 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.601+0000 7fa756a00640 1 -- 172.21.15.163:0/2140355938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccd73b30 msgr2=0x5639ccdb02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:18.601 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.601+0000 7fa756a00640 1 --2- 172.21.15.163:0/2140355938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccd73b30 0x5639ccdb02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:18.601 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.601+0000 7fa756a00640 1 -- 172.21.15.163:0/2140355938 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639ccab66b0 con 0x5639ccdbd9b0 2024-04-01T16:35:18.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.604+0000 7fa756a00640 1 --2- 172.21.15.163:0/2140355938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccdbc6e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa748007080 tx=0x7fa748007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7169d961f6aa0a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:18.603 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.604+0000 7fa74cc00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-01T16:35:18.606 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.607+0000 7fa74cc00640 1 -- 172.21.15.163:0/2140355938 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748029060 con 0x5639ccdbd9b0 2024-04-01T16:35:18.607 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.607+0000 7fa74cc00640 1 -- 172.21.15.163:0/2140355938 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fa748024b50 con 0x5639ccdbd9b0 2024-04-01T16:35:18.607 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.607+0000 7fa769382740 1 -- 172.21.15.163:0/2140355938 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa750018070 con 0x5639ccdbd9b0 2024-04-01T16:35:18.609 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.610+0000 7fa74cc00640 1 -- 172.21.15.163:0/2140355938 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fa748010040 con 0x5639ccdbd9b0 2024-04-01T16:35:18.609 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.610+0000 7fa769382740 10 client.4593 fetch_fsmap learned FSMap version 8 2024-04-01T16:35:18.609 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.610+0000 7fa769382740 1 -- 172.21.15.163:0/2140355938 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5639ccdaf4f0 con 0x5639ccdbd9b0 2024-04-01T16:35:18.617 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.617+0000 7fa74cc00640 1 -- 172.21.15.163:0/2140355938 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa750018070 con 0x5639ccdbd9b0 2024-04-01T16:35:18.617 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.617+0000 7fa74cc00640 1 -- 172.21.15.163:0/2140355938 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fa7480246e0 con 0x5639ccdbd9b0 2024-04-01T16:35:18.617 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.618+0000 7fa769382740 10 client.4593 fetch_fsmap finished waiting for FSMap version 8 2024-04-01T16:35:18.617 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.618+0000 7fa769382740 10 client.4593 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-01T16:35:18.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.618+0000 7fa769382740 20 client.4593 populate_metadata read hostname 'smithi163' 2024-04-01T16:35:18.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.618+0000 7fa769382740 1 --2- 172.21.15.163:0/2140355938 >> [v2:172.21.15.189:6833/2672478403,v1:172.21.15.189:6835/2672478403] conn(0x5639ccdd1730 0x5639ccdd3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:18.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.618+0000 7fa769382740 4 client.4593 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T16:35:18.618 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.618+0000 7fa769382740 1 -- 172.21.15.163:0/2140355938 --> [v2:172.21.15.189:6833/2672478403,v1:172.21.15.189:6835/2672478403] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639ccce54e0 con 0x5639ccdd1730 2024-04-01T16:35:18.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.645+0000 7fa75f400640 1 --2- 172.21.15.163:0/2140355938 >> [v2:172.21.15.189:6833/2672478403,v1:172.21.15.189:6835/2672478403] conn(0x5639ccdd1730 0x5639ccdd3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:18.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.788+0000 7fa75f400640 1 --2- 172.21.15.163:0/2140355938 >> [v2:172.21.15.189:6833/2672478403,v1:172.21.15.189:6835/2672478403] conn(0x5639ccdd1730 0x5639ccdd3b20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=745d4dace1b9ba9d server_cookie=81f4902a36797afc in_seq=0 out_seq=0 2024-04-01T16:35:18.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:18.788+0000 7fa74cc00640 10 client.4593 ms_handle_connect on v2:172.21.15.189:6833/2672478403 2024-04-01T16:35:19.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.054+0000 7fa74cc00640 1 -- 172.21.15.163:0/2140355938 <== mds.0 v2:172.21.15.189:6833/2672478403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5639ccce54e0 con 0x5639ccdd1730 2024-04-01T16:35:19.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.054+0000 7fa74cc00640 10 client.4593 handle_command_reply: tid=0 2024-04-01T16:35:19.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.055+0000 7fa769382740 1 client.4593 shutdown 2024-04-01T16:35:19.055 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.055+0000 7fa769382740 1 -- 172.21.15.163:0/2140355938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 msgr2=0x5639ccdbc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:19.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.055+0000 7fa769382740 1 --2- 172.21.15.163:0/2140355938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccdbc6e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa748007080 tx=0x7fa748007e50 comp rx=0 tx=0).stop 2024-04-01T16:35:19.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.055+0000 7fa769382740 1 -- 172.21.15.163:0/2140355938 shutdown_connections 2024-04-01T16:35:19.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.055+0000 7fa769382740 1 --2- 172.21.15.163:0/2140355938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccdc7ef0 0x5639ccdb0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.055+0000 7fa769382740 1 --2- 172.21.15.163:0/2140355938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccdbc6e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.055+0000 7fa769382740 1 --2- 172.21.15.163:0/2140355938 >> [v2:172.21.15.189:6833/2672478403,v1:172.21.15.189:6835/2672478403] conn(0x5639ccdd1730 0x5639ccdd3b20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.055+0000 7fa769382740 1 --2- 172.21.15.163:0/2140355938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccd73b30 0x5639ccdb02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.055+0000 7fa769382740 1 -- 172.21.15.163:0/2140355938 >> 172.21.15.163:0/2140355938 conn(0x5639ccd72590 msgr2=0x5639ccd73f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:19.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.055+0000 7fa74cc00640 0 client.4593 ms_handle_reset on v2:172.21.15.189:6833/2672478403 2024-04-01T16:35:19.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.056+0000 7fa769382740 1 -- 172.21.15.163:0/2140355938 shutdown_connections 2024-04-01T16:35:19.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.056+0000 7fa769382740 1 -- 172.21.15.163:0/2140355938 wait complete. 2024-04-01T16:35:19.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.056+0000 7fa769382740 20 client.4593 trim_cache size 0 max 16384 2024-04-01T16:35:19.110 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.110+0000 7fa769382740 1 Processor -- start 2024-04-01T16:35:19.110 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.111+0000 7fa769382740 1 -- start start 2024-04-01T16:35:19.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.112+0000 7fa769382740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccdb1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.113+0000 7fa769382740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccd6cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.113+0000 7fa769382740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdc7ef0 0x5639ccd6d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.113+0000 7fa769382740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa7601f78e0 con 0x5639ccdbd9b0 2024-04-01T16:35:19.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.113+0000 7fa769382740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5639ccdaf890 con 0x5639ccdc7ef0 2024-04-01T16:35:19.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.113+0000 7fa769382740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5639ccdb5090 con 0x5639ccd73b30 2024-04-01T16:35:19.114 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.115+0000 7fa75f400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccdb1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:19.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.116+0000 7fa75fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdc7ef0 0x5639ccd6d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:19.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.116+0000 7fa75f400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccdb1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:47022/0 (socket says 172.21.15.163:47022) 2024-04-01T16:35:19.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.116+0000 7fa75f400640 1 -- 172.21.15.163:0/3459404235 learned_addr learned my addr 172.21.15.163:0/3459404235 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:19.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.123+0000 7fa75fe00640 1 -- 172.21.15.163:0/3459404235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 msgr2=0x5639ccdb1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:19.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.123+0000 7fa75fe00640 1 --2- 172.21.15.163:0/3459404235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccdb1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.123+0000 7fa75fe00640 1 -- 172.21.15.163:0/3459404235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 msgr2=0x5639ccd6cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:19.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.123+0000 7fa75fe00640 1 --2- 172.21.15.163:0/3459404235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccd6cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.123+0000 7fa75fe00640 1 -- 172.21.15.163:0/3459404235 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ccd970f0 con 0x5639ccdc7ef0 2024-04-01T16:35:19.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.123+0000 7fa75f400640 1 --2- 172.21.15.163:0/3459404235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccdb1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T16:35:19.132 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.133+0000 7fa75fe00640 1 --2- 172.21.15.163:0/3459404235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdc7ef0 0x5639ccd6d3e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa7580ac9e0 tx=0x7fa7580ac8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aee6ce38aa41466d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:19.234 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.235+0000 7fa74f400640 1 -- 172.21.15.163:0/3459404235 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758094070 con 0x5639ccdc7ef0 2024-04-01T16:35:19.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.249+0000 7fa74f400640 1 -- 172.21.15.163:0/3459404235 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa758084df0 con 0x5639ccdc7ef0 2024-04-01T16:35:19.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.249+0000 7fa74f400640 1 -- 172.21.15.163:0/3459404235 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580802b0 con 0x5639ccdc7ef0 2024-04-01T16:35:19.250 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.250+0000 7fa769382740 1 -- 172.21.15.163:0/3459404235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdc7ef0 msgr2=0x5639ccd6d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:19.250 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.250+0000 7fa769382740 1 --2- 172.21.15.163:0/3459404235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdc7ef0 0x5639ccd6d3e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa7580ac9e0 tx=0x7fa7580ac8e0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.250 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.251+0000 7fa769382740 1 -- 172.21.15.163:0/3459404235 shutdown_connections 2024-04-01T16:35:19.250 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.251+0000 7fa769382740 1 --2- 172.21.15.163:0/3459404235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdc7ef0 0x5639ccd6d3e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.251+0000 7fa769382740 1 --2- 172.21.15.163:0/3459404235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccd6cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.251+0000 7fa769382740 1 --2- 172.21.15.163:0/3459404235 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccdb1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.251+0000 7fa769382740 1 -- 172.21.15.163:0/3459404235 >> 172.21.15.163:0/3459404235 conn(0x5639ccd72590 msgr2=0x5639ccd72aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:19.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.251+0000 7fa769382740 1 -- 172.21.15.163:0/3459404235 shutdown_connections 2024-04-01T16:35:19.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.251+0000 7fa769382740 1 -- 172.21.15.163:0/3459404235 wait complete. 2024-04-01T16:35:19.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.252+0000 7fa769382740 1 -- start start 2024-04-01T16:35:19.252 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.252+0000 7fa769382740 1 Processor -- start 2024-04-01T16:35:19.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.254+0000 7fa769382740 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccd9d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.253 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.254+0000 7fa769382740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccd6df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.254+0000 7fa769382740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdc7ef0 0x5639cce29430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.254+0000 7fa769382740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5639ccdb1a30 con 0x5639ccdbd9b0 2024-04-01T16:35:19.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.254+0000 7fa769382740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5639ccdb8c70 con 0x5639ccdc7ef0 2024-04-01T16:35:19.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.254+0000 7fa769382740 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x5639ccd972c0 con 0x5639ccd73b30 2024-04-01T16:35:19.254 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.254+0000 7fa769382740 10 client.0 _ll_register_callbacks cb 0x7fa748012ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T16:35:19.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.255+0000 7fa75f400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccd9d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:19.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.257+0000 7fa75f400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccd9d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:47034/0 (socket says 172.21.15.163:47034) 2024-04-01T16:35:19.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.257+0000 7fa75f400640 1 -- 172.21.15.163:0/694112847 learned_addr learned my addr 172.21.15.163:0/694112847 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:19.258 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.257+0000 7fa75fe00640 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdc7ef0 0x5639cce29430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:19.258 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.258+0000 7fa756a00640 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccd6df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:19.263 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.263+0000 7fa756a00640 1 -- 172.21.15.163:0/694112847 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 msgr2=0x5639ccd9d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:19.263 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.263+0000 7fa756a00640 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccd9d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.263 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.263+0000 7fa756a00640 1 -- 172.21.15.163:0/694112847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdc7ef0 msgr2=0x5639cce29430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:19.263 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.263+0000 7fa756a00640 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdc7ef0 0x5639cce29430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.263 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.263+0000 7fa756a00640 1 -- 172.21.15.163:0/694112847 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639ccd96c70 con 0x5639ccdbd9b0 2024-04-01T16:35:19.266 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.267+0000 7fa756a00640 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccd6df90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5639ccdaef90 tx=0x7fa748017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc214cffec2e38a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:19.266 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.267+0000 7fa74cc00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-01T16:35:19.271 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.272+0000 7fa74cc00640 1 -- 172.21.15.163:0/694112847 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74803c060 con 0x5639ccdbd9b0 2024-04-01T16:35:19.271 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.272+0000 7fa74cc00640 1 -- 172.21.15.163:0/694112847 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fa748006c20 con 0x5639ccdbd9b0 2024-04-01T16:35:19.271 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.272+0000 7fa769382740 1 -- 172.21.15.163:0/694112847 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa758084df0 con 0x5639ccdbd9b0 2024-04-01T16:35:19.274 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.275+0000 7fa74cc00640 1 -- 172.21.15.163:0/694112847 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fa748024af0 con 0x5639ccdbd9b0 2024-04-01T16:35:19.274 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.275+0000 7fa769382740 10 client.4596 fetch_fsmap learned FSMap version 8 2024-04-01T16:35:19.275 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.275+0000 7fa769382740 1 -- 172.21.15.163:0/694112847 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5639ccd733a0 con 0x5639ccdbd9b0 2024-04-01T16:35:19.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.282+0000 7fa74cc00640 1 -- 172.21.15.163:0/694112847 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa758084df0 con 0x5639ccdbd9b0 2024-04-01T16:35:19.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.282+0000 7fa74cc00640 1 -- 172.21.15.163:0/694112847 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fa748016480 con 0x5639ccdbd9b0 2024-04-01T16:35:19.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.282+0000 7fa769382740 10 client.4596 fetch_fsmap finished waiting for FSMap version 8 2024-04-01T16:35:19.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.282+0000 7fa769382740 10 client.4596 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-01T16:35:19.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.282+0000 7fa769382740 20 client.4596 populate_metadata read hostname 'smithi163' 2024-04-01T16:35:19.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.282+0000 7fa769382740 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.189:6833/2672478403,v1:172.21.15.189:6835/2672478403] conn(0x5639ccdb4510 0x5639cce3be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.282+0000 7fa769382740 4 client.4596 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-01T16:35:19.283 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.282+0000 7fa769382740 1 -- 172.21.15.163:0/694112847 --> [v2:172.21.15.189:6833/2672478403,v1:172.21.15.189:6835/2672478403] -- command(tid 0: {"prefix": "status"}) -- 0x5639cccdf830 con 0x5639ccdb4510 2024-04-01T16:35:19.284 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.285+0000 7fa75f400640 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.189:6833/2672478403,v1:172.21.15.189:6835/2672478403] conn(0x5639ccdb4510 0x5639cce3be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:19.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.292+0000 7fa75f400640 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.189:6833/2672478403,v1:172.21.15.189:6835/2672478403] conn(0x5639ccdb4510 0x5639cce3be40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6f033f14c066126 server_cookie=fbe52fcf97bb16a5 in_seq=0 out_seq=0 2024-04-01T16:35:19.291 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.292+0000 7fa74cc00640 10 client.4596 ms_handle_connect on v2:172.21.15.189:6833/2672478403 2024-04-01T16:35:19.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.327+0000 7fa74cc00640 1 -- 172.21.15.163:0/694112847 <== mds.0 v2:172.21.15.189:6833/2672478403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5639cccdf830 con 0x5639ccdb4510 2024-04-01T16:35:19.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.327+0000 7fa74cc00640 10 client.4596 handle_command_reply: tid=0 2024-04-01T16:35:19.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.327+0000 7fa769382740 1 client.4596 shutdown 2024-04-01T16:35:19.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.327+0000 7fa769382740 1 -- 172.21.15.163:0/694112847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 msgr2=0x5639ccd6df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:19.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.327+0000 7fa769382740 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccd6df90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5639ccdaef90 tx=0x7fa748017000 comp rx=0 tx=0).stop 2024-04-01T16:35:19.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.327+0000 7fa769382740 1 -- 172.21.15.163:0/694112847 shutdown_connections 2024-04-01T16:35:19.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.327+0000 7fa769382740 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.189:6833/2672478403,v1:172.21.15.189:6835/2672478403] conn(0x5639ccdb4510 0x5639cce3be40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.327+0000 7fa769382740 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5639ccdc7ef0 0x5639cce29430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.327+0000 7fa769382740 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5639ccdbd9b0 0x5639ccd6df90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.327+0000 7fa769382740 1 --2- 172.21.15.163:0/694112847 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x5639ccd73b30 0x5639ccd9d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.328+0000 7fa74cc00640 0 client.4596 ms_handle_reset on v2:172.21.15.189:6833/2672478403 2024-04-01T16:35:19.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.328+0000 7fa769382740 1 -- 172.21.15.163:0/694112847 >> 172.21.15.163:0/694112847 conn(0x5639ccd72590 msgr2=0x5639ccdc84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:19.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.328+0000 7fa769382740 1 -- 172.21.15.163:0/694112847 shutdown_connections 2024-04-01T16:35:19.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.328+0000 7fa769382740 1 -- 172.21.15.163:0/694112847 wait complete. 2024-04-01T16:35:19.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.328+0000 7fa769382740 20 client.4596 trim_cache size 0 max 16384 2024-04-01T16:35:19.329 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-01T16:35:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "cluster_fsid": "0870cdfa-3f81-4bb7-98e8-9588fec4cf05", 2024-04-01T16:35:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "whoami": 0, 2024-04-01T16:35:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 4270, 2024-04-01T16:35:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "want_state": "up:active", 2024-04-01T16:35:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "state": "up:active", 2024-04-01T16:35:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs", 2024-04-01T16:35:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "rank_uptime": 44.064080523999998, 2024-04-01T16:35:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "mdsmap_epoch": 8, 2024-04-01T16:35:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch": 27, 2024-04-01T16:35:19.330 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch_barrier": 25, 2024-04-01T16:35:19.330 INFO:teuthology.orchestra.run.smithi163.stdout: "uptime": 58.048569374000003 2024-04-01T16:35:19.330 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-01T16:35:19.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.330+0000 7fa766600640 1 -- 172.21.15.163:0/3758048277 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa73c06c940 msgr2=0x7fa73c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:19.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.330+0000 7fa766600640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa73c06c940 0x7fa73c06ee00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa7600c3c50 tx=0x7fa748009040 comp rx=0 tx=0).stop 2024-04-01T16:35:19.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.330+0000 7fa766600640 1 -- 172.21.15.163:0/3758048277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa76014e580 msgr2=0x7fa76014f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:19.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.330+0000 7fa766600640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa76014e580 0x7fa76014f210 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa75802c560 tx=0x7fa758004a40 comp rx=0 tx=0).stop 2024-04-01T16:35:19.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.330+0000 7fa766600640 1 -- 172.21.15.163:0/3758048277 shutdown_connections 2024-04-01T16:35:19.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.330+0000 7fa766600640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa73c06c940 0x7fa73c06ee00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.330+0000 7fa766600640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa76014e580 0x7fa76014f210 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.330+0000 7fa766600640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa760152830 0x7fa76014ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.330+0000 7fa766600640 1 --2- 172.21.15.163:0/3758048277 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa7600c6b30 0x7fa7601ec5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.330+0000 7fa766600640 1 -- 172.21.15.163:0/3758048277 >> 172.21.15.163:0/3758048277 conn(0x7fa7600cbe20 msgr2=0x7fa7601e19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:19.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.330+0000 7fa766600640 1 -- 172.21.15.163:0/3758048277 shutdown_connections 2024-04-01T16:35:19.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.330+0000 7fa766600640 1 -- 172.21.15.163:0/3758048277 wait complete. 2024-04-01T16:35:19.359 INFO:teuthology.run_tasks:Running task sequential... 2024-04-01T16:35:19.369 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-01T16:35:19.369 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-01T16:35:19.370 INFO:teuthology.task.print:Enabling mgr modules 2024-04-01T16:35:19.370 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-01T16:35:19.526 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-01T16:35:19.526 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-01T16:35:19.526 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-04-01T16:35:19.527 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-01T16:35:19.527 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-01T16:35:19.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:19.527 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-04-01T16:35:19.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:19.584 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2024-04-01T16:35:19.684 INFO:teuthology.orchestra.run.smithi163.stderr:Cannot find device "ceph-brx" 2024-04-01T16:35:19.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T16:35:19.689 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-01T16:35:19.689 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-01T16:35:19.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.901+0000 7f262fa00640 1 Processor -- start 2024-04-01T16:35:19.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.902+0000 7f262fa00640 1 -- start start 2024-04-01T16:35:19.902 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.903+0000 7f262fa00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2628152a10 0x7f262806eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.903+0000 7f262fa00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f26280c4800 0x7f2628158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.903+0000 7f262fa00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26280c7620 con 0x7f2628158bb0 2024-04-01T16:35:19.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.903+0000 7f262fa00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f2628152df0 con 0x7f26280c4800 2024-04-01T16:35:19.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.903+0000 7f262fa00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f262806ead0 con 0x7f2628152a10 2024-04-01T16:35:19.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.904+0000 7f261fe00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f26280c4800 0x7f2628158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:19.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.904+0000 7f262da00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f2628158bb0 0x7f262815bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:58910/0 (socket says 172.21.15.163:58910) 2024-04-01T16:35:19.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.904+0000 7f262da00640 1 -- 172.21.15.163:0/3047319574 learned_addr learned my addr 172.21.15.163:0/3047319574 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T16:35:19.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.905+0000 7f262d000640 1 --2- 172.21.15.163:0/3047319574 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2628152a10 0x7f262806eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:19.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.907+0000 7f261fe00640 1 -- 172.21.15.163:0/3047319574 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2628152a10 msgr2=0x7f262806eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T16:35:19.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.907+0000 7f261fe00640 1 --2- 172.21.15.163:0/3047319574 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2628152a10 0x7f262806eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.907+0000 7f261fe00640 1 -- 172.21.15.163:0/3047319574 >> v1:172.21.15.163:6789/0 conn(0x7f2628158bb0 legacy=0x7f262815bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:19.906 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.907+0000 7f261fe00640 1 -- 172.21.15.163:0/3047319574 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26280c7890 con 0x7f26280c4800 2024-04-01T16:35:19.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.909+0000 7f261fe00640 1 --2- 172.21.15.163:0/3047319574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26280c4800 0x7f2628158670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f26100097a0 tx=0x7f261002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dfef745843e67c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:19.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.919+0000 7f2627e00640 1 -- 172.21.15.163:0/3047319574 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610035020 con 0x7f26280c4800 2024-04-01T16:35:19.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.919+0000 7f2627e00640 1 -- 172.21.15.163:0/3047319574 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2610031810 con 0x7f26280c4800 2024-04-01T16:35:19.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.919+0000 7f2627e00640 1 -- 172.21.15.163:0/3047319574 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610031be0 con 0x7f26280c4800 2024-04-01T16:35:19.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.920+0000 7f262fa00640 1 -- 172.21.15.163:0/3047319574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26280c4800 msgr2=0x7f2628158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:19.919 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.920+0000 7f262fa00640 1 --2- 172.21.15.163:0/3047319574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26280c4800 0x7f2628158670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f26100097a0 tx=0x7f261002b8b0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.920 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.920+0000 7f262fa00640 1 -- 172.21.15.163:0/3047319574 shutdown_connections 2024-04-01T16:35:19.920 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.920+0000 7f262fa00640 1 --2- 172.21.15.163:0/3047319574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26280c4800 0x7f2628158670 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.920 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.920+0000 7f262fa00640 1 --2- 172.21.15.163:0/3047319574 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2628152a10 0x7f262806eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.920 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.920+0000 7f262fa00640 1 -- 172.21.15.163:0/3047319574 >> 172.21.15.163:0/3047319574 conn(0x7f26280c8a00 msgr2=0x7f26280c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:19.920 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.920+0000 7f262fa00640 1 -- 172.21.15.163:0/3047319574 shutdown_connections 2024-04-01T16:35:19.920 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.920+0000 7f262fa00640 1 -- 172.21.15.163:0/3047319574 wait complete. 2024-04-01T16:35:19.921 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.922+0000 7f262fa00640 1 Processor -- start 2024-04-01T16:35:19.922 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.922+0000 7f262fa00640 1 -- start start 2024-04-01T16:35:19.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.923+0000 7f262fa00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26280c4800 0x7f26281434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.923+0000 7f262fa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2628152a10 0x7f262814f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.923+0000 7f262fa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2628158bb0 0x7f262814f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.923+0000 7f262fa00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f26280c8130 con 0x7f2628158bb0 2024-04-01T16:35:19.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.923+0000 7f262fa00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f26280c7e50 con 0x7f2628152a10 2024-04-01T16:35:19.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.923+0000 7f262fa00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f262806e6b0 con 0x7f26280c4800 2024-04-01T16:35:19.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.924+0000 7f262da00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2628158bb0 0x7f262814f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:19.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.925+0000 7f262da00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2628158bb0 0x7f262814f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37224/0 (socket says 172.21.15.163:37224) 2024-04-01T16:35:19.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.925+0000 7f262da00640 1 -- 172.21.15.163:0/4219863119 learned_addr learned my addr 172.21.15.163:0/4219863119 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T16:35:19.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.925+0000 7f261fe00640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2628152a10 0x7f262814f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:19.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.925+0000 7f262d000640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26280c4800 0x7f26281434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:19.928 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.929+0000 7f262da00640 1 -- 172.21.15.163:0/4219863119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26280c4800 msgr2=0x7f26281434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:19.928 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.929+0000 7f262da00640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26280c4800 0x7f26281434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.929+0000 7f262da00640 1 -- 172.21.15.163:0/4219863119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2628152a10 msgr2=0x7f262814f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:19.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.929+0000 7f262da00640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2628152a10 0x7f262814f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:19.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.929+0000 7f262da00640 1 -- 172.21.15.163:0/4219863119 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2628156b80 con 0x7f2628158bb0 2024-04-01T16:35:19.931 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.932+0000 7f262da00640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2628158bb0 0x7f262814f7d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f262000ca80 tx=0x7f262000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:19.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.936+0000 7f2625600640 1 -- 172.21.15.163:0/4219863119 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620017070 con 0x7f2628158bb0 2024-04-01T16:35:19.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.937+0000 7f2625600640 1 -- 172.21.15.163:0/4219863119 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262000ac30 con 0x7f2628158bb0 2024-04-01T16:35:19.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.937+0000 7f2625600640 1 -- 172.21.15.163:0/4219863119 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620012600 con 0x7f2628158bb0 2024-04-01T16:35:19.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.937+0000 7f262fa00640 1 -- 172.21.15.163:0/4219863119 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2628149e70 con 0x7f2628158bb0 2024-04-01T16:35:19.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.937+0000 7f262fa00640 1 -- 172.21.15.163:0/4219863119 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f262814a430 con 0x7f2628158bb0 2024-04-01T16:35:19.937 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.938+0000 7f262fa00640 1 -- 172.21.15.163:0/4219863119 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26280ca6a0 con 0x7f2628158bb0 2024-04-01T16:35:19.961 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.962+0000 7f2625600640 1 -- 172.21.15.163:0/4219863119 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f262001a070 con 0x7f2628158bb0 2024-04-01T16:35:19.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.963+0000 7f2625600640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f260406c940 0x7f260406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T16:35:19.962 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.963+0000 7f262d000640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f260406c940 0x7f260406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T16:35:19.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:19.964+0000 7f262d000640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f260406c940 0x7f260406ee00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2618006fd0 tx=0x7f2618008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T16:35:20.286 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.286+0000 7f2625600640 1 -- 172.21.15.163:0/4219863119 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f2620057b70 con 0x7f2628158bb0 2024-04-01T16:35:20.286 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.287+0000 7f2625600640 1 -- 172.21.15.163:0/4219863119 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f26280ca6a0 con 0x7f2628158bb0 2024-04-01T16:35:20.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.544+0000 7f262fa00640 1 -- 172.21.15.163:0/4219863119 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f26280756d0 con 0x7f2628158bb0 2024-04-01T16:35:20.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.561+0000 7f2625600640 1 -- 172.21.15.163:0/4219863119 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f262000ae20 con 0x7f2628158bb0 2024-04-01T16:35:20.561 INFO:teuthology.orchestra.run.smithi163.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-01T16:35:20.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.564+0000 7f262fa00640 1 -- 172.21.15.163:0/4219863119 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f260406c940 msgr2=0x7f260406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:20.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.564+0000 7f262fa00640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f260406c940 0x7f260406ee00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2618006fd0 tx=0x7f2618008040 comp rx=0 tx=0).stop 2024-04-01T16:35:20.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.564+0000 7f262fa00640 1 -- 172.21.15.163:0/4219863119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2628158bb0 msgr2=0x7f262814f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T16:35:20.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.564+0000 7f262fa00640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2628158bb0 0x7f262814f7d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f262000ca80 tx=0x7f262000cf40 comp rx=0 tx=0).stop 2024-04-01T16:35:20.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.564+0000 7f262fa00640 1 -- 172.21.15.163:0/4219863119 shutdown_connections 2024-04-01T16:35:20.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.564+0000 7f262fa00640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f260406c940 0x7f260406ee00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:20.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.564+0000 7f262fa00640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2628158bb0 0x7f262814f7d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:20.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.564+0000 7f262fa00640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2628152a10 0x7f262814f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:20.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.564+0000 7f262fa00640 1 --2- 172.21.15.163:0/4219863119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f26280c4800 0x7f26281434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T16:35:20.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.564+0000 7f262fa00640 1 -- 172.21.15.163:0/4219863119 >> 172.21.15.163:0/4219863119 conn(0x7f26280c8a00 msgr2=0x7f2628151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T16:35:20.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.564+0000 7f262fa00640 1 -- 172.21.15.163:0/4219863119 shutdown_connections 2024-04-01T16:35:20.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20.564+0000 7f262fa00640 1 -- 172.21.15.163:0/4219863119 wait complete. 2024-04-01T16:35:20.584 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-01T16:35:20.584 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-01T16:35:20.584 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi163.front.sepia.ceph.com 2024-04-01T16:35:20.584 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-01T16:35:20.584 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-01T16:35:20.585 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-01T16:35:20.585 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-01T16:35:20.585 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-01T16:35:20.585 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-01T16:35:20.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:20.585 DEBUG:teuthology.orchestra.run.smithi163:> ip addr 2024-04-01T16:35:20.633 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-01T16:35:20.633 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-01T16:35:20.633 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2024-04-01T16:35:20.633 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-04-01T16:35:20.633 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2024-04-01T16:35:20.633 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-04-01T16:35:20.634 INFO:teuthology.orchestra.run.smithi163.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-01T16:35:20.634 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:06 brd ff:ff:ff:ff:ff:ff 2024-04-01T16:35:20.634 INFO:teuthology.orchestra.run.smithi163.stdout: altname enp7s0f0 2024-04-01T16:35:20.634 INFO:teuthology.orchestra.run.smithi163.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-01T16:35:20.634 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:07 brd ff:ff:ff:ff:ff:ff 2024-04-01T16:35:20.634 INFO:teuthology.orchestra.run.smithi163.stdout: altname enp7s0f1 2024-04-01T16:35:20.634 INFO:teuthology.orchestra.run.smithi163.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-01T16:35:20.634 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5a brd ff:ff:ff:ff:ff:ff 2024-04-01T16:35:20.634 INFO:teuthology.orchestra.run.smithi163.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-01T16:35:20.634 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5b brd ff:ff:ff:ff:ff:ff 2024-04-01T16:35:20.635 INFO:teuthology.orchestra.run.smithi163.stdout: inet 172.21.15.163/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-01T16:35:20.635 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft 42002sec preferred_lft 42002sec 2024-04-01T16:35:20.635 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::ec4:7aff:fe88:7d5b/64 scope link 2024-04-01T16:35:20.635 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-04-01T16:35:20.636 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-01T16:35:20.636 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T16:35:20.636 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-04-01T16:35:20.636 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add name ceph-brx type bridge 2024-04-01T16:35:20.636 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr flush dev ceph-brx 2024-04-01T16:35:20.636 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set ceph-brx up 2024-04-01T16:35:20.636 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-01T16:35:20.636 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-04-01T16:35:20.736 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T16:35:21.134 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T16:35:21.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:21.144 DEBUG:teuthology.orchestra.run.smithi163:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-01T16:35:21.224 INFO:teuthology.orchestra.run.smithi163.stdout:1 2024-04-01T16:35:21.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:21.227 DEBUG:teuthology.orchestra.run.smithi163:> route 2024-04-01T16:35:21.281 INFO:teuthology.orchestra.run.smithi163.stdout:Kernel IP routing table 2024-04-01T16:35:21.281 INFO:teuthology.orchestra.run.smithi163.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-01T16:35:21.281 INFO:teuthology.orchestra.run.smithi163.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-01T16:35:21.282 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-01T16:35:21.282 INFO:teuthology.orchestra.run.smithi163.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-01T16:35:21.282 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T16:35:21.282 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-04-01T16:35:21.282 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-01T16:35:21.282 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-01T16:35:21.282 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-01T16:35:21.282 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-04-01T16:35:21.381 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T16:35:21.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T16:35:21.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:21.999 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-04-01T16:35:22.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:22.053 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list-id 2024-04-01T16:35:22.107 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T16:35:22.107 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-04-01T16:35:22.107 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:22.107 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-01T16:35:22.107 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-04-01T16:35:22.207 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T16:35:22.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T16:35:22.305 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-01T16:35:22.305 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T16:35:22.305 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-04-01T16:35:22.305 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-01T16:35:22.305 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-01T16:35:22.305 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-01T16:35:22.305 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-01T16:35:22.305 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-01T16:35:22.306 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-04-01T16:35:22.408 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T16:35:22.633 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T16:35:22.643 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T16:35:22.643 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-04-01T16:35:22.643 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set brx.0 up 2024-04-01T16:35:22.643 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set dev brx.0 master ceph-brx 2024-04-01T16:35:22.644 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-04-01T16:35:22.746 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T16:35:22.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T16:35:22.871 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-04-01T16:35:22.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-01T16:35:22.871 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-01T16:35:22.919 INFO:teuthology.orchestra.run.smithi163.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-01T16:35:22.919 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-01T16:35:22.919 DEBUG:teuthology.orchestra.run.smithi163:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-01T16:35:22.965 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-01T16:35:22.965 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2024-04-01T16:35:23.104 DEBUG:teuthology.orchestra.run.smithi163:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T16:35:23.156 INFO:teuthology.orchestra.run.smithi163.stdout:/proc 2024-04-01T16:35:23.156 INFO:teuthology.orchestra.run.smithi163.stdout:/sys 2024-04-01T16:35:23.156 INFO:teuthology.orchestra.run.smithi163.stdout:/dev 2024-04-01T16:35:23.156 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/security 2024-04-01T16:35:23.156 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/shm 2024-04-01T16:35:23.156 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/pts 2024-04-01T16:35:23.156 INFO:teuthology.orchestra.run.smithi163.stdout:/run 2024-04-01T16:35:23.156 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup 2024-04-01T16:35:23.156 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/pstore 2024-04-01T16:35:23.156 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/bpf 2024-04-01T16:35:23.156 INFO:teuthology.orchestra.run.smithi163.stdout:/ 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/selinux 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/mqueue 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/hugepages 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/debug 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/tracing 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/fuse/connections 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/config 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/run/user/1000 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph 2024-04-01T16:35:23.157 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T16:35:23.158 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T16:35:23.158 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T16:35:23.158 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T16:35:23.158 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns 2024-04-01T16:35:23.158 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:23.158 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:23.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:23.159 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2024-04-01T16:35:23.207 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-01T16:35:23.207 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-01T16:35:23.211 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2024-04-01T16:35:23.282 DEBUG:teuthology.orchestra.run.smithi163:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T16:35:23.330 INFO:teuthology.orchestra.run.smithi163.stdout:/proc 2024-04-01T16:35:23.330 INFO:teuthology.orchestra.run.smithi163.stdout:/sys 2024-04-01T16:35:23.330 INFO:teuthology.orchestra.run.smithi163.stdout:/dev 2024-04-01T16:35:23.330 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/security 2024-04-01T16:35:23.330 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/shm 2024-04-01T16:35:23.330 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/pts 2024-04-01T16:35:23.330 INFO:teuthology.orchestra.run.smithi163.stdout:/run 2024-04-01T16:35:23.330 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup 2024-04-01T16:35:23.330 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/pstore 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/bpf 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/ 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/selinux 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/mqueue 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/hugepages 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/debug 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/tracing 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/fuse/connections 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/config 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/run/user/1000 2024-04-01T16:35:23.331 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph 2024-04-01T16:35:23.332 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T16:35:23.332 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T16:35:23.332 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T16:35:23.332 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T16:35:23.332 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns 2024-04-01T16:35:23.332 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:23.332 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:23.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:23.333 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2024-04-01T16:35:24.480 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2024-04-01T16:35:24.569 DEBUG:teuthology.orchestra.run.smithi163:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T16:35:24.617 INFO:teuthology.orchestra.run.smithi163.stdout:/proc 2024-04-01T16:35:24.617 INFO:teuthology.orchestra.run.smithi163.stdout:/sys 2024-04-01T16:35:24.617 INFO:teuthology.orchestra.run.smithi163.stdout:/dev 2024-04-01T16:35:24.617 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/security 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/shm 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/pts 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/run 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/pstore 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/bpf 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/ 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/selinux 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/mqueue 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/hugepages 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/debug 2024-04-01T16:35:24.618 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/tracing 2024-04-01T16:35:24.619 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/fuse/connections 2024-04-01T16:35:24.619 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/config 2024-04-01T16:35:24.619 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T16:35:24.619 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T16:35:24.619 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T16:35:24.619 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T16:35:24.619 INFO:teuthology.orchestra.run.smithi163.stdout:/run/user/1000 2024-04-01T16:35:24.619 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph 2024-04-01T16:35:24.619 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T16:35:24.619 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T16:35:24.619 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T16:35:24.619 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T16:35:24.620 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns 2024-04-01T16:35:24.620 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:24.620 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:24.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:24.621 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2024-04-01T16:35:25.768 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2024-04-01T16:35:25.847 DEBUG:teuthology.orchestra.run.smithi163:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T16:35:25.897 INFO:teuthology.orchestra.run.smithi163.stdout:/proc 2024-04-01T16:35:25.897 INFO:teuthology.orchestra.run.smithi163.stdout:/sys 2024-04-01T16:35:25.897 INFO:teuthology.orchestra.run.smithi163.stdout:/dev 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/security 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/shm 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/pts 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/run 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/pstore 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/bpf 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/ 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/selinux 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/mqueue 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/hugepages 2024-04-01T16:35:25.898 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/debug 2024-04-01T16:35:25.899 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/tracing 2024-04-01T16:35:25.899 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/fuse/connections 2024-04-01T16:35:25.899 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/config 2024-04-01T16:35:25.899 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T16:35:25.899 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T16:35:25.899 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T16:35:25.899 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T16:35:25.899 INFO:teuthology.orchestra.run.smithi163.stdout:/run/user/1000 2024-04-01T16:35:25.899 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph 2024-04-01T16:35:25.899 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T16:35:25.899 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T16:35:25.900 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T16:35:25.900 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T16:35:25.900 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns 2024-04-01T16:35:25.900 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:25.900 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:25.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:25.901 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2024-04-01T16:35:27.045 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2024-04-01T16:35:27.129 DEBUG:teuthology.orchestra.run.smithi163:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T16:35:27.174 INFO:teuthology.orchestra.run.smithi163.stdout:/proc 2024-04-01T16:35:27.174 INFO:teuthology.orchestra.run.smithi163.stdout:/sys 2024-04-01T16:35:27.174 INFO:teuthology.orchestra.run.smithi163.stdout:/dev 2024-04-01T16:35:27.174 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/security 2024-04-01T16:35:27.174 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/shm 2024-04-01T16:35:27.174 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/pts 2024-04-01T16:35:27.174 INFO:teuthology.orchestra.run.smithi163.stdout:/run 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/pstore 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/bpf 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/ 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/selinux 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/mqueue 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/hugepages 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/debug 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/tracing 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/fuse/connections 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/config 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T16:35:27.175 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T16:35:27.176 INFO:teuthology.orchestra.run.smithi163.stdout:/run/user/1000 2024-04-01T16:35:27.176 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph 2024-04-01T16:35:27.176 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T16:35:27.176 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T16:35:27.176 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T16:35:27.176 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T16:35:27.176 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns 2024-04-01T16:35:27.176 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:27.176 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:27.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:27.177 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2024-04-01T16:35:28.365 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2024-04-01T16:35:28.449 DEBUG:teuthology.orchestra.run.smithi163:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T16:35:28.494 INFO:teuthology.orchestra.run.smithi163.stdout:/proc 2024-04-01T16:35:28.494 INFO:teuthology.orchestra.run.smithi163.stdout:/sys 2024-04-01T16:35:28.494 INFO:teuthology.orchestra.run.smithi163.stdout:/dev 2024-04-01T16:35:28.494 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/security 2024-04-01T16:35:28.494 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/shm 2024-04-01T16:35:28.494 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/pts 2024-04-01T16:35:28.494 INFO:teuthology.orchestra.run.smithi163.stdout:/run 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/pstore 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/bpf 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/ 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/selinux 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/mqueue 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/hugepages 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/debug 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/tracing 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/fuse/connections 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/config 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T16:35:28.495 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T16:35:28.496 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T16:35:28.496 INFO:teuthology.orchestra.run.smithi163.stdout:/run/user/1000 2024-04-01T16:35:28.496 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph 2024-04-01T16:35:28.496 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T16:35:28.496 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T16:35:28.496 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T16:35:28.496 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T16:35:28.496 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns 2024-04-01T16:35:28.496 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:28.497 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:28.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:28.498 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2024-04-01T16:35:29.688 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2024-04-01T16:35:29.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:ceph-fuse[45195]: starting ceph client 2024-04-01T16:35:29.765 DEBUG:teuthology.orchestra.run.smithi163:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T16:35:29.820 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:2024-04-01T16:35:29.582+0000 6517100 -1 init, newargv = 0x7a3bc70 newargc=15 2024-04-01T16:35:29.852 INFO:teuthology.orchestra.run.smithi163.stdout:/proc 2024-04-01T16:35:29.852 INFO:teuthology.orchestra.run.smithi163.stdout:/sys 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/dev 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/security 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/shm 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/pts 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/run 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/pstore 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/bpf 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/ 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/selinux 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/mqueue 2024-04-01T16:35:29.853 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/hugepages 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/debug 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/tracing 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/fuse/connections 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/config 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/run/user/1000 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T16:35:29.854 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns 2024-04-01T16:35:29.855 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:29.855 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:29.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:29.856 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2024-04-01T16:35:31.045 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2024-04-01T16:35:31.137 DEBUG:teuthology.orchestra.run.smithi163:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T16:35:31.185 INFO:teuthology.orchestra.run.smithi163.stdout:/proc 2024-04-01T16:35:31.185 INFO:teuthology.orchestra.run.smithi163.stdout:/sys 2024-04-01T16:35:31.185 INFO:teuthology.orchestra.run.smithi163.stdout:/dev 2024-04-01T16:35:31.185 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/security 2024-04-01T16:35:31.185 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/shm 2024-04-01T16:35:31.185 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/pts 2024-04-01T16:35:31.185 INFO:teuthology.orchestra.run.smithi163.stdout:/run 2024-04-01T16:35:31.185 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup 2024-04-01T16:35:31.185 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/pstore 2024-04-01T16:35:31.185 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/bpf 2024-04-01T16:35:31.185 INFO:teuthology.orchestra.run.smithi163.stdout:/ 2024-04-01T16:35:31.186 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/selinux 2024-04-01T16:35:31.186 INFO:teuthology.orchestra.run.smithi163.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T16:35:31.186 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/mqueue 2024-04-01T16:35:31.186 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/hugepages 2024-04-01T16:35:31.186 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/debug 2024-04-01T16:35:31.186 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/tracing 2024-04-01T16:35:31.186 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/fuse/connections 2024-04-01T16:35:31.186 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/config 2024-04-01T16:35:31.186 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T16:35:31.186 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T16:35:31.186 INFO:teuthology.orchestra.run.smithi163.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T16:35:31.186 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T16:35:31.187 INFO:teuthology.orchestra.run.smithi163.stdout:/run/user/1000 2024-04-01T16:35:31.187 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph 2024-04-01T16:35:31.187 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T16:35:31.187 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T16:35:31.187 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T16:35:31.187 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T16:35:31.187 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns 2024-04-01T16:35:31.187 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:31.187 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T16:35:31.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:31.188 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2024-04-01T16:35:31.210 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:ceph-fuse[45195]: starting fuse 2024-04-01T16:35:31.231 INFO:teuthology.orchestra.run.smithi163.stdout:41 2024-04-01T16:35:31.231 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-01T16:35:31.231 DEBUG:teuthology.orchestra.run.smithi163:> sudo stdin-killer -- python3 -c ' 2024-04-01T16:35:31.232 DEBUG:teuthology.orchestra.run.smithi163:> import glob 2024-04-01T16:35:31.232 DEBUG:teuthology.orchestra.run.smithi163:> import re 2024-04-01T16:35:31.232 DEBUG:teuthology.orchestra.run.smithi163:> import os 2024-04-01T16:35:31.232 DEBUG:teuthology.orchestra.run.smithi163:> import subprocess 2024-04-01T16:35:31.232 DEBUG:teuthology.orchestra.run.smithi163:> 2024-04-01T16:35:31.232 DEBUG:teuthology.orchestra.run.smithi163:> def _find_admin_socket(client_name): 2024-04-01T16:35:31.233 DEBUG:teuthology.orchestra.run.smithi163:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-01T16:35:31.233 DEBUG:teuthology.orchestra.run.smithi163:> files = glob.glob(asok_path) 2024-04-01T16:35:31.233 DEBUG:teuthology.orchestra.run.smithi163:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-01T16:35:31.233 DEBUG:teuthology.orchestra.run.smithi163:> 2024-04-01T16:35:31.234 DEBUG:teuthology.orchestra.run.smithi163:> # Given a non-glob path, it better be there 2024-04-01T16:35:31.234 DEBUG:teuthology.orchestra.run.smithi163:> if "*" not in asok_path: 2024-04-01T16:35:31.234 DEBUG:teuthology.orchestra.run.smithi163:> assert(len(files) == 1) 2024-04-01T16:35:31.235 DEBUG:teuthology.orchestra.run.smithi163:> return files[0] 2024-04-01T16:35:31.235 DEBUG:teuthology.orchestra.run.smithi163:> 2024-04-01T16:35:31.235 DEBUG:teuthology.orchestra.run.smithi163:> for f in files: 2024-04-01T16:35:31.235 DEBUG:teuthology.orchestra.run.smithi163:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-01T16:35:31.235 DEBUG:teuthology.orchestra.run.smithi163:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-01T16:35:31.235 DEBUG:teuthology.orchestra.run.smithi163:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-01T16:35:31.235 DEBUG:teuthology.orchestra.run.smithi163:> contents = proc_f.read() 2024-04-01T16:35:31.236 DEBUG:teuthology.orchestra.run.smithi163:> if mountpoint in contents: 2024-04-01T16:35:31.236 DEBUG:teuthology.orchestra.run.smithi163:> return f 2024-04-01T16:35:31.236 DEBUG:teuthology.orchestra.run.smithi163:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-01T16:35:31.236 DEBUG:teuthology.orchestra.run.smithi163:> 2024-04-01T16:35:31.236 DEBUG:teuthology.orchestra.run.smithi163:> print(_find_admin_socket("client.0")) 2024-04-01T16:35:31.236 DEBUG:teuthology.orchestra.run.smithi163:> ' 2024-04-01T16:35:31.435 INFO:teuthology.orchestra.run.smithi163.stdout:/var/run/ceph/ceph-client.0.45195.asok 2024-04-01T16:35:31.440 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T16:35:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T16:35:31.451 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45195.asok 2024-04-01T16:35:31.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:31.451 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45195.asok status 2024-04-01T16:35:31.811 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-01T16:35:31.811 INFO:teuthology.orchestra.run.smithi163.stdout: "metadata": { 2024-04-01T16:35:31.811 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_sha1": "d2271579d5e735cfd6d436b8349c004f06527cb0", 2024-04-01T16:35:31.811 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_version": "ceph version 19.0.0-2574-gd2271579 (d2271579d5e735cfd6d436b8349c004f06527cb0) squid (dev)", 2024-04-01T16:35:31.812 INFO:teuthology.orchestra.run.smithi163.stdout: "entity_id": "0", 2024-04-01T16:35:31.812 INFO:teuthology.orchestra.run.smithi163.stdout: "hostname": "smithi163", 2024-04-01T16:35:31.812 INFO:teuthology.orchestra.run.smithi163.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-01T16:35:31.812 INFO:teuthology.orchestra.run.smithi163.stdout: "pid": "45195", 2024-04-01T16:35:31.812 INFO:teuthology.orchestra.run.smithi163.stdout: "root": "/" 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_count": 0, 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_pinned_count": 0, 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 4608, 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: "inst": { 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: "name": { 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "client", 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: "num": 4608 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "172.21.15.163:0", 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 1882123063 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-01T16:35:31.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "172.21.15.163:0", 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 1882123063 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: "inst_str": "client.4608 172.21.15.163:0/1882123063", 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: "addr_str": "172.21.15.163:0/1882123063", 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: "inode_count": 1, 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_epoch": 8, 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch": 27, 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch_barrier": 0, 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: "blocklisted": false, 2024-04-01T16:35:31.814 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs" 2024-04-01T16:35:31.815 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-01T16:35:31.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:31.830 DEBUG:teuthology.orchestra.run.smithi163:> stat --file-system '--printf=%T 2024-04-01T16:35:31.830 DEBUG:teuthology.orchestra.run.smithi163:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-01T16:35:32.000 INFO:teuthology.orchestra.run.smithi163.stdout:fuseblk 2024-04-01T16:35:32.001 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-01T16:35:32.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T16:35:32.001 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-01T16:35:32.326 INFO:teuthology.run_tasks:Running task workunit... 2024-04-01T16:35:32.337 INFO:tasks.workunit:Pulling workunits from ref d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T16:35:32.338 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-01T16:35:32.338 INFO:tasks.workunit:timeout=3h 2024-04-01T16:35:32.338 INFO:tasks.workunit:cleanup=True 2024-04-01T16:35:32.338 DEBUG:teuthology.orchestra.run.smithi163:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-01T16:35:32.451 INFO:teuthology.orchestra.run.smithi163.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-01T16:35:32.451 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-01T16:35:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-04-01T16:35:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T16:35:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-01T16:35:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-01T16:35:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-01 16:34:35.612464075 +0000 2024-04-01T16:35:32.451 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-01 16:35:32.136417591 +0000 2024-04-01T16:35:32.451 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2024-04-01T16:35:32.452 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-01T16:35:32.452 DEBUG:teuthology.orchestra.run.smithi163:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-01T16:35:33.533 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2271579d5e735cfd6d436b8349c004f06527cb0 2024-04-01T16:35:33.592 INFO:tasks.workunit.client.0.smithi163.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-01T16:35:44.446 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:35:44.455 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:36:14.579 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:36:14.588 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:36:44.719 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:36:44.726 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:37:01.006 INFO:tasks.workunit.client.0.smithi163.stderr:Updating files: 62% (7636/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-01T16:37:01.436 INFO:tasks.workunit.client.0.smithi163.stderr:Note: switching to 'd2271579d5e735cfd6d436b8349c004f06527cb0'. 2024-04-01T16:37:01.436 INFO:tasks.workunit.client.0.smithi163.stderr: 2024-04-01T16:37:01.436 INFO:tasks.workunit.client.0.smithi163.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr:state without impacting any branches by switching back to a branch. 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr: 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr: 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr: git switch -c 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr: 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr:Or undo this operation with: 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr: 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr: git switch - 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr: 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr: 2024-04-01T16:37:01.437 INFO:tasks.workunit.client.0.smithi163.stderr:HEAD is now at d2271579d5e Merge PR #53564 into wip-vshankar-testing-20240330.170739 2024-04-01T16:37:01.448 DEBUG:teuthology.orchestra.run.smithi163:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-01T16:37:01.512 INFO:tasks.workunit.client.0.smithi163.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-01T16:37:01.518 INFO:tasks.workunit.client.0.smithi163.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-01T16:37:01.519 INFO:tasks.workunit.client.0.smithi163.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-01T16:37:02.368 INFO:tasks.workunit.client.0.smithi163.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-01T16:37:02.484 INFO:tasks.workunit.client.0.smithi163.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-01T16:37:02.567 INFO:tasks.workunit.client.0.smithi163.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-01T16:37:02.573 INFO:tasks.workunit.client.0.smithi163.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-01T16:37:02.573 INFO:tasks.workunit.client.0.smithi163.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-01T16:37:02.652 INFO:tasks.workunit.client.0.smithi163.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-01T16:37:02.661 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T16:37:02.661 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-01T16:37:02.711 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-04-01T16:37:02.712 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-04-01T16:37:02.713 DEBUG:teuthology.orchestra.run.smithi163:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2271579d5e735cfd6d436b8349c004f06527cb0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-04-01T16:37:03.230 INFO:tasks.workunit.client.0.smithi163.stderr:+ dbench 1 2024-04-01T16:37:03.251 INFO:tasks.workunit.client.0.smithi163.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-01T16:37:03.251 INFO:tasks.workunit.client.0.smithi163.stdout: 2024-04-01T16:37:03.251 INFO:tasks.workunit.client.0.smithi163.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-01T16:37:03.260 INFO:tasks.workunit.client.0.smithi163.stdout:0 of 1 processes prepared for launch 0 sec 2024-04-01T16:37:03.360 INFO:tasks.workunit.client.0.smithi163.stdout:1 of 1 processes prepared for launch 0 sec 2024-04-01T16:37:03.360 INFO:tasks.workunit.client.0.smithi163.stdout:releasing clients 2024-04-01T16:37:04.361 INFO:tasks.workunit.client.0.smithi163.stdout: 0 7 0.00 MB/sec warmup 1 sec latency 176.594 ms 2024-04-01T16:37:05.361 INFO:tasks.workunit.client.0.smithi163.stdout: 0 10 0.00 MB/sec warmup 2 sec latency 662.570 ms 2024-04-01T16:37:06.361 INFO:tasks.workunit.client.0.smithi163.stdout: 1 31 0.35 MB/sec warmup 3 sec latency 333.644 ms 2024-04-01T16:37:07.361 INFO:tasks.workunit.client.0.smithi163.stdout: 1 58 0.59 MB/sec warmup 4 sec latency 638.716 ms 2024-04-01T16:37:08.361 INFO:tasks.workunit.client.0.smithi163.stdout: 1 91 0.84 MB/sec warmup 5 sec latency 473.271 ms 2024-04-01T16:37:09.361 INFO:tasks.workunit.client.0.smithi163.stdout: 1 113 0.87 MB/sec warmup 6 sec latency 498.231 ms 2024-04-01T16:37:10.362 INFO:tasks.workunit.client.0.smithi163.stdout: 1 129 0.82 MB/sec warmup 7 sec latency 507.988 ms 2024-04-01T16:37:11.362 INFO:tasks.workunit.client.0.smithi163.stdout: 1 139 0.75 MB/sec warmup 8 sec latency 498.396 ms 2024-04-01T16:37:12.362 INFO:tasks.workunit.client.0.smithi163.stdout: 1 150 0.70 MB/sec warmup 9 sec latency 825.847 ms 2024-04-01T16:37:13.362 INFO:tasks.workunit.client.0.smithi163.stdout: 1 165 0.68 MB/sec warmup 10 sec latency 557.032 ms 2024-04-01T16:37:14.362 INFO:tasks.workunit.client.0.smithi163.stdout: 1 173 0.64 MB/sec warmup 11 sec latency 642.685 ms 2024-04-01T16:37:14.863 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:37:14.872 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:37:15.362 INFO:tasks.workunit.client.0.smithi163.stdout: 1 189 0.63 MB/sec warmup 12 sec latency 598.181 ms 2024-04-01T16:37:16.362 INFO:tasks.workunit.client.0.smithi163.stdout: 1 199 0.60 MB/sec warmup 13 sec latency 459.496 ms 2024-04-01T16:37:17.363 INFO:tasks.workunit.client.0.smithi163.stdout: 1 207 0.58 MB/sec warmup 14 sec latency 739.183 ms 2024-04-01T16:37:18.362 INFO:tasks.workunit.client.0.smithi163.stdout: 1 223 0.57 MB/sec warmup 15 sec latency 876.045 ms 2024-04-01T16:37:19.363 INFO:tasks.workunit.client.0.smithi163.stdout: 1 239 0.57 MB/sec warmup 16 sec latency 525.103 ms 2024-04-01T16:37:20.363 INFO:tasks.workunit.client.0.smithi163.stdout: 1 247 0.55 MB/sec warmup 17 sec latency 528.785 ms 2024-04-01T16:37:21.363 INFO:tasks.workunit.client.0.smithi163.stdout: 1 263 0.55 MB/sec warmup 18 sec latency 599.619 ms 2024-04-01T16:37:22.363 INFO:tasks.workunit.client.0.smithi163.stdout: 1 271 0.54 MB/sec warmup 19 sec latency 692.624 ms 2024-04-01T16:37:23.363 INFO:tasks.workunit.client.0.smithi163.stdout: 1 287 0.54 MB/sec warmup 20 sec latency 579.600 ms 2024-04-01T16:37:24.363 INFO:tasks.workunit.client.0.smithi163.stdout: 1 297 0.52 MB/sec warmup 21 sec latency 411.664 ms 2024-04-01T16:37:25.363 INFO:tasks.workunit.client.0.smithi163.stdout: 1 313 0.52 MB/sec warmup 22 sec latency 619.172 ms 2024-04-01T16:37:26.364 INFO:tasks.workunit.client.0.smithi163.stdout: 1 323 0.51 MB/sec warmup 23 sec latency 469.806 ms 2024-04-01T16:37:27.364 INFO:tasks.workunit.client.0.smithi163.stdout: 1 331 0.50 MB/sec warmup 24 sec latency 633.520 ms 2024-04-01T16:37:28.364 INFO:tasks.workunit.client.0.smithi163.stdout: 1 349 0.50 MB/sec warmup 25 sec latency 638.437 ms 2024-04-01T16:37:29.364 INFO:tasks.workunit.client.0.smithi163.stdout: 1 357 0.49 MB/sec warmup 26 sec latency 545.389 ms 2024-04-01T16:37:30.364 INFO:tasks.workunit.client.0.smithi163.stdout: 1 373 0.49 MB/sec warmup 27 sec latency 559.733 ms 2024-04-01T16:37:31.364 INFO:tasks.workunit.client.0.smithi163.stdout: 1 389 0.49 MB/sec warmup 28 sec latency 687.804 ms 2024-04-01T16:37:32.364 INFO:tasks.workunit.client.0.smithi163.stdout: 1 397 0.49 MB/sec warmup 29 sec latency 543.843 ms 2024-04-01T16:37:33.365 INFO:tasks.workunit.client.0.smithi163.stdout: 1 413 0.49 MB/sec warmup 30 sec latency 609.392 ms 2024-04-01T16:37:34.365 INFO:tasks.workunit.client.0.smithi163.stdout: 1 426 0.48 MB/sec warmup 31 sec latency 605.283 ms 2024-04-01T16:37:35.365 INFO:tasks.workunit.client.0.smithi163.stdout: 1 437 0.48 MB/sec warmup 32 sec latency 568.436 ms 2024-04-01T16:37:36.365 INFO:tasks.workunit.client.0.smithi163.stdout: 1 450 0.48 MB/sec warmup 33 sec latency 658.316 ms 2024-04-01T16:37:37.365 INFO:tasks.workunit.client.0.smithi163.stdout: 1 461 0.48 MB/sec warmup 34 sec latency 587.665 ms 2024-04-01T16:37:38.365 INFO:tasks.workunit.client.0.smithi163.stdout: 1 469 0.47 MB/sec warmup 35 sec latency 692.468 ms 2024-04-01T16:37:39.365 INFO:tasks.workunit.client.0.smithi163.stdout: 1 485 0.47 MB/sec warmup 36 sec latency 624.177 ms 2024-04-01T16:37:40.365 INFO:tasks.workunit.client.0.smithi163.stdout: 1 493 0.46 MB/sec warmup 37 sec latency 688.588 ms 2024-04-01T16:37:41.366 INFO:tasks.workunit.client.0.smithi163.stdout: 1 511 0.47 MB/sec warmup 38 sec latency 541.682 ms 2024-04-01T16:37:42.366 INFO:tasks.workunit.client.0.smithi163.stdout: 1 522 0.46 MB/sec warmup 39 sec latency 665.478 ms 2024-04-01T16:37:43.366 INFO:tasks.workunit.client.0.smithi163.stdout: 1 542 0.48 MB/sec warmup 40 sec latency 475.229 ms 2024-04-01T16:37:44.366 INFO:tasks.workunit.client.0.smithi163.stdout: 1 603 0.51 MB/sec warmup 41 sec latency 470.603 ms 2024-04-01T16:37:45.001 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:37:45.009 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:37:45.366 INFO:tasks.workunit.client.0.smithi163.stdout: 1 608 0.50 MB/sec warmup 42 sec latency 921.478 ms 2024-04-01T16:37:46.366 INFO:tasks.workunit.client.0.smithi163.stdout: 1 609 0.49 MB/sec warmup 43 sec latency 748.573 ms 2024-04-01T16:37:47.366 INFO:tasks.workunit.client.0.smithi163.stdout: 1 614 0.48 MB/sec warmup 44 sec latency 1391.145 ms 2024-04-01T16:37:48.366 INFO:tasks.workunit.client.0.smithi163.stdout: 1 639 0.47 MB/sec warmup 45 sec latency 1118.676 ms 2024-04-01T16:37:49.367 INFO:tasks.workunit.client.0.smithi163.stdout: 1 644 0.46 MB/sec warmup 46 sec latency 775.502 ms 2024-04-01T16:37:50.366 INFO:tasks.workunit.client.0.smithi163.stdout: 1 645 0.45 MB/sec warmup 47 sec latency 1191.200 ms 2024-04-01T16:37:51.367 INFO:tasks.workunit.client.0.smithi163.stdout: 1 649 0.44 MB/sec warmup 48 sec latency 1151.448 ms 2024-04-01T16:37:52.367 INFO:tasks.workunit.client.0.smithi163.stdout: 1 653 0.43 MB/sec warmup 49 sec latency 578.477 ms 2024-04-01T16:37:53.367 INFO:tasks.workunit.client.0.smithi163.stdout: 1 654 0.42 MB/sec warmup 50 sec latency 1277.847 ms 2024-04-01T16:37:54.369 INFO:tasks.workunit.client.0.smithi163.stdout: 1 671 0.42 MB/sec warmup 51 sec latency 305.627 ms 2024-04-01T16:37:55.367 INFO:tasks.workunit.client.0.smithi163.stdout: 1 680 0.41 MB/sec warmup 52 sec latency 436.881 ms 2024-04-01T16:37:56.367 INFO:tasks.workunit.client.0.smithi163.stdout: 1 682 0.40 MB/sec warmup 53 sec latency 1015.891 ms 2024-04-01T16:37:57.368 INFO:tasks.workunit.client.0.smithi163.stdout: 1 686 0.39 MB/sec warmup 54 sec latency 1247.268 ms 2024-04-01T16:37:58.368 INFO:tasks.workunit.client.0.smithi163.stdout: 1 705 0.39 MB/sec warmup 55 sec latency 410.147 ms 2024-04-01T16:37:59.368 INFO:tasks.workunit.client.0.smithi163.stdout: 1 711 0.38 MB/sec warmup 56 sec latency 776.194 ms 2024-04-01T16:38:00.368 INFO:tasks.workunit.client.0.smithi163.stdout: 1 721 0.37 MB/sec warmup 57 sec latency 390.150 ms 2024-04-01T16:38:01.368 INFO:tasks.workunit.client.0.smithi163.stdout: 1 743 0.37 MB/sec warmup 58 sec latency 200.342 ms 2024-04-01T16:38:02.368 INFO:tasks.workunit.client.0.smithi163.stdout: 1 744 0.36 MB/sec warmup 59 sec latency 863.599 ms 2024-04-01T16:38:03.368 INFO:tasks.workunit.client.0.smithi163.stdout: 1 746 0.36 MB/sec warmup 60 sec latency 1205.260 ms 2024-04-01T16:38:04.369 INFO:tasks.workunit.client.0.smithi163.stdout: 1 769 0.35 MB/sec warmup 61 sec latency 1138.041 ms 2024-04-01T16:38:05.369 INFO:tasks.workunit.client.0.smithi163.stdout: 1 778 0.34 MB/sec warmup 62 sec latency 473.112 ms 2024-04-01T16:38:06.369 INFO:tasks.workunit.client.0.smithi163.stdout: 1 780 0.34 MB/sec warmup 63 sec latency 686.222 ms 2024-04-01T16:38:07.369 INFO:tasks.workunit.client.0.smithi163.stdout: 1 795 0.34 MB/sec warmup 64 sec latency 360.088 ms 2024-04-01T16:38:08.369 INFO:tasks.workunit.client.0.smithi163.stdout: 1 812 0.33 MB/sec warmup 65 sec latency 209.902 ms 2024-04-01T16:38:09.369 INFO:tasks.workunit.client.0.smithi163.stdout: 1 813 0.33 MB/sec warmup 66 sec latency 1054.343 ms 2024-04-01T16:38:10.369 INFO:tasks.workunit.client.0.smithi163.stdout: 1 813 0.32 MB/sec warmup 67 sec latency 1016.382 ms 2024-04-01T16:38:11.369 INFO:tasks.workunit.client.0.smithi163.stdout: 1 818 0.32 MB/sec warmup 68 sec latency 1016.512 ms 2024-04-01T16:38:12.370 INFO:tasks.workunit.client.0.smithi163.stdout: 1 823 0.31 MB/sec warmup 69 sec latency 1097.673 ms 2024-04-01T16:38:13.370 INFO:tasks.workunit.client.0.smithi163.stdout: 1 845 0.31 MB/sec warmup 70 sec latency 1057.181 ms 2024-04-01T16:38:14.370 INFO:tasks.workunit.client.0.smithi163.stdout: 1 853 0.30 MB/sec warmup 71 sec latency 739.087 ms 2024-04-01T16:38:15.132 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:38:15.142 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:38:15.370 INFO:tasks.workunit.client.0.smithi163.stdout: 1 854 0.30 MB/sec warmup 72 sec latency 1106.258 ms 2024-04-01T16:38:16.370 INFO:tasks.workunit.client.0.smithi163.stdout: 1 857 0.30 MB/sec warmup 73 sec latency 1134.760 ms 2024-04-01T16:38:17.370 INFO:tasks.workunit.client.0.smithi163.stdout: 1 862 0.29 MB/sec warmup 74 sec latency 742.002 ms 2024-04-01T16:38:18.370 INFO:tasks.workunit.client.0.smithi163.stdout: 1 864 0.29 MB/sec warmup 75 sec latency 1413.209 ms 2024-04-01T16:38:19.370 INFO:tasks.workunit.client.0.smithi163.stdout: 1 880 0.29 MB/sec warmup 76 sec latency 287.089 ms 2024-04-01T16:38:20.370 INFO:tasks.workunit.client.0.smithi163.stdout: 1 890 0.28 MB/sec warmup 77 sec latency 989.748 ms 2024-04-01T16:38:21.371 INFO:tasks.workunit.client.0.smithi163.stdout: 1 902 0.28 MB/sec warmup 78 sec latency 398.995 ms 2024-04-01T16:38:22.371 INFO:tasks.workunit.client.0.smithi163.stdout: 1 904 0.27 MB/sec warmup 79 sec latency 707.902 ms 2024-04-01T16:38:23.371 INFO:tasks.workunit.client.0.smithi163.stdout: 1 923 0.27 MB/sec warmup 80 sec latency 286.327 ms 2024-04-01T16:38:24.371 INFO:tasks.workunit.client.0.smithi163.stdout: 1 927 0.27 MB/sec warmup 81 sec latency 745.030 ms 2024-04-01T16:38:25.371 INFO:tasks.workunit.client.0.smithi163.stdout: 1 928 0.27 MB/sec warmup 82 sec latency 1000.138 ms 2024-04-01T16:38:26.371 INFO:tasks.workunit.client.0.smithi163.stdout: 1 930 0.26 MB/sec warmup 83 sec latency 1018.990 ms 2024-04-01T16:38:27.371 INFO:tasks.workunit.client.0.smithi163.stdout: 1 931 0.26 MB/sec warmup 84 sec latency 673.049 ms 2024-04-01T16:38:28.372 INFO:tasks.workunit.client.0.smithi163.stdout: 1 933 0.26 MB/sec warmup 85 sec latency 1418.208 ms 2024-04-01T16:38:29.372 INFO:tasks.workunit.client.0.smithi163.stdout: 1 937 0.25 MB/sec warmup 86 sec latency 572.773 ms 2024-04-01T16:38:30.372 INFO:tasks.workunit.client.0.smithi163.stdout: 1 942 0.25 MB/sec warmup 87 sec latency 1112.489 ms 2024-04-01T16:38:31.372 INFO:tasks.workunit.client.0.smithi163.stdout: 1 959 0.25 MB/sec warmup 88 sec latency 1056.617 ms 2024-04-01T16:38:32.372 INFO:tasks.workunit.client.0.smithi163.stdout: 1 969 0.25 MB/sec warmup 89 sec latency 356.635 ms 2024-04-01T16:38:33.372 INFO:tasks.workunit.client.0.smithi163.stdout: 1 971 0.24 MB/sec warmup 90 sec latency 619.668 ms 2024-04-01T16:38:34.372 INFO:tasks.workunit.client.0.smithi163.stdout: 1 990 0.24 MB/sec warmup 91 sec latency 261.666 ms 2024-04-01T16:38:35.372 INFO:tasks.workunit.client.0.smithi163.stdout: 1 994 0.24 MB/sec warmup 92 sec latency 756.873 ms 2024-04-01T16:38:36.373 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1018 0.24 MB/sec warmup 93 sec latency 1021.612 ms 2024-04-01T16:38:37.373 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1027 0.24 MB/sec warmup 94 sec latency 886.561 ms 2024-04-01T16:38:38.373 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1033 0.24 MB/sec warmup 95 sec latency 1222.851 ms 2024-04-01T16:38:39.373 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1033 0.24 MB/sec warmup 96 sec latency 1040.611 ms 2024-04-01T16:38:40.373 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1046 0.24 MB/sec warmup 97 sec latency 1090.657 ms 2024-04-01T16:38:41.373 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1047 0.23 MB/sec warmup 98 sec latency 1015.885 ms 2024-04-01T16:38:42.373 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1047 0.23 MB/sec warmup 99 sec latency 1160.156 ms 2024-04-01T16:38:43.373 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1048 0.23 MB/sec warmup 100 sec latency 1352.815 ms 2024-04-01T16:38:44.374 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1059 0.23 MB/sec warmup 101 sec latency 1055.613 ms 2024-04-01T16:38:45.269 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:38:45.277 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:38:45.373 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1063 0.22 MB/sec warmup 102 sec latency 424.954 ms 2024-04-01T16:38:46.374 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1084 0.22 MB/sec warmup 103 sec latency 319.882 ms 2024-04-01T16:38:47.374 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1088 0.22 MB/sec warmup 104 sec latency 630.689 ms 2024-04-01T16:38:48.374 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1098 0.22 MB/sec warmup 105 sec latency 1166.081 ms 2024-04-01T16:38:49.374 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1100 0.22 MB/sec warmup 106 sec latency 601.722 ms 2024-04-01T16:38:50.374 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1113 0.21 MB/sec warmup 107 sec latency 1009.121 ms 2024-04-01T16:38:51.375 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1114 0.21 MB/sec warmup 108 sec latency 972.387 ms 2024-04-01T16:38:52.374 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1123 0.21 MB/sec warmup 109 sec latency 1030.568 ms 2024-04-01T16:38:53.375 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1134 0.21 MB/sec warmup 110 sec latency 345.355 ms 2024-04-01T16:38:54.375 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1147 0.21 MB/sec warmup 111 sec latency 462.492 ms 2024-04-01T16:38:55.375 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1157 0.21 MB/sec warmup 112 sec latency 578.639 ms 2024-04-01T16:38:56.375 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1160 0.20 MB/sec warmup 113 sec latency 1065.014 ms 2024-04-01T16:38:57.375 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1168 0.20 MB/sec warmup 114 sec latency 443.049 ms 2024-04-01T16:38:58.375 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1169 0.20 MB/sec warmup 115 sec latency 1048.219 ms 2024-04-01T16:38:59.375 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1170 0.20 MB/sec warmup 116 sec latency 1187.471 ms 2024-04-01T16:39:00.375 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1170 0.20 MB/sec warmup 117 sec latency 1207.651 ms 2024-04-01T16:39:01.376 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1177 0.20 MB/sec warmup 118 sec latency 1307.471 ms 2024-04-01T16:39:02.376 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1180 0.19 MB/sec warmup 119 sec latency 496.235 ms 2024-04-01T16:39:04.376 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1204 0.00 MB/sec execute 1 sec latency 462.283 ms 2024-04-01T16:39:05.376 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1210 0.00 MB/sec execute 2 sec latency 1048.579 ms 2024-04-01T16:39:06.376 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1220 0.01 MB/sec execute 3 sec latency 317.035 ms 2024-04-01T16:39:07.377 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1231 0.01 MB/sec execute 4 sec latency 367.073 ms 2024-04-01T16:39:08.377 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1244 0.01 MB/sec execute 5 sec latency 496.412 ms 2024-04-01T16:39:09.377 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1248 0.01 MB/sec execute 6 sec latency 695.306 ms 2024-04-01T16:39:10.377 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1252 0.01 MB/sec execute 7 sec latency 962.870 ms 2024-04-01T16:39:11.377 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1277 0.01 MB/sec execute 8 sec latency 352.514 ms 2024-04-01T16:39:12.377 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1278 0.01 MB/sec execute 9 sec latency 870.230 ms 2024-04-01T16:39:13.377 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1280 0.01 MB/sec execute 10 sec latency 1568.501 ms 2024-04-01T16:39:14.377 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1281 0.01 MB/sec execute 11 sec latency 1162.706 ms 2024-04-01T16:39:15.377 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1283 0.01 MB/sec execute 12 sec latency 1059.630 ms 2024-04-01T16:39:15.403 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:39:15.411 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:39:16.377 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1285 0.01 MB/sec execute 13 sec latency 876.850 ms 2024-04-01T16:39:17.378 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1376 0.21 MB/sec execute 14 sec latency 484.726 ms 2024-04-01T16:39:18.378 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1377 0.20 MB/sec execute 15 sec latency 1067.608 ms 2024-04-01T16:39:19.378 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1380 0.18 MB/sec execute 16 sec latency 1022.415 ms 2024-04-01T16:39:20.378 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1381 0.17 MB/sec execute 17 sec latency 818.902 ms 2024-04-01T16:39:21.378 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1385 0.16 MB/sec execute 18 sec latency 1037.874 ms 2024-04-01T16:39:22.378 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1391 0.16 MB/sec execute 19 sec latency 983.371 ms 2024-04-01T16:39:23.378 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1397 0.15 MB/sec execute 20 sec latency 297.443 ms 2024-04-01T16:39:24.378 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1399 0.14 MB/sec execute 21 sec latency 1001.677 ms 2024-04-01T16:39:25.379 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1417 0.13 MB/sec execute 22 sec latency 580.871 ms 2024-04-01T16:39:26.379 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1417 0.13 MB/sec execute 23 sec latency 1063.091 ms 2024-04-01T16:39:27.379 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1426 0.12 MB/sec execute 24 sec latency 1077.461 ms 2024-04-01T16:39:28.379 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1443 0.12 MB/sec execute 25 sec latency 490.318 ms 2024-04-01T16:39:29.379 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1448 0.11 MB/sec execute 26 sec latency 542.046 ms 2024-04-01T16:39:30.379 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1449 0.11 MB/sec execute 27 sec latency 1041.541 ms 2024-04-01T16:39:31.379 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1463 0.11 MB/sec execute 28 sec latency 204.874 ms 2024-04-01T16:39:32.379 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1466 0.10 MB/sec execute 29 sec latency 426.293 ms 2024-04-01T16:39:33.380 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1474 0.10 MB/sec execute 30 sec latency 1313.169 ms 2024-04-01T16:39:34.380 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1485 0.10 MB/sec execute 31 sec latency 480.563 ms 2024-04-01T16:39:35.380 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1487 0.09 MB/sec execute 32 sec latency 1025.984 ms 2024-04-01T16:39:36.380 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1490 0.09 MB/sec execute 33 sec latency 359.026 ms 2024-04-01T16:39:37.380 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1499 0.09 MB/sec execute 34 sec latency 1083.597 ms 2024-04-01T16:39:38.380 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1502 0.09 MB/sec execute 35 sec latency 459.737 ms 2024-04-01T16:39:39.380 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1516 0.08 MB/sec execute 36 sec latency 538.373 ms 2024-04-01T16:39:40.380 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1525 0.08 MB/sec execute 37 sec latency 511.385 ms 2024-04-01T16:39:41.381 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1526 0.08 MB/sec execute 38 sec latency 967.977 ms 2024-04-01T16:39:42.381 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1530 0.08 MB/sec execute 39 sec latency 1139.037 ms 2024-04-01T16:39:43.381 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1541 0.08 MB/sec execute 40 sec latency 1261.563 ms 2024-04-01T16:39:44.381 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1554 0.07 MB/sec execute 41 sec latency 483.125 ms 2024-04-01T16:39:45.381 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1555 0.07 MB/sec execute 42 sec latency 916.034 ms 2024-04-01T16:39:45.554 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:39:45.564 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:39:46.381 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1568 0.07 MB/sec execute 43 sec latency 1071.792 ms 2024-04-01T16:39:47.381 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1582 0.07 MB/sec execute 44 sec latency 235.855 ms 2024-04-01T16:39:48.382 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1588 0.07 MB/sec execute 45 sec latency 206.600 ms 2024-04-01T16:39:49.382 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1589 0.07 MB/sec execute 46 sec latency 850.382 ms 2024-04-01T16:39:50.382 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1603 0.07 MB/sec execute 47 sec latency 1114.827 ms 2024-04-01T16:39:51.382 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1606 0.06 MB/sec execute 48 sec latency 775.472 ms 2024-04-01T16:39:52.382 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1610 0.06 MB/sec execute 49 sec latency 1005.833 ms 2024-04-01T16:39:53.382 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1614 0.06 MB/sec execute 50 sec latency 1122.093 ms 2024-04-01T16:39:54.382 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1617 0.06 MB/sec execute 51 sec latency 352.319 ms 2024-04-01T16:39:55.382 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1629 0.06 MB/sec execute 52 sec latency 1051.443 ms 2024-04-01T16:39:56.382 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1641 0.06 MB/sec execute 53 sec latency 491.971 ms 2024-04-01T16:39:57.383 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1643 0.06 MB/sec execute 54 sec latency 987.807 ms 2024-04-01T16:39:58.383 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1644 0.06 MB/sec execute 55 sec latency 975.151 ms 2024-04-01T16:39:59.383 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1653 0.06 MB/sec execute 56 sec latency 1132.077 ms 2024-04-01T16:40:00.383 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1680 0.06 MB/sec execute 57 sec latency 700.867 ms 2024-04-01T16:40:01.383 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1686 0.05 MB/sec execute 58 sec latency 702.618 ms 2024-04-01T16:40:02.383 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1698 0.05 MB/sec execute 59 sec latency 705.631 ms 2024-04-01T16:40:03.383 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1701 0.05 MB/sec execute 60 sec latency 362.028 ms 2024-04-01T16:40:04.384 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1707 0.05 MB/sec execute 61 sec latency 1064.036 ms 2024-04-01T16:40:05.384 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1711 0.05 MB/sec execute 62 sec latency 994.348 ms 2024-04-01T16:40:06.384 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1736 0.05 MB/sec execute 63 sec latency 250.153 ms 2024-04-01T16:40:07.384 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1769 0.05 MB/sec execute 64 sec latency 264.363 ms 2024-04-01T16:40:08.384 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1772 0.05 MB/sec execute 65 sec latency 487.300 ms 2024-04-01T16:40:09.385 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1779 0.05 MB/sec execute 66 sec latency 1053.900 ms 2024-04-01T16:40:10.384 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1802 0.05 MB/sec execute 67 sec latency 129.585 ms 2024-04-01T16:40:11.384 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1806 0.05 MB/sec execute 68 sec latency 312.955 ms 2024-04-01T16:40:12.385 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1812 0.05 MB/sec execute 69 sec latency 1100.155 ms 2024-04-01T16:40:13.385 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1822 0.05 MB/sec execute 70 sec latency 500.454 ms 2024-04-01T16:40:14.385 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1823 0.05 MB/sec execute 71 sec latency 1038.578 ms 2024-04-01T16:40:15.385 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1826 0.05 MB/sec execute 72 sec latency 848.932 ms 2024-04-01T16:40:15.684 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:40:15.692 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:40:16.385 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1838 0.05 MB/sec execute 73 sec latency 1001.913 ms 2024-04-01T16:40:17.385 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1841 0.04 MB/sec execute 74 sec latency 405.822 ms 2024-04-01T16:40:18.385 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1852 0.04 MB/sec execute 75 sec latency 1161.245 ms 2024-04-01T16:40:19.386 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1858 0.04 MB/sec execute 76 sec latency 482.746 ms 2024-04-01T16:40:20.386 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1862 0.04 MB/sec execute 77 sec latency 1168.240 ms 2024-04-01T16:40:21.386 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1862 0.04 MB/sec execute 78 sec latency 1069.730 ms 2024-04-01T16:40:22.386 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1868 0.04 MB/sec execute 79 sec latency 1129.990 ms 2024-04-01T16:40:23.386 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1869 0.04 MB/sec execute 80 sec latency 642.454 ms 2024-04-01T16:40:24.387 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1888 0.04 MB/sec execute 81 sec latency 967.305 ms 2024-04-01T16:40:25.386 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1898 0.04 MB/sec execute 82 sec latency 757.123 ms 2024-04-01T16:40:26.386 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1903 0.04 MB/sec execute 83 sec latency 1093.356 ms 2024-04-01T16:40:27.387 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1910 0.04 MB/sec execute 84 sec latency 1012.568 ms 2024-04-01T16:40:28.387 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1912 0.04 MB/sec execute 85 sec latency 651.605 ms 2024-04-01T16:40:29.387 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1920 0.04 MB/sec execute 86 sec latency 1056.739 ms 2024-04-01T16:40:30.387 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1930 0.04 MB/sec execute 87 sec latency 1005.647 ms 2024-04-01T16:40:31.387 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1967 0.04 MB/sec execute 88 sec latency 186.257 ms 2024-04-01T16:40:32.387 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1975 0.04 MB/sec execute 89 sec latency 509.298 ms 2024-04-01T16:40:33.387 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1975 0.04 MB/sec execute 90 sec latency 1053.518 ms 2024-04-01T16:40:34.387 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1989 0.04 MB/sec execute 91 sec latency 1221.632 ms 2024-04-01T16:40:35.388 INFO:tasks.workunit.client.0.smithi163.stdout: 1 1997 0.04 MB/sec execute 92 sec latency 710.441 ms 2024-04-01T16:40:36.388 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2004 0.04 MB/sec execute 93 sec latency 1256.553 ms 2024-04-01T16:40:37.388 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2016 0.04 MB/sec execute 94 sec latency 349.892 ms 2024-04-01T16:40:38.388 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2030 0.04 MB/sec execute 95 sec latency 186.774 ms 2024-04-01T16:40:39.388 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2034 0.04 MB/sec execute 96 sec latency 580.874 ms 2024-04-01T16:40:40.388 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2043 0.04 MB/sec execute 97 sec latency 1198.931 ms 2024-04-01T16:40:41.388 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2043 0.04 MB/sec execute 98 sec latency 1013.666 ms 2024-04-01T16:40:42.388 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2051 0.04 MB/sec execute 99 sec latency 1084.900 ms 2024-04-01T16:40:43.389 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2053 0.04 MB/sec execute 100 sec latency 1215.198 ms 2024-04-01T16:40:44.389 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2057 0.04 MB/sec execute 101 sec latency 1067.378 ms 2024-04-01T16:40:45.389 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2061 0.04 MB/sec execute 102 sec latency 328.785 ms 2024-04-01T16:40:45.832 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:40:45.840 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:40:46.389 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2071 0.03 MB/sec execute 103 sec latency 988.899 ms 2024-04-01T16:40:47.389 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2079 0.03 MB/sec execute 104 sec latency 812.812 ms 2024-04-01T16:40:48.389 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2081 0.03 MB/sec execute 105 sec latency 1292.609 ms 2024-04-01T16:40:49.389 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2088 0.03 MB/sec execute 106 sec latency 951.612 ms 2024-04-01T16:40:50.390 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2093 0.03 MB/sec execute 107 sec latency 632.620 ms 2024-04-01T16:40:51.390 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2096 0.03 MB/sec execute 108 sec latency 1055.763 ms 2024-04-01T16:40:52.390 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2104 0.03 MB/sec execute 109 sec latency 1152.517 ms 2024-04-01T16:40:53.390 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2138 0.03 MB/sec execute 110 sec latency 268.682 ms 2024-04-01T16:40:54.390 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2140 0.03 MB/sec execute 111 sec latency 521.314 ms 2024-04-01T16:40:55.390 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2146 0.03 MB/sec execute 112 sec latency 1056.395 ms 2024-04-01T16:40:56.390 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2152 0.03 MB/sec execute 113 sec latency 1047.258 ms 2024-04-01T16:40:57.390 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2173 0.03 MB/sec execute 114 sec latency 334.868 ms 2024-04-01T16:40:58.391 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2175 0.03 MB/sec execute 115 sec latency 1079.587 ms 2024-04-01T16:40:59.391 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2175 0.03 MB/sec execute 116 sec latency 1098.108 ms 2024-04-01T16:41:00.391 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2179 0.03 MB/sec execute 117 sec latency 1381.376 ms 2024-04-01T16:41:01.391 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2183 0.03 MB/sec execute 118 sec latency 376.137 ms 2024-04-01T16:41:02.391 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2198 0.03 MB/sec execute 119 sec latency 1008.774 ms 2024-04-01T16:41:03.391 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2201 0.03 MB/sec execute 120 sec latency 624.968 ms 2024-04-01T16:41:04.391 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2221 0.03 MB/sec execute 121 sec latency 331.540 ms 2024-04-01T16:41:05.391 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2221 0.03 MB/sec execute 122 sec latency 1058.343 ms 2024-04-01T16:41:06.391 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2258 0.03 MB/sec execute 123 sec latency 1088.255 ms 2024-04-01T16:41:07.392 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2284 0.03 MB/sec execute 124 sec latency 300.850 ms 2024-04-01T16:41:08.392 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2292 0.04 MB/sec execute 125 sec latency 872.880 ms 2024-04-01T16:41:09.392 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2299 0.04 MB/sec execute 126 sec latency 1086.831 ms 2024-04-01T16:41:10.392 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2303 0.04 MB/sec execute 127 sec latency 553.719 ms 2024-04-01T16:41:11.392 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2306 0.04 MB/sec execute 128 sec latency 1060.554 ms 2024-04-01T16:41:12.392 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2306 0.04 MB/sec execute 129 sec latency 1452.142 ms 2024-04-01T16:41:13.392 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2307 0.04 MB/sec execute 130 sec latency 1943.540 ms 2024-04-01T16:41:14.392 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2321 0.04 MB/sec execute 131 sec latency 1071.413 ms 2024-04-01T16:41:15.393 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2324 0.04 MB/sec execute 132 sec latency 1078.767 ms 2024-04-01T16:41:15.960 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:41:15.972 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:41:16.393 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2327 0.04 MB/sec execute 133 sec latency 1014.023 ms 2024-04-01T16:41:17.393 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2335 0.04 MB/sec execute 134 sec latency 414.773 ms 2024-04-01T16:41:18.393 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2336 0.04 MB/sec execute 135 sec latency 1039.914 ms 2024-04-01T16:41:19.393 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2340 0.04 MB/sec execute 136 sec latency 643.776 ms 2024-04-01T16:41:20.393 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2353 0.04 MB/sec execute 137 sec latency 1088.378 ms 2024-04-01T16:41:21.393 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2361 0.04 MB/sec execute 138 sec latency 453.112 ms 2024-04-01T16:41:22.393 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2361 0.03 MB/sec execute 139 sec latency 1021.663 ms 2024-04-01T16:41:23.394 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2362 0.03 MB/sec execute 140 sec latency 1448.071 ms 2024-04-01T16:41:24.394 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2364 0.03 MB/sec execute 141 sec latency 1096.221 ms 2024-04-01T16:41:25.394 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2366 0.03 MB/sec execute 142 sec latency 995.940 ms 2024-04-01T16:41:26.394 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2368 0.03 MB/sec execute 143 sec latency 1077.980 ms 2024-04-01T16:41:27.394 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2371 0.03 MB/sec execute 144 sec latency 745.715 ms 2024-04-01T16:41:28.394 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2385 0.03 MB/sec execute 145 sec latency 1135.757 ms 2024-04-01T16:41:29.394 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2391 0.03 MB/sec execute 146 sec latency 601.089 ms 2024-04-01T16:41:30.394 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2394 0.03 MB/sec execute 147 sec latency 1016.572 ms 2024-04-01T16:41:31.395 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2400 0.03 MB/sec execute 148 sec latency 370.740 ms 2024-04-01T16:41:32.395 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2407 0.03 MB/sec execute 149 sec latency 409.527 ms 2024-04-01T16:41:33.395 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2410 0.03 MB/sec execute 150 sec latency 535.988 ms 2024-04-01T16:41:34.395 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2422 0.03 MB/sec execute 151 sec latency 1060.633 ms 2024-04-01T16:41:35.395 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2428 0.03 MB/sec execute 152 sec latency 660.389 ms 2024-04-01T16:41:36.395 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2431 0.03 MB/sec execute 153 sec latency 836.789 ms 2024-04-01T16:41:37.395 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2432 0.03 MB/sec execute 154 sec latency 1019.473 ms 2024-04-01T16:41:38.398 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2436 0.03 MB/sec execute 155 sec latency 1284.631 ms 2024-04-01T16:41:39.396 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2441 0.03 MB/sec execute 156 sec latency 465.047 ms 2024-04-01T16:41:40.396 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2449 0.03 MB/sec execute 157 sec latency 303.335 ms 2024-04-01T16:41:41.396 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2454 0.03 MB/sec execute 158 sec latency 478.798 ms 2024-04-01T16:41:42.396 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2470 0.04 MB/sec execute 159 sec latency 367.758 ms 2024-04-01T16:41:43.396 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2470 0.03 MB/sec execute 160 sec latency 1137.874 ms 2024-04-01T16:41:44.396 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2489 0.04 MB/sec execute 161 sec latency 1280.328 ms 2024-04-01T16:41:45.396 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2492 0.04 MB/sec execute 162 sec latency 622.198 ms 2024-04-01T16:41:46.094 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:41:46.102 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:41:46.396 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2494 0.03 MB/sec execute 163 sec latency 1092.749 ms 2024-04-01T16:41:47.397 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2497 0.03 MB/sec execute 164 sec latency 923.624 ms 2024-04-01T16:41:48.397 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2503 0.03 MB/sec execute 165 sec latency 399.462 ms 2024-04-01T16:41:49.397 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2506 0.03 MB/sec execute 166 sec latency 844.041 ms 2024-04-01T16:41:50.397 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2549 0.04 MB/sec execute 167 sec latency 1082.992 ms 2024-04-01T16:41:51.397 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2551 0.03 MB/sec execute 168 sec latency 999.425 ms 2024-04-01T16:41:52.397 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2558 0.03 MB/sec execute 169 sec latency 1059.996 ms 2024-04-01T16:41:53.397 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2560 0.03 MB/sec execute 170 sec latency 477.969 ms 2024-04-01T16:41:54.398 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2562 0.03 MB/sec execute 171 sec latency 1033.373 ms 2024-04-01T16:41:55.398 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2576 0.03 MB/sec execute 172 sec latency 400.548 ms 2024-04-01T16:41:56.398 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2580 0.03 MB/sec execute 173 sec latency 657.886 ms 2024-04-01T16:41:57.398 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2581 0.03 MB/sec execute 174 sec latency 1049.357 ms 2024-04-01T16:41:58.398 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2582 0.03 MB/sec execute 175 sec latency 1320.317 ms 2024-04-01T16:41:59.398 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2596 0.03 MB/sec execute 176 sec latency 321.727 ms 2024-04-01T16:42:00.398 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2600 0.03 MB/sec execute 177 sec latency 797.109 ms 2024-04-01T16:42:01.399 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2602 0.03 MB/sec execute 178 sec latency 1057.861 ms 2024-04-01T16:42:02.399 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2608 0.03 MB/sec execute 179 sec latency 391.931 ms 2024-04-01T16:42:03.399 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2615 0.03 MB/sec execute 180 sec latency 548.099 ms 2024-04-01T16:42:04.399 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2617 0.03 MB/sec execute 181 sec latency 984.647 ms 2024-04-01T16:42:05.399 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2618 0.03 MB/sec execute 182 sec latency 989.074 ms 2024-04-01T16:42:06.399 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2621 0.03 MB/sec execute 183 sec latency 1000.139 ms 2024-04-01T16:42:07.399 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2622 0.03 MB/sec execute 184 sec latency 987.477 ms 2024-04-01T16:42:08.400 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2718 0.05 MB/sec execute 185 sec latency 373.040 ms 2024-04-01T16:42:09.400 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2720 0.05 MB/sec execute 186 sec latency 1042.912 ms 2024-04-01T16:42:10.400 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2745 0.05 MB/sec execute 187 sec latency 984.290 ms 2024-04-01T16:42:11.400 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2752 0.05 MB/sec execute 188 sec latency 1083.988 ms 2024-04-01T16:42:12.400 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2760 0.05 MB/sec execute 189 sec latency 694.930 ms 2024-04-01T16:42:13.400 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2763 0.05 MB/sec execute 190 sec latency 1290.355 ms 2024-04-01T16:42:14.403 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2772 0.05 MB/sec execute 191 sec latency 323.835 ms 2024-04-01T16:42:15.400 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2779 0.05 MB/sec execute 192 sec latency 399.888 ms 2024-04-01T16:42:16.230 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:42:16.240 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:42:16.400 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2782 0.05 MB/sec execute 193 sec latency 947.323 ms 2024-04-01T16:42:17.401 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2872 0.05 MB/sec execute 194 sec latency 301.270 ms 2024-04-01T16:42:18.401 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2874 0.05 MB/sec execute 195 sec latency 1221.571 ms 2024-04-01T16:42:19.401 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2880 0.05 MB/sec execute 196 sec latency 325.196 ms 2024-04-01T16:42:20.401 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2897 0.05 MB/sec execute 197 sec latency 445.331 ms 2024-04-01T16:42:21.401 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2902 0.05 MB/sec execute 198 sec latency 339.001 ms 2024-04-01T16:42:22.401 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2918 0.05 MB/sec execute 199 sec latency 435.795 ms 2024-04-01T16:42:23.401 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2931 0.05 MB/sec execute 200 sec latency 313.312 ms 2024-04-01T16:42:24.401 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2935 0.05 MB/sec execute 201 sec latency 624.372 ms 2024-04-01T16:42:25.402 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2938 0.05 MB/sec execute 202 sec latency 774.427 ms 2024-04-01T16:42:26.402 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2966 0.05 MB/sec execute 203 sec latency 1107.645 ms 2024-04-01T16:42:27.402 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2967 0.05 MB/sec execute 204 sec latency 1093.123 ms 2024-04-01T16:42:28.402 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2974 0.05 MB/sec execute 205 sec latency 412.430 ms 2024-04-01T16:42:29.402 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2975 0.05 MB/sec execute 206 sec latency 934.479 ms 2024-04-01T16:42:30.403 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2982 0.05 MB/sec execute 207 sec latency 410.296 ms 2024-04-01T16:42:31.402 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2990 0.05 MB/sec execute 208 sec latency 451.892 ms 2024-04-01T16:42:31.693 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:09:03.376 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:42:31.822 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:09:03.490 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:42:31.826 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:09:03.509 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:42:31.867 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:09:03.534 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:42:31.917 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:09:03.585 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:42:31.980 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:09:03.648 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:42:32.354 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:09:04.037 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:42:32.402 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2994 0.05 MB/sec execute 209 sec latency 531.919 ms 2024-04-01T16:42:32.412 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:09:04.080 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:42:32.492 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:09:04.160 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:42:33.402 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3000 0.05 MB/sec execute 210 sec latency 926.218 ms 2024-04-01T16:42:34.403 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3012 0.05 MB/sec execute 211 sec latency 460.749 ms 2024-04-01T16:42:35.403 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3018 0.05 MB/sec execute 212 sec latency 670.648 ms 2024-04-01T16:42:36.403 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3024 0.05 MB/sec execute 213 sec latency 370.754 ms 2024-04-01T16:42:37.403 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3031 0.05 MB/sec execute 214 sec latency 609.725 ms 2024-04-01T16:42:38.403 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3167 0.05 MB/sec execute 215 sec latency 1288.871 ms 2024-04-01T16:42:39.403 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3170 0.05 MB/sec execute 216 sec latency 982.796 ms 2024-04-01T16:42:40.404 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3176 0.05 MB/sec execute 217 sec latency 339.963 ms 2024-04-01T16:42:41.404 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3188 0.05 MB/sec execute 218 sec latency 438.820 ms 2024-04-01T16:42:42.404 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3189 0.05 MB/sec execute 219 sec latency 1143.363 ms 2024-04-01T16:42:43.404 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3204 0.05 MB/sec execute 220 sec latency 443.130 ms 2024-04-01T16:42:44.404 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3212 0.05 MB/sec execute 221 sec latency 589.572 ms 2024-04-01T16:42:45.404 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3246 0.05 MB/sec execute 222 sec latency 318.524 ms 2024-04-01T16:42:46.404 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3266 0.06 MB/sec execute 223 sec latency 796.904 ms 2024-04-01T16:42:46.620 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:42:46.631 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:42:47.404 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3268 0.05 MB/sec execute 224 sec latency 1212.637 ms 2024-04-01T16:42:48.404 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3271 0.05 MB/sec execute 225 sec latency 1363.632 ms 2024-04-01T16:42:49.405 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3280 0.05 MB/sec execute 226 sec latency 373.084 ms 2024-04-01T16:42:50.405 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3281 0.05 MB/sec execute 227 sec latency 1015.551 ms 2024-04-01T16:42:51.406 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3281 0.05 MB/sec execute 228 sec latency 1358.512 ms 2024-04-01T16:42:52.406 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3282 0.05 MB/sec execute 229 sec latency 1359.381 ms 2024-04-01T16:42:53.406 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3283 0.05 MB/sec execute 230 sec latency 1035.483 ms 2024-04-01T16:42:54.406 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3285 0.05 MB/sec execute 231 sec latency 1113.563 ms 2024-04-01T16:42:55.406 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3286 0.05 MB/sec execute 232 sec latency 1134.169 ms 2024-04-01T16:42:56.406 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3287 0.05 MB/sec execute 233 sec latency 1108.537 ms 2024-04-01T16:42:57.406 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3290 0.05 MB/sec execute 234 sec latency 1062.330 ms 2024-04-01T16:42:58.407 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3291 0.05 MB/sec execute 235 sec latency 1324.584 ms 2024-04-01T16:42:59.407 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3292 0.05 MB/sec execute 236 sec latency 1025.526 ms 2024-04-01T16:43:00.407 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3293 0.05 MB/sec execute 237 sec latency 1041.671 ms 2024-04-01T16:43:01.407 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3294 0.05 MB/sec execute 238 sec latency 1043.286 ms 2024-04-01T16:43:02.407 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3295 0.05 MB/sec execute 239 sec latency 1063.337 ms 2024-04-01T16:43:03.407 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3295 0.05 MB/sec execute 240 sec latency 1000.408 ms 2024-04-01T16:43:04.407 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3298 0.05 MB/sec execute 241 sec latency 1056.940 ms 2024-04-01T16:43:05.407 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3299 0.05 MB/sec execute 242 sec latency 966.543 ms 2024-04-01T16:43:06.408 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3303 0.05 MB/sec execute 243 sec latency 1059.474 ms 2024-04-01T16:43:07.408 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3306 0.05 MB/sec execute 244 sec latency 1004.427 ms 2024-04-01T16:43:08.408 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3307 0.05 MB/sec execute 245 sec latency 1101.612 ms 2024-04-01T16:43:09.408 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3308 0.05 MB/sec execute 246 sec latency 1065.559 ms 2024-04-01T16:43:10.408 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3309 0.05 MB/sec execute 247 sec latency 1076.750 ms 2024-04-01T16:43:11.408 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3310 0.05 MB/sec execute 248 sec latency 987.021 ms 2024-04-01T16:43:12.408 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3311 0.05 MB/sec execute 249 sec latency 1017.264 ms 2024-04-01T16:43:13.408 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3312 0.05 MB/sec execute 250 sec latency 1072.238 ms 2024-04-01T16:43:14.409 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3313 0.05 MB/sec execute 251 sec latency 962.913 ms 2024-04-01T16:43:15.409 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3314 0.05 MB/sec execute 252 sec latency 1027.714 ms 2024-04-01T16:43:16.409 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3316 0.05 MB/sec execute 253 sec latency 980.908 ms 2024-04-01T16:43:16.765 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:43:16.774 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:43:17.409 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3317 0.05 MB/sec execute 254 sec latency 950.918 ms 2024-04-01T16:43:18.409 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3318 0.05 MB/sec execute 255 sec latency 1015.192 ms 2024-04-01T16:43:19.409 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3319 0.05 MB/sec execute 256 sec latency 1036.984 ms 2024-04-01T16:43:20.409 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3320 0.05 MB/sec execute 257 sec latency 1051.646 ms 2024-04-01T16:43:21.409 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3322 0.05 MB/sec execute 258 sec latency 989.674 ms 2024-04-01T16:43:22.410 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3323 0.05 MB/sec execute 259 sec latency 1048.964 ms 2024-04-01T16:43:23.410 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3324 0.05 MB/sec execute 260 sec latency 979.930 ms 2024-04-01T16:43:24.410 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3325 0.05 MB/sec execute 261 sec latency 1025.135 ms 2024-04-01T16:43:25.410 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3326 0.05 MB/sec execute 262 sec latency 1006.881 ms 2024-04-01T16:43:26.410 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3327 0.05 MB/sec execute 263 sec latency 1001.346 ms 2024-04-01T16:43:27.410 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3329 0.05 MB/sec execute 264 sec latency 1003.137 ms 2024-04-01T16:43:28.410 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3330 0.05 MB/sec execute 265 sec latency 842.020 ms 2024-04-01T16:43:29.410 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3331 0.05 MB/sec execute 266 sec latency 973.058 ms 2024-04-01T16:43:30.411 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3332 0.05 MB/sec execute 267 sec latency 1047.908 ms 2024-04-01T16:43:31.411 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3333 0.05 MB/sec execute 268 sec latency 958.271 ms 2024-04-01T16:43:32.411 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3334 0.05 MB/sec execute 269 sec latency 1054.697 ms 2024-04-01T16:43:33.411 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3335 0.05 MB/sec execute 270 sec latency 1045.220 ms 2024-04-01T16:43:34.411 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3336 0.05 MB/sec execute 271 sec latency 1073.276 ms 2024-04-01T16:43:35.411 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3337 0.05 MB/sec execute 272 sec latency 1061.210 ms 2024-04-01T16:43:36.411 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3342 0.05 MB/sec execute 273 sec latency 1049.299 ms 2024-04-01T16:43:37.412 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3352 0.05 MB/sec execute 274 sec latency 417.100 ms 2024-04-01T16:43:38.411 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3361 0.05 MB/sec execute 275 sec latency 417.915 ms 2024-04-01T16:43:39.412 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3366 0.04 MB/sec execute 276 sec latency 507.439 ms 2024-04-01T16:43:40.412 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3374 0.04 MB/sec execute 277 sec latency 347.814 ms 2024-04-01T16:43:41.412 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3379 0.04 MB/sec execute 278 sec latency 491.391 ms 2024-04-01T16:43:42.412 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3391 0.04 MB/sec execute 279 sec latency 454.736 ms 2024-04-01T16:43:43.412 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3391 0.04 MB/sec execute 280 sec latency 1454.836 ms 2024-04-01T16:43:44.413 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3393 0.04 MB/sec execute 281 sec latency 1521.110 ms 2024-04-01T16:43:45.412 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3395 0.04 MB/sec execute 282 sec latency 1104.776 ms 2024-04-01T16:43:46.413 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3398 0.04 MB/sec execute 283 sec latency 1269.433 ms 2024-04-01T16:43:46.911 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:43:46.919 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:43:47.413 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3410 0.04 MB/sec execute 284 sec latency 1141.485 ms 2024-04-01T16:43:48.413 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3501 0.05 MB/sec execute 285 sec latency 308.968 ms 2024-04-01T16:43:49.413 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3515 0.05 MB/sec execute 286 sec latency 282.221 ms 2024-04-01T16:43:50.413 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3530 0.05 MB/sec execute 287 sec latency 286.025 ms 2024-04-01T16:43:51.413 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3531 0.05 MB/sec execute 288 sec latency 916.602 ms 2024-04-01T16:43:52.414 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3540 0.05 MB/sec execute 289 sec latency 1042.652 ms 2024-04-01T16:43:53.413 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3550 0.05 MB/sec execute 290 sec latency 429.995 ms 2024-04-01T16:43:54.414 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3557 0.05 MB/sec execute 291 sec latency 342.677 ms 2024-04-01T16:43:55.414 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3558 0.05 MB/sec execute 292 sec latency 1013.778 ms 2024-04-01T16:43:56.414 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3563 0.05 MB/sec execute 293 sec latency 464.178 ms 2024-04-01T16:43:57.414 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3573 0.05 MB/sec execute 294 sec latency 316.058 ms 2024-04-01T16:43:58.414 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3577 0.05 MB/sec execute 295 sec latency 1103.664 ms 2024-04-01T16:43:59.414 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3587 0.05 MB/sec execute 296 sec latency 274.902 ms 2024-04-01T16:44:00.414 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3588 0.05 MB/sec execute 297 sec latency 997.250 ms 2024-04-01T16:44:01.414 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3626 0.05 MB/sec execute 298 sec latency 1033.563 ms 2024-04-01T16:44:02.415 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3633 0.05 MB/sec execute 299 sec latency 465.267 ms 2024-04-01T16:44:03.415 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3638 0.05 MB/sec execute 300 sec latency 517.366 ms 2024-04-01T16:44:04.415 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3642 0.05 MB/sec execute 301 sec latency 678.271 ms 2024-04-01T16:44:05.415 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3645 0.05 MB/sec execute 302 sec latency 1070.578 ms 2024-04-01T16:44:06.415 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3665 0.05 MB/sec execute 303 sec latency 354.728 ms 2024-04-01T16:44:07.415 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3672 0.05 MB/sec execute 304 sec latency 354.449 ms 2024-04-01T16:44:08.416 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3672 0.05 MB/sec execute 305 sec latency 1097.132 ms 2024-04-01T16:44:09.415 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3676 0.05 MB/sec execute 306 sec latency 1374.147 ms 2024-04-01T16:44:10.416 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3686 0.05 MB/sec execute 307 sec latency 358.733 ms 2024-04-01T16:44:11.416 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3686 0.05 MB/sec execute 308 sec latency 1014.523 ms 2024-04-01T16:44:12.416 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3695 0.05 MB/sec execute 309 sec latency 1023.405 ms 2024-04-01T16:44:13.416 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3697 0.05 MB/sec execute 310 sec latency 503.749 ms 2024-04-01T16:44:14.420 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3707 0.05 MB/sec execute 311 sec latency 525.905 ms 2024-04-01T16:44:15.416 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3717 0.05 MB/sec execute 312 sec latency 375.931 ms 2024-04-01T16:44:16.416 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3738 0.05 MB/sec execute 313 sec latency 199.006 ms 2024-04-01T16:44:17.059 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:44:17.069 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:44:17.417 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3758 0.05 MB/sec execute 314 sec latency 721.516 ms 2024-04-01T16:44:18.417 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3760 0.05 MB/sec execute 315 sec latency 1130.250 ms 2024-04-01T16:44:19.417 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3771 0.05 MB/sec execute 316 sec latency 543.340 ms 2024-04-01T16:44:20.417 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3776 0.05 MB/sec execute 317 sec latency 427.594 ms 2024-04-01T16:44:21.417 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3781 0.05 MB/sec execute 318 sec latency 432.610 ms 2024-04-01T16:44:22.417 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3788 0.05 MB/sec execute 319 sec latency 481.705 ms 2024-04-01T16:44:23.418 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3790 0.05 MB/sec execute 320 sec latency 512.398 ms 2024-04-01T16:44:24.418 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3791 0.05 MB/sec execute 321 sec latency 839.476 ms 2024-04-01T16:44:25.418 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3796 0.05 MB/sec execute 322 sec latency 772.708 ms 2024-04-01T16:44:26.418 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3797 0.05 MB/sec execute 323 sec latency 612.965 ms 2024-04-01T16:44:27.418 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3804 0.05 MB/sec execute 324 sec latency 688.374 ms 2024-04-01T16:44:28.418 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3808 0.05 MB/sec execute 325 sec latency 396.017 ms 2024-04-01T16:44:29.418 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3814 0.05 MB/sec execute 326 sec latency 456.720 ms 2024-04-01T16:44:30.418 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3820 0.05 MB/sec execute 327 sec latency 313.053 ms 2024-04-01T16:44:31.418 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3824 0.05 MB/sec execute 328 sec latency 481.720 ms 2024-04-01T16:44:32.419 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3830 0.05 MB/sec execute 329 sec latency 417.934 ms 2024-04-01T16:44:33.419 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3835 0.05 MB/sec execute 330 sec latency 408.246 ms 2024-04-01T16:44:34.419 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3840 0.05 MB/sec execute 331 sec latency 421.736 ms 2024-04-01T16:44:35.419 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3845 0.05 MB/sec execute 332 sec latency 395.874 ms 2024-04-01T16:44:36.419 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3852 0.05 MB/sec execute 333 sec latency 347.401 ms 2024-04-01T16:44:37.419 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3856 0.05 MB/sec execute 334 sec latency 434.138 ms 2024-04-01T16:44:38.419 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3862 0.05 MB/sec execute 335 sec latency 434.384 ms 2024-04-01T16:44:39.420 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3868 0.05 MB/sec execute 336 sec latency 300.023 ms 2024-04-01T16:44:40.420 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3870 0.05 MB/sec execute 337 sec latency 595.441 ms 2024-04-01T16:44:41.420 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3874 0.05 MB/sec execute 338 sec latency 1055.537 ms 2024-04-01T16:44:42.420 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3876 0.05 MB/sec execute 339 sec latency 961.347 ms 2024-04-01T16:44:43.420 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3880 0.05 MB/sec execute 340 sec latency 1052.470 ms 2024-04-01T16:44:44.420 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3885 0.05 MB/sec execute 341 sec latency 390.582 ms 2024-04-01T16:44:45.420 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3896 0.05 MB/sec execute 342 sec latency 856.387 ms 2024-04-01T16:44:46.420 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3898 0.05 MB/sec execute 343 sec latency 1011.297 ms 2024-04-01T16:44:47.194 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:44:47.202 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:44:47.421 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3901 0.05 MB/sec execute 344 sec latency 1056.381 ms 2024-04-01T16:44:48.421 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3914 0.05 MB/sec execute 345 sec latency 230.126 ms 2024-04-01T16:44:49.421 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3915 0.05 MB/sec execute 346 sec latency 1021.395 ms 2024-04-01T16:44:50.421 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3922 0.05 MB/sec execute 347 sec latency 438.862 ms 2024-04-01T16:44:51.421 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3927 0.05 MB/sec execute 348 sec latency 408.477 ms 2024-04-01T16:44:52.421 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3932 0.05 MB/sec execute 349 sec latency 450.282 ms 2024-04-01T16:44:53.421 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3936 0.05 MB/sec execute 350 sec latency 615.103 ms 2024-04-01T16:44:54.422 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3938 0.05 MB/sec execute 351 sec latency 982.135 ms 2024-04-01T16:44:55.422 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3942 0.05 MB/sec execute 352 sec latency 546.393 ms 2024-04-01T16:44:56.422 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3944 0.05 MB/sec execute 353 sec latency 495.850 ms 2024-04-01T16:44:57.422 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3950 0.05 MB/sec execute 354 sec latency 641.395 ms 2024-04-01T16:44:58.422 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3954 0.05 MB/sec execute 355 sec latency 452.530 ms 2024-04-01T16:44:59.422 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3960 0.05 MB/sec execute 356 sec latency 379.166 ms 2024-04-01T16:45:00.422 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3967 0.05 MB/sec execute 357 sec latency 309.170 ms 2024-04-01T16:45:01.422 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3971 0.05 MB/sec execute 358 sec latency 452.594 ms 2024-04-01T16:45:02.423 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3976 0.05 MB/sec execute 359 sec latency 405.966 ms 2024-04-01T16:45:03.423 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3982 0.05 MB/sec execute 360 sec latency 298.788 ms 2024-04-01T16:45:04.423 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3987 0.05 MB/sec execute 361 sec latency 394.936 ms 2024-04-01T16:45:05.423 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3992 0.05 MB/sec execute 362 sec latency 441.936 ms 2024-04-01T16:45:06.423 INFO:tasks.workunit.client.0.smithi163.stdout: 1 3999 0.05 MB/sec execute 363 sec latency 323.319 ms 2024-04-01T16:45:07.423 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4002 0.05 MB/sec execute 364 sec latency 464.639 ms 2024-04-01T16:45:07.777 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:11:39.460 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:45:07.781 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:11:39.465 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:45:07.819 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:11:39.487 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:45:07.825 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:11:39.493 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:45:07.828 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:11:39.496 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:45:07.835 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:11:39.503 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:45:07.911 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:11:39.594 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:45:07.953 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:11:39.621 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:45:07.984 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:11:39.652 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:45:08.423 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4009 0.05 MB/sec execute 365 sec latency 418.510 ms 2024-04-01T16:45:09.423 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4014 0.05 MB/sec execute 366 sec latency 334.248 ms 2024-04-01T16:45:10.424 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4020 0.05 MB/sec execute 367 sec latency 390.484 ms 2024-04-01T16:45:11.424 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4023 0.05 MB/sec execute 368 sec latency 480.205 ms 2024-04-01T16:45:12.424 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4027 0.05 MB/sec execute 369 sec latency 667.246 ms 2024-04-01T16:45:13.424 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4028 0.05 MB/sec execute 370 sec latency 1027.408 ms 2024-04-01T16:45:14.424 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4032 0.05 MB/sec execute 371 sec latency 716.155 ms 2024-04-01T16:45:15.424 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4035 0.05 MB/sec execute 372 sec latency 974.096 ms 2024-04-01T16:45:16.424 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4037 0.05 MB/sec execute 373 sec latency 1048.947 ms 2024-04-01T16:45:17.318 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:45:17.326 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:45:17.424 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4043 0.05 MB/sec execute 374 sec latency 194.686 ms 2024-04-01T16:45:18.424 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4047 0.05 MB/sec execute 375 sec latency 521.223 ms 2024-04-01T16:45:19.425 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4058 0.05 MB/sec execute 376 sec latency 1065.426 ms 2024-04-01T16:45:20.425 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4060 0.05 MB/sec execute 377 sec latency 1013.809 ms 2024-04-01T16:45:21.425 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4063 0.05 MB/sec execute 378 sec latency 542.513 ms 2024-04-01T16:45:22.425 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4070 0.04 MB/sec execute 379 sec latency 193.856 ms 2024-04-01T16:45:23.425 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4071 0.04 MB/sec execute 380 sec latency 903.153 ms 2024-04-01T16:45:24.425 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4082 0.04 MB/sec execute 381 sec latency 1300.168 ms 2024-04-01T16:45:25.425 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4085 0.04 MB/sec execute 382 sec latency 1006.607 ms 2024-04-01T16:45:26.425 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4095 0.04 MB/sec execute 383 sec latency 417.854 ms 2024-04-01T16:45:27.426 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4108 0.04 MB/sec execute 384 sec latency 162.079 ms 2024-04-01T16:45:28.426 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4116 0.04 MB/sec execute 385 sec latency 419.159 ms 2024-04-01T16:45:29.426 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4120 0.04 MB/sec execute 386 sec latency 497.298 ms 2024-04-01T16:45:30.426 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4130 0.04 MB/sec execute 387 sec latency 217.874 ms 2024-04-01T16:45:31.426 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4141 0.04 MB/sec execute 388 sec latency 306.143 ms 2024-04-01T16:45:32.426 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4150 0.04 MB/sec execute 389 sec latency 291.065 ms 2024-04-01T16:45:33.426 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4157 0.04 MB/sec execute 390 sec latency 493.237 ms 2024-04-01T16:45:34.426 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4161 0.04 MB/sec execute 391 sec latency 490.773 ms 2024-04-01T16:45:35.426 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4167 0.04 MB/sec execute 392 sec latency 451.536 ms 2024-04-01T16:45:36.427 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4173 0.04 MB/sec execute 393 sec latency 388.389 ms 2024-04-01T16:45:37.427 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4176 0.04 MB/sec execute 394 sec latency 1114.501 ms 2024-04-01T16:45:38.427 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4179 0.04 MB/sec execute 395 sec latency 1019.518 ms 2024-04-01T16:45:39.427 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4181 0.04 MB/sec execute 396 sec latency 451.299 ms 2024-04-01T16:45:40.427 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4186 0.04 MB/sec execute 397 sec latency 1061.028 ms 2024-04-01T16:45:41.427 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4211 0.04 MB/sec execute 398 sec latency 1099.683 ms 2024-04-01T16:45:42.427 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4216 0.04 MB/sec execute 399 sec latency 849.409 ms 2024-04-01T16:45:43.427 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4217 0.04 MB/sec execute 400 sec latency 1047.389 ms 2024-04-01T16:45:44.427 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4221 0.04 MB/sec execute 401 sec latency 1503.453 ms 2024-04-01T16:45:45.428 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4225 0.04 MB/sec execute 402 sec latency 639.421 ms 2024-04-01T16:45:46.428 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4227 0.04 MB/sec execute 403 sec latency 977.474 ms 2024-04-01T16:45:47.428 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4250 0.04 MB/sec execute 404 sec latency 340.987 ms 2024-04-01T16:45:47.472 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:45:47.481 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:45:48.428 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4254 0.04 MB/sec execute 405 sec latency 946.512 ms 2024-04-01T16:45:49.428 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4254 0.04 MB/sec execute 406 sec latency 1001.533 ms 2024-04-01T16:45:50.428 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4270 0.04 MB/sec execute 407 sec latency 1082.457 ms 2024-04-01T16:45:51.428 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4281 0.04 MB/sec execute 408 sec latency 575.036 ms 2024-04-01T16:45:52.429 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4292 0.04 MB/sec execute 409 sec latency 648.249 ms 2024-04-01T16:45:53.429 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4311 0.04 MB/sec execute 410 sec latency 181.845 ms 2024-04-01T16:45:54.429 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4315 0.04 MB/sec execute 411 sec latency 618.714 ms 2024-04-01T16:45:55.429 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4317 0.04 MB/sec execute 412 sec latency 964.362 ms 2024-04-01T16:45:56.429 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4340 0.04 MB/sec execute 413 sec latency 1026.419 ms 2024-04-01T16:45:57.429 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4349 0.04 MB/sec execute 414 sec latency 414.678 ms 2024-04-01T16:45:58.429 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4351 0.04 MB/sec execute 415 sec latency 682.172 ms 2024-04-01T16:45:59.429 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4374 0.04 MB/sec execute 416 sec latency 347.033 ms 2024-04-01T16:46:00.430 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4383 0.04 MB/sec execute 417 sec latency 448.165 ms 2024-04-01T16:46:01.430 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4384 0.04 MB/sec execute 418 sec latency 1072.767 ms 2024-04-01T16:46:02.430 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4386 0.04 MB/sec execute 419 sec latency 1072.861 ms 2024-04-01T16:46:03.430 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4388 0.04 MB/sec execute 420 sec latency 678.892 ms 2024-04-01T16:46:04.430 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4393 0.04 MB/sec execute 421 sec latency 1092.725 ms 2024-04-01T16:46:05.430 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4423 0.04 MB/sec execute 422 sec latency 1074.614 ms 2024-04-01T16:46:06.430 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4424 0.04 MB/sec execute 423 sec latency 1078.496 ms 2024-04-01T16:46:07.430 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4424 0.04 MB/sec execute 424 sec latency 1011.202 ms 2024-04-01T16:46:08.431 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4432 0.04 MB/sec execute 425 sec latency 1194.276 ms 2024-04-01T16:46:09.431 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4432 0.04 MB/sec execute 426 sec latency 1083.096 ms 2024-04-01T16:46:10.431 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4440 0.04 MB/sec execute 427 sec latency 1350.133 ms 2024-04-01T16:46:11.431 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4450 0.04 MB/sec execute 428 sec latency 558.158 ms 2024-04-01T16:46:12.431 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4462 0.04 MB/sec execute 429 sec latency 1073.607 ms 2024-04-01T16:46:13.431 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4472 0.04 MB/sec execute 430 sec latency 426.458 ms 2024-04-01T16:46:14.432 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4474 0.04 MB/sec execute 431 sec latency 765.781 ms 2024-04-01T16:46:15.431 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4496 0.04 MB/sec execute 432 sec latency 268.115 ms 2024-04-01T16:46:16.432 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4497 0.04 MB/sec execute 433 sec latency 971.305 ms 2024-04-01T16:46:17.432 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4499 0.04 MB/sec execute 434 sec latency 995.761 ms 2024-04-01T16:46:17.618 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:46:17.627 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:46:18.432 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4501 0.04 MB/sec execute 435 sec latency 537.683 ms 2024-04-01T16:46:19.432 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4501 0.04 MB/sec execute 436 sec latency 1073.509 ms 2024-04-01T16:46:20.432 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4506 0.04 MB/sec execute 437 sec latency 1266.273 ms 2024-04-01T16:46:21.432 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4511 0.04 MB/sec execute 438 sec latency 1127.498 ms 2024-04-01T16:46:22.432 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4511 0.04 MB/sec execute 439 sec latency 1020.478 ms 2024-04-01T16:46:23.432 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4538 0.04 MB/sec execute 440 sec latency 1074.013 ms 2024-04-01T16:46:24.433 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4539 0.04 MB/sec execute 441 sec latency 812.349 ms 2024-04-01T16:46:25.433 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4552 0.04 MB/sec execute 442 sec latency 414.074 ms 2024-04-01T16:46:26.433 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4563 0.04 MB/sec execute 443 sec latency 383.792 ms 2024-04-01T16:46:27.433 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4567 0.04 MB/sec execute 444 sec latency 1084.906 ms 2024-04-01T16:46:28.433 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4596 0.04 MB/sec execute 445 sec latency 486.287 ms 2024-04-01T16:46:29.433 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4598 0.04 MB/sec execute 446 sec latency 1119.252 ms 2024-04-01T16:46:30.433 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4602 0.04 MB/sec execute 447 sec latency 734.132 ms 2024-04-01T16:46:31.433 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4614 0.04 MB/sec execute 448 sec latency 1062.638 ms 2024-04-01T16:46:32.434 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4615 0.04 MB/sec execute 449 sec latency 1002.320 ms 2024-04-01T16:46:33.434 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4615 0.04 MB/sec execute 450 sec latency 1006.052 ms 2024-04-01T16:46:34.434 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4616 0.04 MB/sec execute 451 sec latency 1146.644 ms 2024-04-01T16:46:35.434 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4618 0.04 MB/sec execute 452 sec latency 1678.387 ms 2024-04-01T16:46:36.434 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4628 0.04 MB/sec execute 453 sec latency 346.046 ms 2024-04-01T16:46:37.434 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4632 0.04 MB/sec execute 454 sec latency 365.917 ms 2024-04-01T16:46:38.434 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4654 0.04 MB/sec execute 455 sec latency 451.689 ms 2024-04-01T16:46:39.434 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4656 0.04 MB/sec execute 456 sec latency 901.457 ms 2024-04-01T16:46:40.435 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4667 0.04 MB/sec execute 457 sec latency 1133.435 ms 2024-04-01T16:46:41.435 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4668 0.04 MB/sec execute 458 sec latency 916.786 ms 2024-04-01T16:46:42.435 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4681 0.04 MB/sec execute 459 sec latency 1023.294 ms 2024-04-01T16:46:43.435 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4684 0.04 MB/sec execute 460 sec latency 1013.300 ms 2024-04-01T16:46:44.435 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4699 0.04 MB/sec execute 461 sec latency 380.661 ms 2024-04-01T16:46:45.435 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4714 0.04 MB/sec execute 462 sec latency 373.967 ms 2024-04-01T16:46:46.435 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4723 0.04 MB/sec execute 463 sec latency 610.532 ms 2024-04-01T16:46:47.435 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4724 0.04 MB/sec execute 464 sec latency 897.054 ms 2024-04-01T16:46:47.750 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:46:47.758 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:46:48.436 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4734 0.04 MB/sec execute 465 sec latency 1054.299 ms 2024-04-01T16:46:49.436 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4735 0.04 MB/sec execute 466 sec latency 1093.404 ms 2024-04-01T16:46:50.436 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4735 0.04 MB/sec execute 467 sec latency 1137.971 ms 2024-04-01T16:46:51.436 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4736 0.04 MB/sec execute 468 sec latency 1172.661 ms 2024-04-01T16:46:52.436 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4742 0.04 MB/sec execute 469 sec latency 1189.782 ms 2024-04-01T16:46:53.436 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4746 0.04 MB/sec execute 470 sec latency 499.757 ms 2024-04-01T16:46:54.436 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4756 0.04 MB/sec execute 471 sec latency 646.524 ms 2024-04-01T16:46:55.436 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4770 0.04 MB/sec execute 472 sec latency 420.329 ms 2024-04-01T16:46:56.437 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4771 0.04 MB/sec execute 473 sec latency 1095.010 ms 2024-04-01T16:46:57.437 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4781 0.04 MB/sec execute 474 sec latency 337.281 ms 2024-04-01T16:46:58.437 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4797 0.04 MB/sec execute 475 sec latency 380.991 ms 2024-04-01T16:46:59.437 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4810 0.04 MB/sec execute 476 sec latency 478.089 ms 2024-04-01T16:47:00.437 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4814 0.04 MB/sec execute 477 sec latency 544.424 ms 2024-04-01T16:47:01.437 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4817 0.04 MB/sec execute 478 sec latency 1089.018 ms 2024-04-01T16:47:02.437 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4836 0.04 MB/sec execute 479 sec latency 389.855 ms 2024-04-01T16:47:03.437 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4844 0.04 MB/sec execute 480 sec latency 377.586 ms 2024-04-01T16:47:04.438 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4844 0.04 MB/sec execute 481 sec latency 1377.743 ms 2024-04-01T16:47:05.438 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4846 0.04 MB/sec execute 482 sec latency 1577.586 ms 2024-04-01T16:47:06.438 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4847 0.04 MB/sec execute 483 sec latency 1039.196 ms 2024-04-01T16:47:07.438 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4850 0.04 MB/sec execute 484 sec latency 1103.392 ms 2024-04-01T16:47:08.438 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4942 0.05 MB/sec execute 485 sec latency 1048.987 ms 2024-04-01T16:47:09.438 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4942 0.05 MB/sec execute 486 sec latency 1019.206 ms 2024-04-01T16:47:10.438 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4943 0.05 MB/sec execute 487 sec latency 1073.515 ms 2024-04-01T16:47:11.438 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4947 0.05 MB/sec execute 488 sec latency 1018.811 ms 2024-04-01T16:47:12.439 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4951 0.05 MB/sec execute 489 sec latency 1042.681 ms 2024-04-01T16:47:13.439 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4953 0.05 MB/sec execute 490 sec latency 1025.977 ms 2024-04-01T16:47:14.439 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4961 0.04 MB/sec execute 491 sec latency 349.479 ms 2024-04-01T16:47:15.439 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4963 0.04 MB/sec execute 492 sec latency 563.083 ms 2024-04-01T16:47:16.439 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4969 0.04 MB/sec execute 493 sec latency 974.432 ms 2024-04-01T16:47:17.439 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4983 0.04 MB/sec execute 494 sec latency 624.684 ms 2024-04-01T16:47:17.882 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:47:17.890 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:47:18.440 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4985 0.04 MB/sec execute 495 sec latency 1065.644 ms 2024-04-01T16:47:19.440 INFO:tasks.workunit.client.0.smithi163.stdout: 1 4995 0.04 MB/sec execute 496 sec latency 469.796 ms 2024-04-01T16:47:20.440 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5012 0.04 MB/sec execute 497 sec latency 361.920 ms 2024-04-01T16:47:21.440 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5014 0.04 MB/sec execute 498 sec latency 741.943 ms 2024-04-01T16:47:22.440 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5028 0.04 MB/sec execute 499 sec latency 1019.691 ms 2024-04-01T16:47:23.440 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5032 0.04 MB/sec execute 500 sec latency 383.491 ms 2024-04-01T16:47:24.440 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5032 0.04 MB/sec execute 501 sec latency 1081.096 ms 2024-04-01T16:47:25.440 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5051 0.04 MB/sec execute 502 sec latency 1278.335 ms 2024-04-01T16:47:26.440 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5052 0.04 MB/sec execute 503 sec latency 1148.951 ms 2024-04-01T16:47:27.441 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5056 0.04 MB/sec execute 504 sec latency 365.857 ms 2024-04-01T16:47:28.441 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5058 0.04 MB/sec execute 505 sec latency 1043.435 ms 2024-04-01T16:47:29.441 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5067 0.04 MB/sec execute 506 sec latency 574.856 ms 2024-04-01T16:47:30.441 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5078 0.04 MB/sec execute 507 sec latency 336.996 ms 2024-04-01T16:47:31.442 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5089 0.04 MB/sec execute 508 sec latency 595.974 ms 2024-04-01T16:47:32.441 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5092 0.04 MB/sec execute 509 sec latency 593.925 ms 2024-04-01T16:47:33.441 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5096 0.04 MB/sec execute 510 sec latency 990.367 ms 2024-04-01T16:47:34.441 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5112 0.04 MB/sec execute 511 sec latency 994.323 ms 2024-04-01T16:47:35.442 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5120 0.04 MB/sec execute 512 sec latency 367.983 ms 2024-04-01T16:47:36.442 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5123 0.04 MB/sec execute 513 sec latency 1026.800 ms 2024-04-01T16:47:37.442 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5135 0.04 MB/sec execute 514 sec latency 194.897 ms 2024-04-01T16:47:38.442 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5149 0.04 MB/sec execute 515 sec latency 198.400 ms 2024-04-01T16:47:39.442 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5153 0.04 MB/sec execute 516 sec latency 263.559 ms 2024-04-01T16:47:40.442 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5154 0.04 MB/sec execute 517 sec latency 905.701 ms 2024-04-01T16:47:41.442 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5168 0.04 MB/sec execute 518 sec latency 1296.836 ms 2024-04-01T16:47:42.443 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5171 0.04 MB/sec execute 519 sec latency 678.267 ms 2024-04-01T16:47:43.443 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5175 0.04 MB/sec execute 520 sec latency 1063.117 ms 2024-04-01T16:47:44.443 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5178 0.04 MB/sec execute 521 sec latency 1108.140 ms 2024-04-01T16:47:45.443 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5182 0.04 MB/sec execute 522 sec latency 332.222 ms 2024-04-01T16:47:46.443 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5187 0.04 MB/sec execute 523 sec latency 1038.326 ms 2024-04-01T16:47:47.443 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5206 0.04 MB/sec execute 524 sec latency 322.784 ms 2024-04-01T16:47:48.011 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:47:48.019 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:47:48.443 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5208 0.04 MB/sec execute 525 sec latency 1007.749 ms 2024-04-01T16:47:49.443 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5209 0.04 MB/sec execute 526 sec latency 787.411 ms 2024-04-01T16:47:50.444 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5218 0.04 MB/sec execute 527 sec latency 1113.685 ms 2024-04-01T16:47:51.444 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5245 0.04 MB/sec execute 528 sec latency 548.167 ms 2024-04-01T16:47:52.444 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5251 0.04 MB/sec execute 529 sec latency 644.311 ms 2024-04-01T16:47:53.444 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5256 0.04 MB/sec execute 530 sec latency 739.709 ms 2024-04-01T16:47:54.444 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5264 0.04 MB/sec execute 531 sec latency 493.270 ms 2024-04-01T16:47:55.444 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5266 0.04 MB/sec execute 532 sec latency 706.979 ms 2024-04-01T16:47:56.444 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5272 0.04 MB/sec execute 533 sec latency 988.895 ms 2024-04-01T16:47:57.444 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5274 0.04 MB/sec execute 534 sec latency 1409.538 ms 2024-04-01T16:47:58.445 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5286 0.04 MB/sec execute 535 sec latency 211.435 ms 2024-04-01T16:47:59.445 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5304 0.04 MB/sec execute 536 sec latency 165.145 ms 2024-04-01T16:48:00.445 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5335 0.04 MB/sec execute 537 sec latency 264.855 ms 2024-04-01T16:48:01.445 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5337 0.04 MB/sec execute 538 sec latency 495.813 ms 2024-04-01T16:48:02.445 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5346 0.04 MB/sec execute 539 sec latency 1079.730 ms 2024-04-01T16:48:03.445 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5367 0.04 MB/sec execute 540 sec latency 179.729 ms 2024-04-01T16:48:04.445 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5371 0.04 MB/sec execute 541 sec latency 318.342 ms 2024-04-01T16:48:05.446 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5373 0.04 MB/sec execute 542 sec latency 1209.062 ms 2024-04-01T16:48:06.446 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5387 0.04 MB/sec execute 543 sec latency 364.315 ms 2024-04-01T16:48:07.446 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5388 0.04 MB/sec execute 544 sec latency 1129.234 ms 2024-04-01T16:48:08.446 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5391 0.04 MB/sec execute 545 sec latency 836.236 ms 2024-04-01T16:48:09.446 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5401 0.04 MB/sec execute 546 sec latency 1042.283 ms 2024-04-01T16:48:10.446 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5406 0.04 MB/sec execute 547 sec latency 325.030 ms 2024-04-01T16:48:11.446 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5408 0.04 MB/sec execute 548 sec latency 982.733 ms 2024-04-01T16:48:12.446 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5423 0.04 MB/sec execute 549 sec latency 517.872 ms 2024-04-01T16:48:13.446 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5424 0.04 MB/sec execute 550 sec latency 1060.828 ms 2024-04-01T16:48:14.446 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5427 0.04 MB/sec execute 551 sec latency 809.993 ms 2024-04-01T16:48:15.446 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5432 0.04 MB/sec execute 552 sec latency 1196.819 ms 2024-04-01T16:48:16.447 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5434 0.04 MB/sec execute 553 sec latency 533.910 ms 2024-04-01T16:48:17.447 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5449 0.04 MB/sec execute 554 sec latency 1030.710 ms 2024-04-01T16:48:18.150 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:48:18.159 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:48:18.447 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5463 0.04 MB/sec execute 555 sec latency 567.790 ms 2024-04-01T16:48:19.447 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5468 0.04 MB/sec execute 556 sec latency 959.398 ms 2024-04-01T16:48:20.447 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5474 0.04 MB/sec execute 557 sec latency 1033.852 ms 2024-04-01T16:48:21.447 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5477 0.04 MB/sec execute 558 sec latency 584.931 ms 2024-04-01T16:48:22.450 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5485 0.04 MB/sec execute 559 sec latency 1038.740 ms 2024-04-01T16:48:23.448 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5487 0.04 MB/sec execute 560 sec latency 1171.003 ms 2024-04-01T16:48:24.448 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5526 0.04 MB/sec execute 561 sec latency 229.005 ms 2024-04-01T16:48:25.448 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5538 0.04 MB/sec execute 562 sec latency 351.326 ms 2024-04-01T16:48:26.448 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5540 0.04 MB/sec execute 563 sec latency 809.079 ms 2024-04-01T16:48:27.448 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5554 0.04 MB/sec execute 564 sec latency 1084.374 ms 2024-04-01T16:48:28.448 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5562 0.04 MB/sec execute 565 sec latency 576.040 ms 2024-04-01T16:48:29.448 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5567 0.04 MB/sec execute 566 sec latency 1026.382 ms 2024-04-01T16:48:30.449 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5577 0.04 MB/sec execute 567 sec latency 398.387 ms 2024-04-01T16:48:31.449 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5589 0.04 MB/sec execute 568 sec latency 161.959 ms 2024-04-01T16:48:32.449 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5597 0.04 MB/sec execute 569 sec latency 280.269 ms 2024-04-01T16:48:33.449 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5598 0.04 MB/sec execute 570 sec latency 1229.831 ms 2024-04-01T16:48:34.449 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5605 0.04 MB/sec execute 571 sec latency 722.835 ms 2024-04-01T16:48:35.449 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5613 0.04 MB/sec execute 572 sec latency 1357.674 ms 2024-04-01T16:48:36.449 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5615 0.04 MB/sec execute 573 sec latency 1061.802 ms 2024-04-01T16:48:37.449 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5616 0.04 MB/sec execute 574 sec latency 1011.818 ms 2024-04-01T16:48:38.450 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5622 0.04 MB/sec execute 575 sec latency 199.358 ms 2024-04-01T16:48:39.450 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5623 0.04 MB/sec execute 576 sec latency 781.148 ms 2024-04-01T16:48:40.450 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5641 0.04 MB/sec execute 577 sec latency 1212.294 ms 2024-04-01T16:48:41.450 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5641 0.04 MB/sec execute 578 sec latency 1137.561 ms 2024-04-01T16:48:42.450 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5643 0.04 MB/sec execute 579 sec latency 1219.860 ms 2024-04-01T16:48:43.450 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5651 0.04 MB/sec execute 580 sec latency 1098.273 ms 2024-04-01T16:48:44.450 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5655 0.04 MB/sec execute 581 sec latency 817.158 ms 2024-04-01T16:48:45.451 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5658 0.04 MB/sec execute 582 sec latency 1291.860 ms 2024-04-01T16:48:46.451 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5666 0.04 MB/sec execute 583 sec latency 1042.433 ms 2024-04-01T16:48:47.451 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5700 0.04 MB/sec execute 584 sec latency 276.054 ms 2024-04-01T16:48:48.306 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:48:48.315 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:48:48.451 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5702 0.04 MB/sec execute 585 sec latency 711.249 ms 2024-04-01T16:48:49.451 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5708 0.04 MB/sec execute 586 sec latency 981.620 ms 2024-04-01T16:48:50.451 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5722 0.04 MB/sec execute 587 sec latency 1057.324 ms 2024-04-01T16:48:51.451 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5735 0.04 MB/sec execute 588 sec latency 595.200 ms 2024-04-01T16:48:52.451 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5737 0.04 MB/sec execute 589 sec latency 1024.634 ms 2024-04-01T16:48:53.452 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5738 0.04 MB/sec execute 590 sec latency 1348.636 ms 2024-04-01T16:48:54.452 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5743 0.04 MB/sec execute 591 sec latency 214.390 ms 2024-04-01T16:48:55.452 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5744 0.04 MB/sec execute 592 sec latency 646.984 ms 2024-04-01T16:48:56.452 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5759 0.04 MB/sec execute 593 sec latency 1013.296 ms 2024-04-01T16:48:57.452 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5763 0.04 MB/sec execute 594 sec latency 431.439 ms 2024-04-01T16:48:58.452 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5782 0.04 MB/sec execute 595 sec latency 377.445 ms 2024-04-01T16:48:59.452 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5790 0.04 MB/sec execute 596 sec latency 1070.278 ms 2024-04-01T16:49:00.452 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5823 0.04 MB/sec execute 597 sec latency 182.003 ms 2024-04-01T16:49:01.452 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5853 0.04 MB/sec execute 598 sec latency 213.329 ms 2024-04-01T16:49:02.452 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5855 0.04 MB/sec execute 599 sec latency 1071.802 ms 2024-04-01T16:49:03.453 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 600 sec 2024-04-01T16:49:04.453 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 601 sec 2024-04-01T16:49:05.453 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 602 sec 2024-04-01T16:49:06.453 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 603 sec 2024-04-01T16:49:07.453 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 604 sec 2024-04-01T16:49:08.453 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 605 sec 2024-04-01T16:49:09.453 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 606 sec 2024-04-01T16:49:10.454 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 607 sec 2024-04-01T16:49:11.454 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 608 sec 2024-04-01T16:49:12.454 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 609 sec 2024-04-01T16:49:13.454 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 610 sec 2024-04-01T16:49:14.454 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 611 sec 2024-04-01T16:49:15.454 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 612 sec 2024-04-01T16:49:16.454 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 613 sec 2024-04-01T16:49:17.258 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:15:48.941 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:49:17.292 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:15:48.959 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:49:17.308 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:15:48.976 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:49:17.359 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:15:49.041 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:49:17.366 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:15:49.034 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:49:17.392 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:15:49.059 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:49:17.454 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 614 sec 2024-04-01T16:49:17.484 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:15:49.152 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:49:17.515 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:15:49.198 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:49:17.580 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:15:49.247 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:49:18.444 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:49:18.452 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:49:18.454 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 615 sec 2024-04-01T16:49:19.455 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 616 sec 2024-04-01T16:49:20.455 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 617 sec 2024-04-01T16:49:21.455 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 618 sec 2024-04-01T16:49:22.455 INFO:tasks.workunit.client.0.smithi163.stdout: 1 cleanup 619 sec 2024-04-01T16:49:22.912 INFO:tasks.workunit.client.0.smithi163.stdout: 0 cleanup 620 sec 2024-04-01T16:49:22.912 INFO:tasks.workunit.client.0.smithi163.stdout: 2024-04-01T16:49:22.912 INFO:tasks.workunit.client.0.smithi163.stdout: Operation Count AvgLat MaxLat 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: ---------------------------------------- 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: NTCreateX 836 192.263 982.105 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: Close 636 4.262 36.277 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: Rename 30 568.896 812.326 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: Unlink 141 203.662 497.274 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: Qpathinfo 802 102.869 839.455 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: Qfileinfo 135 3.679 15.886 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: Qfsinfo 109 19.897 116.706 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: Sfileinfo 57 39.838 48.028 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: Find 272 1070.334 1943.517 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: WriteX 392 13.108 300.831 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: ReadX 1201 0.163 6.931 2024-04-01T16:49:22.913 INFO:tasks.workunit.client.0.smithi163.stdout: LockX 2 75.031 116.076 2024-04-01T16:49:22.914 INFO:tasks.workunit.client.0.smithi163.stdout: UnlockX 2 59.428 84.261 2024-04-01T16:49:22.914 INFO:tasks.workunit.client.0.smithi163.stdout: Flush 49 138.241 279.446 2024-04-01T16:49:22.914 INFO:tasks.workunit.client.0.smithi163.stdout: 2024-04-01T16:49:22.914 INFO:tasks.workunit.client.0.smithi163.stdout:Throughput 0.0397844 MB/sec 1 clients 1 procs max_latency=1943.540 ms 2024-04-01T16:49:22.914 INFO:tasks.workunit.client.0.smithi163.stderr:+ dbench 10 2024-04-01T16:49:22.915 INFO:tasks.workunit.client.0.smithi163.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-01T16:49:22.915 INFO:tasks.workunit.client.0.smithi163.stdout: 2024-04-01T16:49:22.915 INFO:tasks.workunit.client.0.smithi163.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-01T16:49:22.919 INFO:tasks.workunit.client.0.smithi163.stdout:9 of 10 processes prepared for launch 0 sec 2024-04-01T16:49:23.020 INFO:tasks.workunit.client.0.smithi163.stdout:10 of 10 processes prepared for launch 0 sec 2024-04-01T16:49:23.020 INFO:tasks.workunit.client.0.smithi163.stdout:releasing clients 2024-04-01T16:49:24.020 INFO:tasks.workunit.client.0.smithi163.stdout: 0 1 0.00 MB/sec warmup 1 sec latency 999.604 ms 2024-04-01T16:49:25.020 INFO:tasks.workunit.client.0.smithi163.stdout: 0 2 0.00 MB/sec warmup 2 sec latency 1999.706 ms 2024-04-01T16:49:26.020 INFO:tasks.workunit.client.0.smithi163.stdout: 0 3 0.00 MB/sec warmup 3 sec latency 2999.825 ms 2024-04-01T16:49:27.020 INFO:tasks.workunit.client.0.smithi163.stdout: 0 4 0.00 MB/sec warmup 4 sec latency 3999.934 ms 2024-04-01T16:49:28.020 INFO:tasks.workunit.client.0.smithi163.stdout: 1 5 0.17 MB/sec warmup 5 sec latency 5000.063 ms 2024-04-01T16:49:29.021 INFO:tasks.workunit.client.0.smithi163.stdout: 2 9 0.35 MB/sec warmup 6 sec latency 4950.987 ms 2024-04-01T16:49:30.026 INFO:tasks.workunit.client.0.smithi163.stdout: 2 12 0.38 MB/sec warmup 7 sec latency 1283.431 ms 2024-04-01T16:49:31.021 INFO:tasks.workunit.client.0.smithi163.stdout: 2 14 0.43 MB/sec warmup 8 sec latency 1563.275 ms 2024-04-01T16:49:32.021 INFO:tasks.workunit.client.0.smithi163.stdout: 2 16 0.47 MB/sec warmup 9 sec latency 1490.930 ms 2024-04-01T16:49:33.021 INFO:tasks.workunit.client.0.smithi163.stdout: 2 19 0.52 MB/sec warmup 10 sec latency 1431.445 ms 2024-04-01T16:49:34.021 INFO:tasks.workunit.client.0.smithi163.stdout: 3 22 0.58 MB/sec warmup 11 sec latency 1619.461 ms 2024-04-01T16:49:35.021 INFO:tasks.workunit.client.0.smithi163.stdout: 6 27 0.69 MB/sec warmup 12 sec latency 1571.629 ms 2024-04-01T16:49:36.021 INFO:tasks.workunit.client.0.smithi163.stdout: 7 32 0.88 MB/sec warmup 13 sec latency 1942.353 ms 2024-04-01T16:49:37.021 INFO:tasks.workunit.client.0.smithi163.stdout: 9 37 0.97 MB/sec warmup 14 sec latency 2378.125 ms 2024-04-01T16:49:38.022 INFO:tasks.workunit.client.0.smithi163.stdout: 10 43 1.12 MB/sec warmup 15 sec latency 2118.104 ms 2024-04-01T16:49:39.022 INFO:tasks.workunit.client.0.smithi163.stdout: 10 49 1.23 MB/sec warmup 16 sec latency 2136.869 ms 2024-04-01T16:49:40.022 INFO:tasks.workunit.client.0.smithi163.stdout: 10 53 1.31 MB/sec warmup 17 sec latency 1992.824 ms 2024-04-01T16:49:41.022 INFO:tasks.workunit.client.0.smithi163.stdout: 10 58 1.35 MB/sec warmup 18 sec latency 2270.427 ms 2024-04-01T16:49:42.022 INFO:tasks.workunit.client.0.smithi163.stdout: 10 64 1.44 MB/sec warmup 19 sec latency 1933.277 ms 2024-04-01T16:49:43.022 INFO:tasks.workunit.client.0.smithi163.stdout: 10 69 1.51 MB/sec warmup 20 sec latency 2202.986 ms 2024-04-01T16:49:44.022 INFO:tasks.workunit.client.0.smithi163.stdout: 10 72 1.54 MB/sec warmup 21 sec latency 2342.885 ms 2024-04-01T16:49:45.022 INFO:tasks.workunit.client.0.smithi163.stdout: 10 77 1.55 MB/sec warmup 22 sec latency 2730.535 ms 2024-04-01T16:49:46.022 INFO:tasks.workunit.client.0.smithi163.stdout: 10 82 1.60 MB/sec warmup 23 sec latency 3288.201 ms 2024-04-01T16:49:47.023 INFO:tasks.workunit.client.0.smithi163.stdout: 10 86 1.60 MB/sec warmup 24 sec latency 2760.006 ms 2024-04-01T16:49:48.023 INFO:tasks.workunit.client.0.smithi163.stdout: 10 91 1.66 MB/sec warmup 25 sec latency 2055.040 ms 2024-04-01T16:49:48.574 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:49:48.582 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:49:49.023 INFO:tasks.workunit.client.0.smithi163.stdout: 10 96 1.68 MB/sec warmup 26 sec latency 2450.620 ms 2024-04-01T16:49:50.023 INFO:tasks.workunit.client.0.smithi163.stdout: 10 100 1.70 MB/sec warmup 27 sec latency 2042.348 ms 2024-04-01T16:49:51.023 INFO:tasks.workunit.client.0.smithi163.stdout: 10 104 1.71 MB/sec warmup 28 sec latency 2249.161 ms 2024-04-01T16:49:52.023 INFO:tasks.workunit.client.0.smithi163.stdout: 10 109 1.74 MB/sec warmup 29 sec latency 2636.977 ms 2024-04-01T16:49:53.023 INFO:tasks.workunit.client.0.smithi163.stdout: 10 114 1.76 MB/sec warmup 30 sec latency 2489.862 ms 2024-04-01T16:49:54.023 INFO:tasks.workunit.client.0.smithi163.stdout: 10 117 1.74 MB/sec warmup 31 sec latency 2111.480 ms 2024-04-01T16:49:55.023 INFO:tasks.workunit.client.0.smithi163.stdout: 10 118 1.70 MB/sec warmup 32 sec latency 2264.713 ms 2024-04-01T16:49:56.024 INFO:tasks.workunit.client.0.smithi163.stdout: 10 119 1.65 MB/sec warmup 33 sec latency 2380.229 ms 2024-04-01T16:49:57.024 INFO:tasks.workunit.client.0.smithi163.stdout: 10 119 1.60 MB/sec warmup 34 sec latency 3157.993 ms 2024-04-01T16:49:58.024 INFO:tasks.workunit.client.0.smithi163.stdout: 10 121 1.57 MB/sec warmup 35 sec latency 4099.003 ms 2024-04-01T16:49:59.024 INFO:tasks.workunit.client.0.smithi163.stdout: 10 124 1.55 MB/sec warmup 36 sec latency 4385.416 ms 2024-04-01T16:50:00.024 INFO:tasks.workunit.client.0.smithi163.stdout: 10 127 1.54 MB/sec warmup 37 sec latency 4090.656 ms 2024-04-01T16:50:01.027 INFO:tasks.workunit.client.0.smithi163.stdout: 10 130 1.52 MB/sec warmup 38 sec latency 2564.913 ms 2024-04-01T16:50:02.024 INFO:tasks.workunit.client.0.smithi163.stdout: 10 133 1.51 MB/sec warmup 39 sec latency 2478.404 ms 2024-04-01T16:50:03.025 INFO:tasks.workunit.client.0.smithi163.stdout: 10 137 1.51 MB/sec warmup 40 sec latency 2196.080 ms 2024-04-01T16:50:04.025 INFO:tasks.workunit.client.0.smithi163.stdout: 10 139 1.48 MB/sec warmup 41 sec latency 1961.045 ms 2024-04-01T16:50:05.025 INFO:tasks.workunit.client.0.smithi163.stdout: 10 140 1.45 MB/sec warmup 42 sec latency 2488.040 ms 2024-04-01T16:50:06.025 INFO:tasks.workunit.client.0.smithi163.stdout: 10 141 1.42 MB/sec warmup 43 sec latency 3182.171 ms 2024-04-01T16:50:07.025 INFO:tasks.workunit.client.0.smithi163.stdout: 10 143 1.40 MB/sec warmup 44 sec latency 3880.174 ms 2024-04-01T16:50:08.025 INFO:tasks.workunit.client.0.smithi163.stdout: 10 143 1.37 MB/sec warmup 45 sec latency 4268.676 ms 2024-04-01T16:50:09.025 INFO:tasks.workunit.client.0.smithi163.stdout: 10 146 1.36 MB/sec warmup 46 sec latency 4088.134 ms 2024-04-01T16:50:10.026 INFO:tasks.workunit.client.0.smithi163.stdout: 10 148 1.35 MB/sec warmup 47 sec latency 3392.426 ms 2024-04-01T16:50:11.025 INFO:tasks.workunit.client.0.smithi163.stdout: 10 149 1.32 MB/sec warmup 48 sec latency 3182.793 ms 2024-04-01T16:50:12.026 INFO:tasks.workunit.client.0.smithi163.stdout: 10 152 1.31 MB/sec warmup 49 sec latency 3619.610 ms 2024-04-01T16:50:13.026 INFO:tasks.workunit.client.0.smithi163.stdout: 10 157 1.32 MB/sec warmup 50 sec latency 3877.211 ms 2024-04-01T16:50:14.026 INFO:tasks.workunit.client.0.smithi163.stdout: 10 158 1.30 MB/sec warmup 51 sec latency 2269.980 ms 2024-04-01T16:50:15.026 INFO:tasks.workunit.client.0.smithi163.stdout: 10 160 1.29 MB/sec warmup 52 sec latency 2571.045 ms 2024-04-01T16:50:16.026 INFO:tasks.workunit.client.0.smithi163.stdout: 10 163 1.28 MB/sec warmup 53 sec latency 2645.935 ms 2024-04-01T16:50:17.026 INFO:tasks.workunit.client.0.smithi163.stdout: 10 163 1.25 MB/sec warmup 54 sec latency 3004.665 ms 2024-04-01T16:50:18.026 INFO:tasks.workunit.client.0.smithi163.stdout: 10 163 1.23 MB/sec warmup 55 sec latency 3516.545 ms 2024-04-01T16:50:18.695 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:50:18.705 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:50:19.026 INFO:tasks.workunit.client.0.smithi163.stdout: 10 165 1.22 MB/sec warmup 56 sec latency 4046.857 ms 2024-04-01T16:50:20.026 INFO:tasks.workunit.client.0.smithi163.stdout: 10 169 1.22 MB/sec warmup 57 sec latency 4641.582 ms 2024-04-01T16:50:21.026 INFO:tasks.workunit.client.0.smithi163.stdout: 10 171 1.21 MB/sec warmup 58 sec latency 4430.377 ms 2024-04-01T16:50:22.027 INFO:tasks.workunit.client.0.smithi163.stdout: 10 173 1.20 MB/sec warmup 59 sec latency 2911.324 ms 2024-04-01T16:50:23.027 INFO:tasks.workunit.client.0.smithi163.stdout: 10 175 1.18 MB/sec warmup 60 sec latency 3598.701 ms 2024-04-01T16:50:24.027 INFO:tasks.workunit.client.0.smithi163.stdout: 10 179 1.19 MB/sec warmup 61 sec latency 2729.583 ms 2024-04-01T16:50:25.027 INFO:tasks.workunit.client.0.smithi163.stdout: 10 181 1.18 MB/sec warmup 62 sec latency 2003.133 ms 2024-04-01T16:50:26.027 INFO:tasks.workunit.client.0.smithi163.stdout: 10 183 1.17 MB/sec warmup 63 sec latency 2686.902 ms 2024-04-01T16:50:27.027 INFO:tasks.workunit.client.0.smithi163.stdout: 10 186 1.17 MB/sec warmup 64 sec latency 3394.916 ms 2024-04-01T16:50:28.027 INFO:tasks.workunit.client.0.smithi163.stdout: 10 188 1.16 MB/sec warmup 65 sec latency 4062.366 ms 2024-04-01T16:50:29.028 INFO:tasks.workunit.client.0.smithi163.stdout: 10 188 1.14 MB/sec warmup 66 sec latency 4168.704 ms 2024-04-01T16:50:30.028 INFO:tasks.workunit.client.0.smithi163.stdout: 10 189 1.13 MB/sec warmup 67 sec latency 4380.305 ms 2024-04-01T16:50:31.028 INFO:tasks.workunit.client.0.smithi163.stdout: 10 193 1.13 MB/sec warmup 68 sec latency 4756.087 ms 2024-04-01T16:50:32.028 INFO:tasks.workunit.client.0.smithi163.stdout: 10 196 1.13 MB/sec warmup 69 sec latency 4201.367 ms 2024-04-01T16:50:33.028 INFO:tasks.workunit.client.0.smithi163.stdout: 10 196 1.11 MB/sec warmup 70 sec latency 3408.735 ms 2024-04-01T16:50:34.032 INFO:tasks.workunit.client.0.smithi163.stdout: 10 196 1.10 MB/sec warmup 71 sec latency 4186.549 ms 2024-04-01T16:50:35.028 INFO:tasks.workunit.client.0.smithi163.stdout: 10 202 1.11 MB/sec warmup 72 sec latency 3858.630 ms 2024-04-01T16:50:36.028 INFO:tasks.workunit.client.0.smithi163.stdout: 10 203 1.10 MB/sec warmup 73 sec latency 2209.829 ms 2024-04-01T16:50:37.029 INFO:tasks.workunit.client.0.smithi163.stdout: 10 204 1.09 MB/sec warmup 74 sec latency 2801.989 ms 2024-04-01T16:50:38.029 INFO:tasks.workunit.client.0.smithi163.stdout: 10 204 1.07 MB/sec warmup 75 sec latency 3417.567 ms 2024-04-01T16:50:39.029 INFO:tasks.workunit.client.0.smithi163.stdout: 10 205 1.07 MB/sec warmup 76 sec latency 4417.672 ms 2024-04-01T16:50:40.029 INFO:tasks.workunit.client.0.smithi163.stdout: 10 208 1.06 MB/sec warmup 77 sec latency 4652.019 ms 2024-04-01T16:50:41.029 INFO:tasks.workunit.client.0.smithi163.stdout: 10 209 1.05 MB/sec warmup 78 sec latency 2048.773 ms 2024-04-01T16:50:42.029 INFO:tasks.workunit.client.0.smithi163.stdout: 10 211 1.04 MB/sec warmup 79 sec latency 2921.296 ms 2024-04-01T16:50:43.029 INFO:tasks.workunit.client.0.smithi163.stdout: 10 215 1.05 MB/sec warmup 80 sec latency 3176.728 ms 2024-04-01T16:50:44.029 INFO:tasks.workunit.client.0.smithi163.stdout: 10 218 1.04 MB/sec warmup 81 sec latency 2475.974 ms 2024-04-01T16:50:45.030 INFO:tasks.workunit.client.0.smithi163.stdout: 10 220 1.04 MB/sec warmup 82 sec latency 2213.928 ms 2024-04-01T16:50:46.030 INFO:tasks.workunit.client.0.smithi163.stdout: 10 224 1.04 MB/sec warmup 83 sec latency 2513.863 ms 2024-04-01T16:50:47.030 INFO:tasks.workunit.client.0.smithi163.stdout: 10 225 1.04 MB/sec warmup 84 sec latency 2955.633 ms 2024-04-01T16:50:48.030 INFO:tasks.workunit.client.0.smithi163.stdout: 10 226 1.03 MB/sec warmup 85 sec latency 3584.718 ms 2024-04-01T16:50:48.817 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:50:48.825 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:50:49.030 INFO:tasks.workunit.client.0.smithi163.stdout: 10 227 1.02 MB/sec warmup 86 sec latency 4035.301 ms 2024-04-01T16:50:50.030 INFO:tasks.workunit.client.0.smithi163.stdout: 10 231 1.02 MB/sec warmup 87 sec latency 4119.679 ms 2024-04-01T16:50:51.030 INFO:tasks.workunit.client.0.smithi163.stdout: 10 234 1.02 MB/sec warmup 88 sec latency 2391.566 ms 2024-04-01T16:50:52.030 INFO:tasks.workunit.client.0.smithi163.stdout: 10 236 1.02 MB/sec warmup 89 sec latency 2503.209 ms 2024-04-01T16:50:53.030 INFO:tasks.workunit.client.0.smithi163.stdout: 10 237 1.01 MB/sec warmup 90 sec latency 2982.223 ms 2024-04-01T16:50:54.031 INFO:tasks.workunit.client.0.smithi163.stdout: 10 242 1.02 MB/sec warmup 91 sec latency 2920.673 ms 2024-04-01T16:50:55.031 INFO:tasks.workunit.client.0.smithi163.stdout: 10 244 1.01 MB/sec warmup 92 sec latency 2750.255 ms 2024-04-01T16:50:55.157 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:17:26.840 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:50:55.180 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:17:26.863 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:50:55.272 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:17:26.955 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:50:55.285 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:17:26.953 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:50:55.288 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:17:26.956 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:50:55.291 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:17:26.959 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:50:55.301 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:17:26.968 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:50:55.338 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:17:27.006 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:50:55.402 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:17:27.070 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:50:56.031 INFO:tasks.workunit.client.0.smithi163.stdout: 10 246 1.01 MB/sec warmup 93 sec latency 2533.845 ms 2024-04-01T16:50:57.031 INFO:tasks.workunit.client.0.smithi163.stdout: 10 250 1.01 MB/sec warmup 94 sec latency 3119.162 ms 2024-04-01T16:50:58.031 INFO:tasks.workunit.client.0.smithi163.stdout: 10 251 1.00 MB/sec warmup 95 sec latency 3252.975 ms 2024-04-01T16:50:59.031 INFO:tasks.workunit.client.0.smithi163.stdout: 10 251 1.00 MB/sec warmup 96 sec latency 3851.778 ms 2024-04-01T16:51:00.031 INFO:tasks.workunit.client.0.smithi163.stdout: 10 253 0.99 MB/sec warmup 97 sec latency 4568.689 ms 2024-04-01T16:51:01.031 INFO:tasks.workunit.client.0.smithi163.stdout: 10 256 0.99 MB/sec warmup 98 sec latency 4316.596 ms 2024-04-01T16:51:02.032 INFO:tasks.workunit.client.0.smithi163.stdout: 10 259 0.99 MB/sec warmup 99 sec latency 4196.432 ms 2024-04-01T16:51:03.032 INFO:tasks.workunit.client.0.smithi163.stdout: 10 260 0.98 MB/sec warmup 100 sec latency 2901.185 ms 2024-04-01T16:51:04.032 INFO:tasks.workunit.client.0.smithi163.stdout: 10 263 0.98 MB/sec warmup 101 sec latency 3216.339 ms 2024-04-01T16:51:05.032 INFO:tasks.workunit.client.0.smithi163.stdout: 10 268 0.99 MB/sec warmup 102 sec latency 2690.709 ms 2024-04-01T16:51:06.032 INFO:tasks.workunit.client.0.smithi163.stdout: 10 268 0.98 MB/sec warmup 103 sec latency 2282.469 ms 2024-04-01T16:51:07.032 INFO:tasks.workunit.client.0.smithi163.stdout: 10 268 0.97 MB/sec warmup 104 sec latency 2987.047 ms 2024-04-01T16:51:08.032 INFO:tasks.workunit.client.0.smithi163.stdout: 10 268 0.96 MB/sec warmup 105 sec latency 3987.168 ms 2024-04-01T16:51:09.032 INFO:tasks.workunit.client.0.smithi163.stdout: 10 268 0.95 MB/sec warmup 106 sec latency 4987.259 ms 2024-04-01T16:51:10.033 INFO:tasks.workunit.client.0.smithi163.stdout: 10 270 0.95 MB/sec warmup 107 sec latency 5680.203 ms 2024-04-01T16:51:11.033 INFO:tasks.workunit.client.0.smithi163.stdout: 10 274 0.95 MB/sec warmup 108 sec latency 6282.812 ms 2024-04-01T16:51:12.033 INFO:tasks.workunit.client.0.smithi163.stdout: 10 276 0.95 MB/sec warmup 109 sec latency 1909.999 ms 2024-04-01T16:51:13.033 INFO:tasks.workunit.client.0.smithi163.stdout: 10 277 0.94 MB/sec warmup 110 sec latency 2762.346 ms 2024-04-01T16:51:14.033 INFO:tasks.workunit.client.0.smithi163.stdout: 10 282 0.95 MB/sec warmup 111 sec latency 2724.117 ms 2024-04-01T16:51:15.033 INFO:tasks.workunit.client.0.smithi163.stdout: 10 284 0.95 MB/sec warmup 112 sec latency 2649.373 ms 2024-04-01T16:51:16.033 INFO:tasks.workunit.client.0.smithi163.stdout: 10 286 0.94 MB/sec warmup 113 sec latency 2156.763 ms 2024-04-01T16:51:17.033 INFO:tasks.workunit.client.0.smithi163.stdout: 10 290 0.95 MB/sec warmup 114 sec latency 2561.495 ms 2024-04-01T16:51:18.034 INFO:tasks.workunit.client.0.smithi163.stdout: 10 291 0.94 MB/sec warmup 115 sec latency 2768.430 ms 2024-04-01T16:51:18.951 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:51:18.959 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:51:19.034 INFO:tasks.workunit.client.0.smithi163.stdout: 10 291 0.93 MB/sec warmup 116 sec latency 3768.533 ms 2024-04-01T16:51:20.034 INFO:tasks.workunit.client.0.smithi163.stdout: 10 291 0.92 MB/sec warmup 117 sec latency 4768.663 ms 2024-04-01T16:51:21.034 INFO:tasks.workunit.client.0.smithi163.stdout: 10 291 0.92 MB/sec warmup 118 sec latency 5768.793 ms 2024-04-01T16:51:22.034 INFO:tasks.workunit.client.0.smithi163.stdout: 10 294 0.92 MB/sec warmup 119 sec latency 5799.233 ms 2024-04-01T16:51:24.035 INFO:tasks.workunit.client.0.smithi163.stdout: 10 298 0.26 MB/sec execute 1 sec latency 5213.993 ms 2024-04-01T16:51:25.035 INFO:tasks.workunit.client.0.smithi163.stdout: 10 301 0.49 MB/sec execute 2 sec latency 3328.961 ms 2024-04-01T16:51:26.034 INFO:tasks.workunit.client.0.smithi163.stdout: 10 303 0.52 MB/sec execute 3 sec latency 3797.878 ms 2024-04-01T16:51:27.035 INFO:tasks.workunit.client.0.smithi163.stdout: 10 304 0.47 MB/sec execute 4 sec latency 3230.087 ms 2024-04-01T16:51:28.035 INFO:tasks.workunit.client.0.smithi163.stdout: 10 308 0.66 MB/sec execute 5 sec latency 2904.205 ms 2024-04-01T16:51:29.035 INFO:tasks.workunit.client.0.smithi163.stdout: 10 309 0.56 MB/sec execute 6 sec latency 3595.023 ms 2024-04-01T16:51:30.035 INFO:tasks.workunit.client.0.smithi163.stdout: 10 311 0.58 MB/sec execute 7 sec latency 3599.146 ms 2024-04-01T16:51:31.035 INFO:tasks.workunit.client.0.smithi163.stdout: 10 315 0.68 MB/sec execute 8 sec latency 3313.306 ms 2024-04-01T16:51:32.035 INFO:tasks.workunit.client.0.smithi163.stdout: 10 317 0.66 MB/sec execute 9 sec latency 3443.810 ms 2024-04-01T16:51:33.035 INFO:tasks.workunit.client.0.smithi163.stdout: 10 318 0.62 MB/sec execute 10 sec latency 2930.139 ms 2024-04-01T16:51:34.036 INFO:tasks.workunit.client.0.smithi163.stdout: 10 319 0.59 MB/sec execute 11 sec latency 3741.916 ms 2024-04-01T16:51:35.036 INFO:tasks.workunit.client.0.smithi163.stdout: 10 324 0.67 MB/sec execute 12 sec latency 3748.411 ms 2024-04-01T16:51:36.036 INFO:tasks.workunit.client.0.smithi163.stdout: 10 324 0.62 MB/sec execute 13 sec latency 2175.323 ms 2024-04-01T16:51:37.036 INFO:tasks.workunit.client.0.smithi163.stdout: 10 325 0.61 MB/sec execute 14 sec latency 2741.354 ms 2024-04-01T16:51:38.036 INFO:tasks.workunit.client.0.smithi163.stdout: 10 328 0.62 MB/sec execute 15 sec latency 3704.951 ms 2024-04-01T16:51:39.036 INFO:tasks.workunit.client.0.smithi163.stdout: 10 329 0.60 MB/sec execute 16 sec latency 4058.807 ms 2024-04-01T16:51:40.036 INFO:tasks.workunit.client.0.smithi163.stdout: 10 329 0.57 MB/sec execute 17 sec latency 5058.905 ms 2024-04-01T16:51:41.036 INFO:tasks.workunit.client.0.smithi163.stdout: 10 331 0.56 MB/sec execute 18 sec latency 5181.511 ms 2024-04-01T16:51:42.036 INFO:tasks.workunit.client.0.smithi163.stdout: 10 335 0.60 MB/sec execute 19 sec latency 3840.266 ms 2024-04-01T16:51:43.037 INFO:tasks.workunit.client.0.smithi163.stdout: 10 337 0.60 MB/sec execute 20 sec latency 2168.749 ms 2024-04-01T16:51:44.036 INFO:tasks.workunit.client.0.smithi163.stdout: 10 339 0.59 MB/sec execute 21 sec latency 2449.426 ms 2024-04-01T16:51:45.037 INFO:tasks.workunit.client.0.smithi163.stdout: 10 344 0.64 MB/sec execute 22 sec latency 2492.283 ms 2024-04-01T16:51:46.037 INFO:tasks.workunit.client.0.smithi163.stdout: 10 346 0.64 MB/sec execute 23 sec latency 2485.067 ms 2024-04-01T16:51:47.037 INFO:tasks.workunit.client.0.smithi163.stdout: 10 346 0.62 MB/sec execute 24 sec latency 2565.043 ms 2024-04-01T16:51:48.037 INFO:tasks.workunit.client.0.smithi163.stdout: 10 347 0.59 MB/sec execute 25 sec latency 3459.246 ms 2024-04-01T16:51:49.037 INFO:tasks.workunit.client.0.smithi163.stdout: 10 351 0.63 MB/sec execute 26 sec latency 3717.135 ms 2024-04-01T16:51:49.084 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:51:49.093 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:51:50.037 INFO:tasks.workunit.client.0.smithi163.stdout: 10 354 0.64 MB/sec execute 27 sec latency 3973.689 ms 2024-04-01T16:51:51.037 INFO:tasks.workunit.client.0.smithi163.stdout: 10 355 0.62 MB/sec execute 28 sec latency 2808.842 ms 2024-04-01T16:51:52.037 INFO:tasks.workunit.client.0.smithi163.stdout: 10 356 0.62 MB/sec execute 29 sec latency 3809.004 ms 2024-04-01T16:51:53.038 INFO:tasks.workunit.client.0.smithi163.stdout: 10 357 0.60 MB/sec execute 30 sec latency 4427.831 ms 2024-04-01T16:51:54.038 INFO:tasks.workunit.client.0.smithi163.stdout: 10 358 0.60 MB/sec execute 31 sec latency 4605.866 ms 2024-04-01T16:51:55.038 INFO:tasks.workunit.client.0.smithi163.stdout: 10 361 0.60 MB/sec execute 32 sec latency 5310.511 ms 2024-04-01T16:51:56.038 INFO:tasks.workunit.client.0.smithi163.stdout: 10 361 0.59 MB/sec execute 33 sec latency 6297.942 ms 2024-04-01T16:51:57.038 INFO:tasks.workunit.client.0.smithi163.stdout: 10 365 0.60 MB/sec execute 34 sec latency 6360.408 ms 2024-04-01T16:51:58.038 INFO:tasks.workunit.client.0.smithi163.stdout: 10 366 0.60 MB/sec execute 35 sec latency 4403.940 ms 2024-04-01T16:51:59.039 INFO:tasks.workunit.client.0.smithi163.stdout: 10 369 0.61 MB/sec execute 36 sec latency 4528.085 ms 2024-04-01T16:52:00.038 INFO:tasks.workunit.client.0.smithi163.stdout: 10 372 0.62 MB/sec execute 37 sec latency 3513.236 ms 2024-04-01T16:52:01.039 INFO:tasks.workunit.client.0.smithi163.stdout: 10 374 0.62 MB/sec execute 38 sec latency 4331.380 ms 2024-04-01T16:52:02.039 INFO:tasks.workunit.client.0.smithi163.stdout: 10 378 0.63 MB/sec execute 39 sec latency 2683.924 ms 2024-04-01T16:52:03.039 INFO:tasks.workunit.client.0.smithi163.stdout: 10 378 0.62 MB/sec execute 40 sec latency 2874.637 ms 2024-04-01T16:52:04.039 INFO:tasks.workunit.client.0.smithi163.stdout: 10 378 0.61 MB/sec execute 41 sec latency 3874.773 ms 2024-04-01T16:52:05.039 INFO:tasks.workunit.client.0.smithi163.stdout: 10 381 0.61 MB/sec execute 42 sec latency 4283.898 ms 2024-04-01T16:52:06.039 INFO:tasks.workunit.client.0.smithi163.stdout: 10 383 0.60 MB/sec execute 43 sec latency 4787.898 ms 2024-04-01T16:52:07.039 INFO:tasks.workunit.client.0.smithi163.stdout: 10 386 0.63 MB/sec execute 44 sec latency 2762.667 ms 2024-04-01T16:52:08.039 INFO:tasks.workunit.client.0.smithi163.stdout: 10 387 0.62 MB/sec execute 45 sec latency 3726.191 ms 2024-04-01T16:52:09.040 INFO:tasks.workunit.client.0.smithi163.stdout: 10 389 0.62 MB/sec execute 46 sec latency 3821.720 ms 2024-04-01T16:52:10.040 INFO:tasks.workunit.client.0.smithi163.stdout: 10 389 0.60 MB/sec execute 47 sec latency 3732.187 ms 2024-04-01T16:52:11.040 INFO:tasks.workunit.client.0.smithi163.stdout: 10 391 0.60 MB/sec execute 48 sec latency 4531.776 ms 2024-04-01T16:52:12.040 INFO:tasks.workunit.client.0.smithi163.stdout: 10 397 0.63 MB/sec execute 49 sec latency 4698.920 ms 2024-04-01T16:52:13.040 INFO:tasks.workunit.client.0.smithi163.stdout: 10 397 0.62 MB/sec execute 50 sec latency 2048.459 ms 2024-04-01T16:52:14.040 INFO:tasks.workunit.client.0.smithi163.stdout: 10 397 0.61 MB/sec execute 51 sec latency 3048.606 ms 2024-04-01T16:52:15.040 INFO:tasks.workunit.client.0.smithi163.stdout: 10 397 0.60 MB/sec execute 52 sec latency 4048.747 ms 2024-04-01T16:52:16.041 INFO:tasks.workunit.client.0.smithi163.stdout: 10 403 0.62 MB/sec execute 53 sec latency 4186.885 ms 2024-04-01T16:52:17.041 INFO:tasks.workunit.client.0.smithi163.stdout: 10 405 0.62 MB/sec execute 54 sec latency 1590.886 ms 2024-04-01T16:52:18.041 INFO:tasks.workunit.client.0.smithi163.stdout: 10 405 0.61 MB/sec execute 55 sec latency 2591.022 ms 2024-04-01T16:52:19.042 INFO:tasks.workunit.client.0.smithi163.stdout: 10 405 0.60 MB/sec execute 56 sec latency 3465.313 ms 2024-04-01T16:52:19.223 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:52:19.232 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:52:20.042 INFO:tasks.workunit.client.0.smithi163.stdout: 10 405 0.59 MB/sec execute 57 sec latency 4465.408 ms 2024-04-01T16:52:21.041 INFO:tasks.workunit.client.0.smithi163.stdout: 10 406 0.59 MB/sec execute 58 sec latency 5222.593 ms 2024-04-01T16:52:22.042 INFO:tasks.workunit.client.0.smithi163.stdout: 10 409 0.60 MB/sec execute 59 sec latency 5801.748 ms 2024-04-01T16:52:23.042 INFO:tasks.workunit.client.0.smithi163.stdout: 10 413 0.60 MB/sec execute 60 sec latency 6419.432 ms 2024-04-01T16:52:24.042 INFO:tasks.workunit.client.0.smithi163.stdout: 10 414 0.60 MB/sec execute 61 sec latency 2744.184 ms 2024-04-01T16:52:25.042 INFO:tasks.workunit.client.0.smithi163.stdout: 10 416 0.60 MB/sec execute 62 sec latency 2674.465 ms 2024-04-01T16:52:26.042 INFO:tasks.workunit.client.0.smithi163.stdout: 10 421 0.62 MB/sec execute 63 sec latency 2816.516 ms 2024-04-01T16:52:27.043 INFO:tasks.workunit.client.0.smithi163.stdout: 10 422 0.61 MB/sec execute 64 sec latency 3517.886 ms 2024-04-01T16:52:28.042 INFO:tasks.workunit.client.0.smithi163.stdout: 10 422 0.60 MB/sec execute 65 sec latency 2953.501 ms 2024-04-01T16:52:29.042 INFO:tasks.workunit.client.0.smithi163.stdout: 10 425 0.60 MB/sec execute 66 sec latency 3629.830 ms 2024-04-01T16:52:30.043 INFO:tasks.workunit.client.0.smithi163.stdout: 10 428 0.61 MB/sec execute 67 sec latency 4247.280 ms 2024-04-01T16:52:31.043 INFO:tasks.workunit.client.0.smithi163.stdout: 10 430 0.62 MB/sec execute 68 sec latency 4615.109 ms 2024-04-01T16:52:32.043 INFO:tasks.workunit.client.0.smithi163.stdout: 10 431 0.61 MB/sec execute 69 sec latency 2830.488 ms 2024-04-01T16:52:33.043 INFO:tasks.workunit.client.0.smithi163.stdout: 10 433 0.61 MB/sec execute 70 sec latency 3694.701 ms 2024-04-01T16:52:34.043 INFO:tasks.workunit.client.0.smithi163.stdout: 10 436 0.62 MB/sec execute 71 sec latency 3950.063 ms 2024-04-01T16:52:35.043 INFO:tasks.workunit.client.0.smithi163.stdout: 10 439 0.62 MB/sec execute 72 sec latency 4165.273 ms 2024-04-01T16:52:36.043 INFO:tasks.workunit.client.0.smithi163.stdout: 10 440 0.62 MB/sec execute 73 sec latency 2873.112 ms 2024-04-01T16:52:37.043 INFO:tasks.workunit.client.0.smithi163.stdout: 10 442 0.62 MB/sec execute 74 sec latency 3166.255 ms 2024-04-01T16:52:38.043 INFO:tasks.workunit.client.0.smithi163.stdout: 10 442 0.61 MB/sec execute 75 sec latency 4082.943 ms 2024-04-01T16:52:39.043 INFO:tasks.workunit.client.0.smithi163.stdout: 10 446 0.62 MB/sec execute 76 sec latency 4491.483 ms 2024-04-01T16:52:40.043 INFO:tasks.workunit.client.0.smithi163.stdout: 10 447 0.61 MB/sec execute 77 sec latency 5134.480 ms 2024-04-01T16:52:41.044 INFO:tasks.workunit.client.0.smithi163.stdout: 10 449 0.61 MB/sec execute 78 sec latency 5915.428 ms 2024-04-01T16:52:42.044 INFO:tasks.workunit.client.0.smithi163.stdout: 10 449 0.61 MB/sec execute 79 sec latency 5225.202 ms 2024-04-01T16:52:43.044 INFO:tasks.workunit.client.0.smithi163.stdout: 10 452 0.61 MB/sec execute 80 sec latency 5603.216 ms 2024-04-01T16:52:44.044 INFO:tasks.workunit.client.0.smithi163.stdout: 10 455 0.62 MB/sec execute 81 sec latency 4839.155 ms 2024-04-01T16:52:45.044 INFO:tasks.workunit.client.0.smithi163.stdout: 10 456 0.61 MB/sec execute 82 sec latency 4020.925 ms 2024-04-01T16:52:46.044 INFO:tasks.workunit.client.0.smithi163.stdout: 10 458 0.61 MB/sec execute 83 sec latency 4838.838 ms 2024-04-01T16:52:47.044 INFO:tasks.workunit.client.0.smithi163.stdout: 10 462 0.62 MB/sec execute 84 sec latency 3220.402 ms 2024-04-01T16:52:48.044 INFO:tasks.workunit.client.0.smithi163.stdout: 10 463 0.62 MB/sec execute 85 sec latency 3438.513 ms 2024-04-01T16:52:49.045 INFO:tasks.workunit.client.0.smithi163.stdout: 10 463 0.61 MB/sec execute 86 sec latency 4066.937 ms 2024-04-01T16:52:49.406 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:52:49.414 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:52:50.045 INFO:tasks.workunit.client.0.smithi163.stdout: 10 466 0.61 MB/sec execute 87 sec latency 4105.801 ms 2024-04-01T16:52:51.045 INFO:tasks.workunit.client.0.smithi163.stdout: 10 469 0.62 MB/sec execute 88 sec latency 4222.227 ms 2024-04-01T16:52:52.045 INFO:tasks.workunit.client.0.smithi163.stdout: 10 471 0.62 MB/sec execute 89 sec latency 3766.845 ms 2024-04-01T16:52:53.045 INFO:tasks.workunit.client.0.smithi163.stdout: 10 472 0.62 MB/sec execute 90 sec latency 3270.096 ms 2024-04-01T16:52:54.045 INFO:tasks.workunit.client.0.smithi163.stdout: 10 474 0.62 MB/sec execute 91 sec latency 3274.656 ms 2024-04-01T16:52:55.045 INFO:tasks.workunit.client.0.smithi163.stdout: 10 477 0.62 MB/sec execute 92 sec latency 3669.483 ms 2024-04-01T16:52:56.046 INFO:tasks.workunit.client.0.smithi163.stdout: 10 479 0.62 MB/sec execute 93 sec latency 3441.313 ms 2024-04-01T16:52:57.046 INFO:tasks.workunit.client.0.smithi163.stdout: 10 481 0.62 MB/sec execute 94 sec latency 3502.683 ms 2024-04-01T16:52:58.046 INFO:tasks.workunit.client.0.smithi163.stdout: 10 483 0.62 MB/sec execute 95 sec latency 3376.151 ms 2024-04-01T16:52:59.046 INFO:tasks.workunit.client.0.smithi163.stdout: 10 484 0.62 MB/sec execute 96 sec latency 3739.748 ms 2024-04-01T16:53:00.046 INFO:tasks.workunit.client.0.smithi163.stdout: 10 484 0.61 MB/sec execute 97 sec latency 4483.192 ms 2024-04-01T16:53:01.046 INFO:tasks.workunit.client.0.smithi163.stdout: 10 486 0.61 MB/sec execute 98 sec latency 5483.285 ms 2024-04-01T16:53:02.046 INFO:tasks.workunit.client.0.smithi163.stdout: 10 491 0.62 MB/sec execute 99 sec latency 5635.066 ms 2024-04-01T16:53:03.046 INFO:tasks.workunit.client.0.smithi163.stdout: 10 492 0.62 MB/sec execute 100 sec latency 1952.476 ms 2024-04-01T16:53:04.047 INFO:tasks.workunit.client.0.smithi163.stdout: 10 493 0.61 MB/sec execute 101 sec latency 2952.604 ms 2024-04-01T16:53:05.047 INFO:tasks.workunit.client.0.smithi163.stdout: 10 494 0.61 MB/sec execute 102 sec latency 3757.627 ms 2024-04-01T16:53:06.047 INFO:tasks.workunit.client.0.smithi163.stdout: 10 498 0.62 MB/sec execute 103 sec latency 4162.328 ms 2024-04-01T16:53:07.047 INFO:tasks.workunit.client.0.smithi163.stdout: 10 502 0.63 MB/sec execute 104 sec latency 2388.924 ms 2024-04-01T16:53:08.047 INFO:tasks.workunit.client.0.smithi163.stdout: 10 502 0.62 MB/sec execute 105 sec latency 3024.817 ms 2024-04-01T16:53:09.047 INFO:tasks.workunit.client.0.smithi163.stdout: 10 503 0.62 MB/sec execute 106 sec latency 3525.429 ms 2024-04-01T16:53:10.047 INFO:tasks.workunit.client.0.smithi163.stdout: 10 504 0.61 MB/sec execute 107 sec latency 4014.304 ms 2024-04-01T16:53:11.047 INFO:tasks.workunit.client.0.smithi163.stdout: 10 506 0.61 MB/sec execute 108 sec latency 4935.110 ms 2024-04-01T16:53:12.047 INFO:tasks.workunit.client.0.smithi163.stdout: 10 511 0.62 MB/sec execute 109 sec latency 4936.330 ms 2024-04-01T16:53:13.048 INFO:tasks.workunit.client.0.smithi163.stdout: 10 517 0.63 MB/sec execute 110 sec latency 3782.444 ms 2024-04-01T16:53:14.048 INFO:tasks.workunit.client.0.smithi163.stdout: 10 517 0.63 MB/sec execute 111 sec latency 2965.721 ms 2024-04-01T16:53:15.048 INFO:tasks.workunit.client.0.smithi163.stdout: 10 518 0.62 MB/sec execute 112 sec latency 3881.999 ms 2024-04-01T16:53:16.048 INFO:tasks.workunit.client.0.smithi163.stdout: 10 520 0.63 MB/sec execute 113 sec latency 4356.893 ms 2024-04-01T16:53:17.048 INFO:tasks.workunit.client.0.smithi163.stdout: 10 524 0.63 MB/sec execute 114 sec latency 4616.706 ms 2024-04-01T16:53:18.048 INFO:tasks.workunit.client.0.smithi163.stdout: 10 526 0.64 MB/sec execute 115 sec latency 5036.300 ms 2024-04-01T16:53:19.048 INFO:tasks.workunit.client.0.smithi163.stdout: 10 527 0.63 MB/sec execute 116 sec latency 6036.389 ms 2024-04-01T16:53:19.527 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:53:19.536 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:53:20.048 INFO:tasks.workunit.client.0.smithi163.stdout: 10 529 0.63 MB/sec execute 117 sec latency 7036.518 ms 2024-04-01T16:53:21.049 INFO:tasks.workunit.client.0.smithi163.stdout: 10 536 0.63 MB/sec execute 118 sec latency 8036.643 ms 2024-04-01T16:53:22.049 INFO:tasks.workunit.client.0.smithi163.stdout: 10 541 0.65 MB/sec execute 119 sec latency 8334.574 ms 2024-04-01T16:53:23.049 INFO:tasks.workunit.client.0.smithi163.stdout: 10 548 0.67 MB/sec execute 120 sec latency 1710.680 ms 2024-04-01T16:53:24.049 INFO:tasks.workunit.client.0.smithi163.stdout: 10 551 0.68 MB/sec execute 121 sec latency 2564.680 ms 2024-04-01T16:53:24.811 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:19:56.494 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:53:24.821 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:19:56.503 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:53:24.929 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:19:56.597 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:53:24.930 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:19:56.598 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:53:24.932 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:19:56.600 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:53:24.933 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:19:56.617 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:53:24.938 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:19:56.606 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:53:25.032 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:19:56.700 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:53:25.037 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:19:56.705 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:53:25.049 INFO:tasks.workunit.client.0.smithi163.stdout: 10 555 0.68 MB/sec execute 122 sec latency 2907.055 ms 2024-04-01T16:53:26.049 INFO:tasks.workunit.client.0.smithi163.stdout: 10 560 0.69 MB/sec execute 123 sec latency 2679.293 ms 2024-04-01T16:53:27.049 INFO:tasks.workunit.client.0.smithi163.stdout: 10 567 0.69 MB/sec execute 124 sec latency 3272.762 ms 2024-04-01T16:53:28.051 INFO:tasks.workunit.client.0.smithi163.stdout: 10 573 0.71 MB/sec execute 125 sec latency 3833.149 ms 2024-04-01T16:53:29.050 INFO:tasks.workunit.client.0.smithi163.stdout: 10 579 0.72 MB/sec execute 126 sec latency 4221.730 ms 2024-04-01T16:53:30.050 INFO:tasks.workunit.client.0.smithi163.stdout: 10 584 0.73 MB/sec execute 127 sec latency 4672.293 ms 2024-04-01T16:53:31.050 INFO:tasks.workunit.client.0.smithi163.stdout: 10 587 0.73 MB/sec execute 128 sec latency 3890.259 ms 2024-04-01T16:53:32.050 INFO:tasks.workunit.client.0.smithi163.stdout: 10 590 0.73 MB/sec execute 129 sec latency 3895.000 ms 2024-04-01T16:53:33.050 INFO:tasks.workunit.client.0.smithi163.stdout: 10 593 0.74 MB/sec execute 130 sec latency 3589.314 ms 2024-04-01T16:53:34.050 INFO:tasks.workunit.client.0.smithi163.stdout: 10 598 0.74 MB/sec execute 131 sec latency 4313.688 ms 2024-04-01T16:53:35.050 INFO:tasks.workunit.client.0.smithi163.stdout: 10 601 0.74 MB/sec execute 132 sec latency 4708.698 ms 2024-04-01T16:53:36.050 INFO:tasks.workunit.client.0.smithi163.stdout: 10 604 0.74 MB/sec execute 133 sec latency 5429.867 ms 2024-04-01T16:53:37.050 INFO:tasks.workunit.client.0.smithi163.stdout: 10 609 0.74 MB/sec execute 134 sec latency 5322.545 ms 2024-04-01T16:53:38.051 INFO:tasks.workunit.client.0.smithi163.stdout: 10 611 0.74 MB/sec execute 135 sec latency 5483.489 ms 2024-04-01T16:53:39.051 INFO:tasks.workunit.client.0.smithi163.stdout: 10 612 0.73 MB/sec execute 136 sec latency 5511.754 ms 2024-04-01T16:53:40.051 INFO:tasks.workunit.client.0.smithi163.stdout: 10 613 0.73 MB/sec execute 137 sec latency 4631.229 ms 2024-04-01T16:53:41.051 INFO:tasks.workunit.client.0.smithi163.stdout: 10 613 0.72 MB/sec execute 138 sec latency 5478.470 ms 2024-04-01T16:53:42.051 INFO:tasks.workunit.client.0.smithi163.stdout: 10 614 0.72 MB/sec execute 139 sec latency 5456.196 ms 2024-04-01T16:53:43.051 INFO:tasks.workunit.client.0.smithi163.stdout: 10 618 0.71 MB/sec execute 140 sec latency 5567.766 ms 2024-04-01T16:53:44.051 INFO:tasks.workunit.client.0.smithi163.stdout: 10 621 0.71 MB/sec execute 141 sec latency 4668.494 ms 2024-04-01T16:53:45.051 INFO:tasks.workunit.client.0.smithi163.stdout: 10 624 0.71 MB/sec execute 142 sec latency 5302.868 ms 2024-04-01T16:53:46.052 INFO:tasks.workunit.client.0.smithi163.stdout: 10 626 0.70 MB/sec execute 143 sec latency 4952.011 ms 2024-04-01T16:53:47.051 INFO:tasks.workunit.client.0.smithi163.stdout: 10 630 0.70 MB/sec execute 144 sec latency 4213.767 ms 2024-04-01T16:53:48.052 INFO:tasks.workunit.client.0.smithi163.stdout: 10 632 0.69 MB/sec execute 145 sec latency 4793.927 ms 2024-04-01T16:53:49.052 INFO:tasks.workunit.client.0.smithi163.stdout: 10 635 0.69 MB/sec execute 146 sec latency 4761.153 ms 2024-04-01T16:53:49.658 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:53:49.669 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:53:50.052 INFO:tasks.workunit.client.0.smithi163.stdout: 10 635 0.68 MB/sec execute 147 sec latency 5628.947 ms 2024-04-01T16:53:51.052 INFO:tasks.workunit.client.0.smithi163.stdout: 10 638 0.68 MB/sec execute 148 sec latency 5510.480 ms 2024-04-01T16:53:52.052 INFO:tasks.workunit.client.0.smithi163.stdout: 10 641 0.68 MB/sec execute 149 sec latency 5449.379 ms 2024-04-01T16:53:53.052 INFO:tasks.workunit.client.0.smithi163.stdout: 10 642 0.67 MB/sec execute 150 sec latency 5192.209 ms 2024-04-01T16:53:54.052 INFO:tasks.workunit.client.0.smithi163.stdout: 10 642 0.67 MB/sec execute 151 sec latency 6192.304 ms 2024-04-01T16:53:55.052 INFO:tasks.workunit.client.0.smithi163.stdout: 10 642 0.66 MB/sec execute 152 sec latency 6907.088 ms 2024-04-01T16:53:56.053 INFO:tasks.workunit.client.0.smithi163.stdout: 10 643 0.66 MB/sec execute 153 sec latency 5402.317 ms 2024-04-01T16:53:57.053 INFO:tasks.workunit.client.0.smithi163.stdout: 10 646 0.65 MB/sec execute 154 sec latency 5066.708 ms 2024-04-01T16:53:58.053 INFO:tasks.workunit.client.0.smithi163.stdout: 10 647 0.65 MB/sec execute 155 sec latency 5469.907 ms 2024-04-01T16:53:59.053 INFO:tasks.workunit.client.0.smithi163.stdout: 10 648 0.65 MB/sec execute 156 sec latency 5557.292 ms 2024-04-01T16:54:00.053 INFO:tasks.workunit.client.0.smithi163.stdout: 10 648 0.64 MB/sec execute 157 sec latency 5561.156 ms 2024-04-01T16:54:01.053 INFO:tasks.workunit.client.0.smithi163.stdout: 10 649 0.64 MB/sec execute 158 sec latency 5881.122 ms 2024-04-01T16:54:02.053 INFO:tasks.workunit.client.0.smithi163.stdout: 10 650 0.63 MB/sec execute 159 sec latency 4523.406 ms 2024-04-01T16:54:03.053 INFO:tasks.workunit.client.0.smithi163.stdout: 10 651 0.63 MB/sec execute 160 sec latency 5523.537 ms 2024-04-01T16:54:04.053 INFO:tasks.workunit.client.0.smithi163.stdout: 10 651 0.63 MB/sec execute 161 sec latency 6523.629 ms 2024-04-01T16:54:05.054 INFO:tasks.workunit.client.0.smithi163.stdout: 10 652 0.62 MB/sec execute 162 sec latency 7523.759 ms 2024-04-01T16:54:06.054 INFO:tasks.workunit.client.0.smithi163.stdout: 10 653 0.62 MB/sec execute 163 sec latency 8122.793 ms 2024-04-01T16:54:07.054 INFO:tasks.workunit.client.0.smithi163.stdout: 10 654 0.61 MB/sec execute 164 sec latency 7520.426 ms 2024-04-01T16:54:08.054 INFO:tasks.workunit.client.0.smithi163.stdout: 10 655 0.61 MB/sec execute 165 sec latency 5622.334 ms 2024-04-01T16:54:09.054 INFO:tasks.workunit.client.0.smithi163.stdout: 10 655 0.61 MB/sec execute 166 sec latency 6622.491 ms 2024-04-01T16:54:10.055 INFO:tasks.workunit.client.0.smithi163.stdout: 10 656 0.60 MB/sec execute 167 sec latency 7128.279 ms 2024-04-01T16:54:11.055 INFO:tasks.workunit.client.0.smithi163.stdout: 10 658 0.60 MB/sec execute 168 sec latency 4744.376 ms 2024-04-01T16:54:12.055 INFO:tasks.workunit.client.0.smithi163.stdout: 10 659 0.60 MB/sec execute 169 sec latency 5174.249 ms 2024-04-01T16:54:13.055 INFO:tasks.workunit.client.0.smithi163.stdout: 10 663 0.60 MB/sec execute 170 sec latency 5939.174 ms 2024-04-01T16:54:14.055 INFO:tasks.workunit.client.0.smithi163.stdout: 10 664 0.59 MB/sec execute 171 sec latency 6132.791 ms 2024-04-01T16:54:15.055 INFO:tasks.workunit.client.0.smithi163.stdout: 10 666 0.59 MB/sec execute 172 sec latency 6952.183 ms 2024-04-01T16:54:16.055 INFO:tasks.workunit.client.0.smithi163.stdout: 10 668 0.59 MB/sec execute 173 sec latency 5997.683 ms 2024-04-01T16:54:17.055 INFO:tasks.workunit.client.0.smithi163.stdout: 10 670 0.58 MB/sec execute 174 sec latency 4170.563 ms 2024-04-01T16:54:18.055 INFO:tasks.workunit.client.0.smithi163.stdout: 10 671 0.58 MB/sec execute 175 sec latency 5170.659 ms 2024-04-01T16:54:19.055 INFO:tasks.workunit.client.0.smithi163.stdout: 10 674 0.58 MB/sec execute 176 sec latency 6170.755 ms 2024-04-01T16:54:19.796 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:54:19.807 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:54:20.055 INFO:tasks.workunit.client.0.smithi163.stdout: 10 674 0.57 MB/sec execute 177 sec latency 7170.851 ms 2024-04-01T16:54:21.056 INFO:tasks.workunit.client.0.smithi163.stdout: 10 675 0.57 MB/sec execute 178 sec latency 7800.801 ms 2024-04-01T16:54:22.056 INFO:tasks.workunit.client.0.smithi163.stdout: 10 678 0.57 MB/sec execute 179 sec latency 7264.476 ms 2024-04-01T16:54:23.056 INFO:tasks.workunit.client.0.smithi163.stdout: 10 679 0.57 MB/sec execute 180 sec latency 6248.695 ms 2024-04-01T16:54:24.056 INFO:tasks.workunit.client.0.smithi163.stdout: 10 680 0.56 MB/sec execute 181 sec latency 6486.911 ms 2024-04-01T16:54:25.056 INFO:tasks.workunit.client.0.smithi163.stdout: 10 681 0.56 MB/sec execute 182 sec latency 6681.423 ms 2024-04-01T16:54:26.056 INFO:tasks.workunit.client.0.smithi163.stdout: 10 682 0.56 MB/sec execute 183 sec latency 6045.318 ms 2024-04-01T16:54:27.056 INFO:tasks.workunit.client.0.smithi163.stdout: 10 683 0.55 MB/sec execute 184 sec latency 4622.759 ms 2024-04-01T16:54:28.056 INFO:tasks.workunit.client.0.smithi163.stdout: 10 685 0.55 MB/sec execute 185 sec latency 5452.867 ms 2024-04-01T16:54:29.056 INFO:tasks.workunit.client.0.smithi163.stdout: 10 687 0.55 MB/sec execute 186 sec latency 5212.027 ms 2024-04-01T16:54:30.057 INFO:tasks.workunit.client.0.smithi163.stdout: 10 689 0.55 MB/sec execute 187 sec latency 5209.014 ms 2024-04-01T16:54:31.064 INFO:tasks.workunit.client.0.smithi163.stdout: 10 691 0.54 MB/sec execute 188 sec latency 5891.377 ms 2024-04-01T16:54:32.058 INFO:tasks.workunit.client.0.smithi163.stdout: 10 694 0.54 MB/sec execute 189 sec latency 6000.609 ms 2024-04-01T16:54:33.057 INFO:tasks.workunit.client.0.smithi163.stdout: 10 697 0.54 MB/sec execute 190 sec latency 4955.360 ms 2024-04-01T16:54:34.057 INFO:tasks.workunit.client.0.smithi163.stdout: 10 699 0.53 MB/sec execute 191 sec latency 5748.809 ms 2024-04-01T16:54:35.057 INFO:tasks.workunit.client.0.smithi163.stdout: 10 701 0.53 MB/sec execute 192 sec latency 1765.210 ms 2024-04-01T16:54:36.057 INFO:tasks.workunit.client.0.smithi163.stdout: 10 703 0.53 MB/sec execute 193 sec latency 2290.518 ms 2024-04-01T16:54:37.057 INFO:tasks.workunit.client.0.smithi163.stdout: 10 705 0.53 MB/sec execute 194 sec latency 2985.622 ms 2024-04-01T16:54:38.057 INFO:tasks.workunit.client.0.smithi163.stdout: 10 707 0.52 MB/sec execute 195 sec latency 3954.675 ms 2024-04-01T16:54:39.058 INFO:tasks.workunit.client.0.smithi163.stdout: 10 708 0.52 MB/sec execute 196 sec latency 1845.645 ms 2024-04-01T16:54:40.058 INFO:tasks.workunit.client.0.smithi163.stdout: 10 710 0.52 MB/sec execute 197 sec latency 2718.281 ms 2024-04-01T16:54:41.058 INFO:tasks.workunit.client.0.smithi163.stdout: 10 712 0.52 MB/sec execute 198 sec latency 3498.585 ms 2024-04-01T16:54:42.058 INFO:tasks.workunit.client.0.smithi163.stdout: 10 714 0.51 MB/sec execute 199 sec latency 4342.290 ms 2024-04-01T16:54:43.058 INFO:tasks.workunit.client.0.smithi163.stdout: 10 717 0.51 MB/sec execute 200 sec latency 4715.789 ms 2024-04-01T16:54:44.058 INFO:tasks.workunit.client.0.smithi163.stdout: 10 718 0.51 MB/sec execute 201 sec latency 5558.987 ms 2024-04-01T16:54:45.059 INFO:tasks.workunit.client.0.smithi163.stdout: 10 719 0.51 MB/sec execute 202 sec latency 6559.123 ms 2024-04-01T16:54:46.058 INFO:tasks.workunit.client.0.smithi163.stdout: 10 719 0.51 MB/sec execute 203 sec latency 7559.227 ms 2024-04-01T16:54:47.059 INFO:tasks.workunit.client.0.smithi163.stdout: 10 721 0.50 MB/sec execute 204 sec latency 8559.364 ms 2024-04-01T16:54:48.059 INFO:tasks.workunit.client.0.smithi163.stdout: 10 723 0.50 MB/sec execute 205 sec latency 9349.732 ms 2024-04-01T16:54:49.059 INFO:tasks.workunit.client.0.smithi163.stdout: 10 726 0.50 MB/sec execute 206 sec latency 2283.929 ms 2024-04-01T16:54:49.962 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:54:49.970 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:54:50.059 INFO:tasks.workunit.client.0.smithi163.stdout: 10 727 0.50 MB/sec execute 207 sec latency 2459.079 ms 2024-04-01T16:54:51.059 INFO:tasks.workunit.client.0.smithi163.stdout: 10 728 0.49 MB/sec execute 208 sec latency 3123.372 ms 2024-04-01T16:54:52.059 INFO:tasks.workunit.client.0.smithi163.stdout: 10 730 0.49 MB/sec execute 209 sec latency 4123.461 ms 2024-04-01T16:54:53.059 INFO:tasks.workunit.client.0.smithi163.stdout: 10 732 0.49 MB/sec execute 210 sec latency 5123.597 ms 2024-04-01T16:54:54.060 INFO:tasks.workunit.client.0.smithi163.stdout: 10 734 0.49 MB/sec execute 211 sec latency 6123.737 ms 2024-04-01T16:54:55.060 INFO:tasks.workunit.client.0.smithi163.stdout: 10 735 0.49 MB/sec execute 212 sec latency 7123.868 ms 2024-04-01T16:54:56.060 INFO:tasks.workunit.client.0.smithi163.stdout: 10 738 0.48 MB/sec execute 213 sec latency 8123.964 ms 2024-04-01T16:54:57.060 INFO:tasks.workunit.client.0.smithi163.stdout: 10 740 0.48 MB/sec execute 214 sec latency 9124.069 ms 2024-04-01T16:54:58.060 INFO:tasks.workunit.client.0.smithi163.stdout: 10 742 0.48 MB/sec execute 215 sec latency 9535.309 ms 2024-04-01T16:54:59.060 INFO:tasks.workunit.client.0.smithi163.stdout: 10 745 0.48 MB/sec execute 216 sec latency 9097.329 ms 2024-04-01T16:55:00.060 INFO:tasks.workunit.client.0.smithi163.stdout: 10 746 0.48 MB/sec execute 217 sec latency 3443.081 ms 2024-04-01T16:55:01.060 INFO:tasks.workunit.client.0.smithi163.stdout: 10 747 0.47 MB/sec execute 218 sec latency 4443.168 ms 2024-04-01T16:55:02.061 INFO:tasks.workunit.client.0.smithi163.stdout: 10 747 0.47 MB/sec execute 219 sec latency 5443.276 ms 2024-04-01T16:55:03.061 INFO:tasks.workunit.client.0.smithi163.stdout: 10 748 0.47 MB/sec execute 220 sec latency 6433.870 ms 2024-04-01T16:55:04.061 INFO:tasks.workunit.client.0.smithi163.stdout: 10 748 0.47 MB/sec execute 221 sec latency 6284.227 ms 2024-04-01T16:55:05.061 INFO:tasks.workunit.client.0.smithi163.stdout: 10 748 0.47 MB/sec execute 222 sec latency 7206.933 ms 2024-04-01T16:55:06.061 INFO:tasks.workunit.client.0.smithi163.stdout: 10 749 0.46 MB/sec execute 223 sec latency 7216.412 ms 2024-04-01T16:55:07.061 INFO:tasks.workunit.client.0.smithi163.stdout: 10 754 0.46 MB/sec execute 224 sec latency 5988.081 ms 2024-04-01T16:55:08.061 INFO:tasks.workunit.client.0.smithi163.stdout: 10 755 0.46 MB/sec execute 225 sec latency 4963.135 ms 2024-04-01T16:55:09.061 INFO:tasks.workunit.client.0.smithi163.stdout: 10 757 0.46 MB/sec execute 226 sec latency 5276.166 ms 2024-04-01T16:55:10.062 INFO:tasks.workunit.client.0.smithi163.stdout: 10 760 0.46 MB/sec execute 227 sec latency 4958.171 ms 2024-04-01T16:55:11.062 INFO:tasks.workunit.client.0.smithi163.stdout: 10 764 0.45 MB/sec execute 228 sec latency 5253.262 ms 2024-04-01T16:55:12.062 INFO:tasks.workunit.client.0.smithi163.stdout: 10 766 0.45 MB/sec execute 229 sec latency 5345.319 ms 2024-04-01T16:55:13.062 INFO:tasks.workunit.client.0.smithi163.stdout: 10 770 0.45 MB/sec execute 230 sec latency 2620.177 ms 2024-04-01T16:55:14.062 INFO:tasks.workunit.client.0.smithi163.stdout: 10 773 0.45 MB/sec execute 231 sec latency 1779.981 ms 2024-04-01T16:55:15.062 INFO:tasks.workunit.client.0.smithi163.stdout: 10 776 0.45 MB/sec execute 232 sec latency 2118.669 ms 2024-04-01T16:55:16.062 INFO:tasks.workunit.client.0.smithi163.stdout: 10 777 0.45 MB/sec execute 233 sec latency 1792.062 ms 2024-04-01T16:55:17.062 INFO:tasks.workunit.client.0.smithi163.stdout: 10 779 0.44 MB/sec execute 234 sec latency 2619.386 ms 2024-04-01T16:55:18.062 INFO:tasks.workunit.client.0.smithi163.stdout: 10 780 0.44 MB/sec execute 235 sec latency 2826.285 ms 2024-04-01T16:55:19.063 INFO:tasks.workunit.client.0.smithi163.stdout: 10 781 0.44 MB/sec execute 236 sec latency 2578.825 ms 2024-04-01T16:55:20.063 INFO:tasks.workunit.client.0.smithi163.stdout: 10 782 0.44 MB/sec execute 237 sec latency 3228.013 ms 2024-04-01T16:55:20.094 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:55:20.103 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:55:21.063 INFO:tasks.workunit.client.0.smithi163.stdout: 10 783 0.44 MB/sec execute 238 sec latency 4228.160 ms 2024-04-01T16:55:22.063 INFO:tasks.workunit.client.0.smithi163.stdout: 10 783 0.43 MB/sec execute 239 sec latency 5112.530 ms 2024-04-01T16:55:23.063 INFO:tasks.workunit.client.0.smithi163.stdout: 10 784 0.43 MB/sec execute 240 sec latency 5962.905 ms 2024-04-01T16:55:24.063 INFO:tasks.workunit.client.0.smithi163.stdout: 10 785 0.43 MB/sec execute 241 sec latency 6307.744 ms 2024-04-01T16:55:25.063 INFO:tasks.workunit.client.0.smithi163.stdout: 10 788 0.43 MB/sec execute 242 sec latency 7307.838 ms 2024-04-01T16:55:26.063 INFO:tasks.workunit.client.0.smithi163.stdout: 10 790 0.43 MB/sec execute 243 sec latency 8307.934 ms 2024-04-01T16:55:27.063 INFO:tasks.workunit.client.0.smithi163.stdout: 10 792 0.43 MB/sec execute 244 sec latency 9308.070 ms 2024-04-01T16:55:28.063 INFO:tasks.workunit.client.0.smithi163.stdout: 10 796 0.43 MB/sec execute 245 sec latency 10137.107 ms 2024-04-01T16:55:29.064 INFO:tasks.workunit.client.0.smithi163.stdout: 10 798 0.43 MB/sec execute 246 sec latency 2631.136 ms 2024-04-01T16:55:30.064 INFO:tasks.workunit.client.0.smithi163.stdout: 10 799 0.42 MB/sec execute 247 sec latency 3631.264 ms 2024-04-01T16:55:31.064 INFO:tasks.workunit.client.0.smithi163.stdout: 10 799 0.42 MB/sec execute 248 sec latency 4631.391 ms 2024-04-01T16:55:32.064 INFO:tasks.workunit.client.0.smithi163.stdout: 10 803 0.42 MB/sec execute 249 sec latency 5631.536 ms 2024-04-01T16:55:33.064 INFO:tasks.workunit.client.0.smithi163.stdout: 10 804 0.42 MB/sec execute 250 sec latency 6631.684 ms 2024-04-01T16:55:34.064 INFO:tasks.workunit.client.0.smithi163.stdout: 10 806 0.42 MB/sec execute 251 sec latency 7631.820 ms 2024-04-01T16:55:35.064 INFO:tasks.workunit.client.0.smithi163.stdout: 10 808 0.42 MB/sec execute 252 sec latency 7749.109 ms 2024-04-01T16:55:36.065 INFO:tasks.workunit.client.0.smithi163.stdout: 10 809 0.41 MB/sec execute 253 sec latency 8172.030 ms 2024-04-01T16:55:37.065 INFO:tasks.workunit.client.0.smithi163.stdout: 10 811 0.41 MB/sec execute 254 sec latency 8382.318 ms 2024-04-01T16:55:38.065 INFO:tasks.workunit.client.0.smithi163.stdout: 10 812 0.41 MB/sec execute 255 sec latency 4729.896 ms 2024-04-01T16:55:39.065 INFO:tasks.workunit.client.0.smithi163.stdout: 10 812 0.41 MB/sec execute 256 sec latency 5730.037 ms 2024-04-01T16:55:40.065 INFO:tasks.workunit.client.0.smithi163.stdout: 10 812 0.41 MB/sec execute 257 sec latency 6730.187 ms 2024-04-01T16:55:41.065 INFO:tasks.workunit.client.0.smithi163.stdout: 10 813 0.41 MB/sec execute 258 sec latency 7517.778 ms 2024-04-01T16:55:42.065 INFO:tasks.workunit.client.0.smithi163.stdout: 10 813 0.41 MB/sec execute 259 sec latency 5250.693 ms 2024-04-01T16:55:43.065 INFO:tasks.workunit.client.0.smithi163.stdout: 10 813 0.40 MB/sec execute 260 sec latency 6250.829 ms 2024-04-01T16:55:44.066 INFO:tasks.workunit.client.0.smithi163.stdout: 10 814 0.40 MB/sec execute 261 sec latency 6493.672 ms 2024-04-01T16:55:45.066 INFO:tasks.workunit.client.0.smithi163.stdout: 10 815 0.40 MB/sec execute 262 sec latency 4295.137 ms 2024-04-01T16:55:46.066 INFO:tasks.workunit.client.0.smithi163.stdout: 10 815 0.40 MB/sec execute 263 sec latency 5184.925 ms 2024-04-01T16:55:47.066 INFO:tasks.workunit.client.0.smithi163.stdout: 10 816 0.40 MB/sec execute 264 sec latency 5188.457 ms 2024-04-01T16:55:48.066 INFO:tasks.workunit.client.0.smithi163.stdout: 10 816 0.40 MB/sec execute 265 sec latency 4480.420 ms 2024-04-01T16:55:49.066 INFO:tasks.workunit.client.0.smithi163.stdout: 10 817 0.39 MB/sec execute 266 sec latency 5323.889 ms 2024-04-01T16:55:50.066 INFO:tasks.workunit.client.0.smithi163.stdout: 10 820 0.39 MB/sec execute 267 sec latency 4865.378 ms 2024-04-01T16:55:50.287 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:55:50.295 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:55:51.067 INFO:tasks.workunit.client.0.smithi163.stdout: 10 821 0.39 MB/sec execute 268 sec latency 3818.271 ms 2024-04-01T16:55:52.067 INFO:tasks.workunit.client.0.smithi163.stdout: 10 823 0.39 MB/sec execute 269 sec latency 4576.742 ms 2024-04-01T16:55:53.067 INFO:tasks.workunit.client.0.smithi163.stdout: 10 826 0.39 MB/sec execute 270 sec latency 4560.473 ms 2024-04-01T16:55:54.067 INFO:tasks.workunit.client.0.smithi163.stdout: 10 826 0.39 MB/sec execute 271 sec latency 4260.121 ms 2024-04-01T16:55:55.067 INFO:tasks.workunit.client.0.smithi163.stdout: 10 826 0.39 MB/sec execute 272 sec latency 4972.526 ms 2024-04-01T16:55:56.067 INFO:tasks.workunit.client.0.smithi163.stdout: 10 829 0.39 MB/sec execute 273 sec latency 4602.926 ms 2024-04-01T16:55:57.067 INFO:tasks.workunit.client.0.smithi163.stdout: 10 832 0.38 MB/sec execute 274 sec latency 4755.762 ms 2024-04-01T16:55:58.067 INFO:tasks.workunit.client.0.smithi163.stdout: 10 836 0.38 MB/sec execute 275 sec latency 4752.390 ms 2024-04-01T16:55:59.067 INFO:tasks.workunit.client.0.smithi163.stdout: 10 837 0.38 MB/sec execute 276 sec latency 3225.706 ms 2024-04-01T16:56:00.068 INFO:tasks.workunit.client.0.smithi163.stdout: 10 838 0.38 MB/sec execute 277 sec latency 4225.858 ms 2024-04-01T16:56:01.068 INFO:tasks.workunit.client.0.smithi163.stdout: 10 838 0.38 MB/sec execute 278 sec latency 4629.988 ms 2024-04-01T16:56:02.068 INFO:tasks.workunit.client.0.smithi163.stdout: 10 841 0.38 MB/sec execute 279 sec latency 5110.370 ms 2024-04-01T16:56:03.068 INFO:tasks.workunit.client.0.smithi163.stdout: 10 851 0.38 MB/sec execute 280 sec latency 5376.057 ms 2024-04-01T16:56:04.069 INFO:tasks.workunit.client.0.smithi163.stdout: 10 853 0.38 MB/sec execute 281 sec latency 4583.855 ms 2024-04-01T16:56:05.068 INFO:tasks.workunit.client.0.smithi163.stdout: 10 854 0.38 MB/sec execute 282 sec latency 4422.761 ms 2024-04-01T16:56:06.068 INFO:tasks.workunit.client.0.smithi163.stdout: 10 855 0.37 MB/sec execute 283 sec latency 4511.261 ms 2024-04-01T16:56:07.069 INFO:tasks.workunit.client.0.smithi163.stdout: 10 855 0.37 MB/sec execute 284 sec latency 4600.495 ms 2024-04-01T16:56:08.069 INFO:tasks.workunit.client.0.smithi163.stdout: 10 856 0.37 MB/sec execute 285 sec latency 5211.764 ms 2024-04-01T16:56:09.069 INFO:tasks.workunit.client.0.smithi163.stdout: 10 856 0.37 MB/sec execute 286 sec latency 5456.921 ms 2024-04-01T16:56:10.069 INFO:tasks.workunit.client.0.smithi163.stdout: 10 856 0.37 MB/sec execute 287 sec latency 5356.880 ms 2024-04-01T16:56:11.069 INFO:tasks.workunit.client.0.smithi163.stdout: 10 857 0.37 MB/sec execute 288 sec latency 5269.330 ms 2024-04-01T16:56:12.069 INFO:tasks.workunit.client.0.smithi163.stdout: 10 858 0.37 MB/sec execute 289 sec latency 4660.851 ms 2024-04-01T16:56:13.069 INFO:tasks.workunit.client.0.smithi163.stdout: 10 860 0.37 MB/sec execute 290 sec latency 4870.033 ms 2024-04-01T16:56:14.069 INFO:tasks.workunit.client.0.smithi163.stdout: 10 861 0.36 MB/sec execute 291 sec latency 4303.727 ms 2024-04-01T16:56:15.070 INFO:tasks.workunit.client.0.smithi163.stdout: 10 861 0.36 MB/sec execute 292 sec latency 5303.849 ms 2024-04-01T16:56:16.070 INFO:tasks.workunit.client.0.smithi163.stdout: 10 862 0.36 MB/sec execute 293 sec latency 6077.468 ms 2024-04-01T16:56:17.070 INFO:tasks.workunit.client.0.smithi163.stdout: 10 864 0.36 MB/sec execute 294 sec latency 6686.184 ms 2024-04-01T16:56:18.070 INFO:tasks.workunit.client.0.smithi163.stdout: 10 865 0.36 MB/sec execute 295 sec latency 4838.867 ms 2024-04-01T16:56:19.070 INFO:tasks.workunit.client.0.smithi163.stdout: 10 866 0.36 MB/sec execute 296 sec latency 5838.998 ms 2024-04-01T16:56:20.070 INFO:tasks.workunit.client.0.smithi163.stdout: 10 867 0.36 MB/sec execute 297 sec latency 6839.109 ms 2024-04-01T16:56:20.443 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:56:20.451 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:56:21.070 INFO:tasks.workunit.client.0.smithi163.stdout: 10 868 0.36 MB/sec execute 298 sec latency 7133.173 ms 2024-04-01T16:56:22.070 INFO:tasks.workunit.client.0.smithi163.stdout: 10 869 0.35 MB/sec execute 299 sec latency 5456.157 ms 2024-04-01T16:56:23.070 INFO:tasks.workunit.client.0.smithi163.stdout: 10 870 0.35 MB/sec execute 300 sec latency 5491.734 ms 2024-04-01T16:56:24.071 INFO:tasks.workunit.client.0.smithi163.stdout: 10 872 0.35 MB/sec execute 301 sec latency 5584.287 ms 2024-04-01T16:56:25.071 INFO:tasks.workunit.client.0.smithi163.stdout: 10 874 0.35 MB/sec execute 302 sec latency 6158.079 ms 2024-04-01T16:56:26.071 INFO:tasks.workunit.client.0.smithi163.stdout: 10 876 0.35 MB/sec execute 303 sec latency 6904.739 ms 2024-04-01T16:56:27.071 INFO:tasks.workunit.client.0.smithi163.stdout: 10 878 0.35 MB/sec execute 304 sec latency 6605.056 ms 2024-04-01T16:56:28.071 INFO:tasks.workunit.client.0.smithi163.stdout: 10 879 0.35 MB/sec execute 305 sec latency 6614.061 ms 2024-04-01T16:56:29.071 INFO:tasks.workunit.client.0.smithi163.stdout: 10 879 0.35 MB/sec execute 306 sec latency 4375.048 ms 2024-04-01T16:56:30.071 INFO:tasks.workunit.client.0.smithi163.stdout: 10 882 0.35 MB/sec execute 307 sec latency 5375.144 ms 2024-04-01T16:56:31.071 INFO:tasks.workunit.client.0.smithi163.stdout: 10 883 0.35 MB/sec execute 308 sec latency 6375.236 ms 2024-04-01T16:56:32.071 INFO:tasks.workunit.client.0.smithi163.stdout: 10 884 0.35 MB/sec execute 309 sec latency 7375.361 ms 2024-04-01T16:56:33.071 INFO:tasks.workunit.client.0.smithi163.stdout: 10 885 0.34 MB/sec execute 310 sec latency 8375.469 ms 2024-04-01T16:56:34.072 INFO:tasks.workunit.client.0.smithi163.stdout: 10 888 0.34 MB/sec execute 311 sec latency 8510.515 ms 2024-04-01T16:56:35.072 INFO:tasks.workunit.client.0.smithi163.stdout: 10 890 0.34 MB/sec execute 312 sec latency 7266.724 ms 2024-04-01T16:56:36.072 INFO:tasks.workunit.client.0.smithi163.stdout: 10 892 0.34 MB/sec execute 313 sec latency 7437.387 ms 2024-04-01T16:56:37.072 INFO:tasks.workunit.client.0.smithi163.stdout: 10 894 0.34 MB/sec execute 314 sec latency 3388.973 ms 2024-04-01T16:56:38.072 INFO:tasks.workunit.client.0.smithi163.stdout: 10 895 0.34 MB/sec execute 315 sec latency 4389.136 ms 2024-04-01T16:56:39.072 INFO:tasks.workunit.client.0.smithi163.stdout: 10 897 0.34 MB/sec execute 316 sec latency 5389.314 ms 2024-04-01T16:56:40.072 INFO:tasks.workunit.client.0.smithi163.stdout: 10 898 0.34 MB/sec execute 317 sec latency 6389.454 ms 2024-04-01T16:56:41.073 INFO:tasks.workunit.client.0.smithi163.stdout: 10 899 0.34 MB/sec execute 318 sec latency 7389.590 ms 2024-04-01T16:56:42.073 INFO:tasks.workunit.client.0.smithi163.stdout: 10 900 0.34 MB/sec execute 319 sec latency 8345.498 ms 2024-04-01T16:56:43.073 INFO:tasks.workunit.client.0.smithi163.stdout: 10 902 0.33 MB/sec execute 320 sec latency 8421.842 ms 2024-04-01T16:56:44.073 INFO:tasks.workunit.client.0.smithi163.stdout: 10 904 0.33 MB/sec execute 321 sec latency 5887.052 ms 2024-04-01T16:56:45.073 INFO:tasks.workunit.client.0.smithi163.stdout: 10 906 0.33 MB/sec execute 322 sec latency 6759.898 ms 2024-04-01T16:56:46.073 INFO:tasks.workunit.client.0.smithi163.stdout: 10 906 0.33 MB/sec execute 323 sec latency 5434.950 ms 2024-04-01T16:56:47.073 INFO:tasks.workunit.client.0.smithi163.stdout: 10 908 0.33 MB/sec execute 324 sec latency 6385.171 ms 2024-04-01T16:56:48.073 INFO:tasks.workunit.client.0.smithi163.stdout: 10 910 0.33 MB/sec execute 325 sec latency 3416.374 ms 2024-04-01T16:56:49.074 INFO:tasks.workunit.client.0.smithi163.stdout: 10 913 0.33 MB/sec execute 326 sec latency 4132.458 ms 2024-04-01T16:56:50.074 INFO:tasks.workunit.client.0.smithi163.stdout: 10 914 0.33 MB/sec execute 327 sec latency 5132.581 ms 2024-04-01T16:56:50.582 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:56:50.592 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:56:51.074 INFO:tasks.workunit.client.0.smithi163.stdout: 10 916 0.33 MB/sec execute 328 sec latency 6132.723 ms 2024-04-01T16:56:52.074 INFO:tasks.workunit.client.0.smithi163.stdout: 10 917 0.33 MB/sec execute 329 sec latency 7132.838 ms 2024-04-01T16:56:53.074 INFO:tasks.workunit.client.0.smithi163.stdout: 10 917 0.33 MB/sec execute 330 sec latency 7286.634 ms 2024-04-01T16:56:54.074 INFO:tasks.workunit.client.0.smithi163.stdout: 10 918 0.32 MB/sec execute 331 sec latency 6470.065 ms 2024-04-01T16:56:55.074 INFO:tasks.workunit.client.0.smithi163.stdout: 10 918 0.32 MB/sec execute 332 sec latency 3756.414 ms 2024-04-01T16:56:56.075 INFO:tasks.workunit.client.0.smithi163.stdout: 10 918 0.32 MB/sec execute 333 sec latency 4756.549 ms 2024-04-01T16:56:57.075 INFO:tasks.workunit.client.0.smithi163.stdout: 10 920 0.32 MB/sec execute 334 sec latency 5561.156 ms 2024-04-01T16:56:58.075 INFO:tasks.workunit.client.0.smithi163.stdout: 10 923 0.32 MB/sec execute 335 sec latency 6561.288 ms 2024-04-01T16:56:59.075 INFO:tasks.workunit.client.0.smithi163.stdout: 10 925 0.32 MB/sec execute 336 sec latency 7561.426 ms 2024-04-01T16:57:00.075 INFO:tasks.workunit.client.0.smithi163.stdout: 10 926 0.32 MB/sec execute 337 sec latency 8076.130 ms 2024-04-01T16:57:01.075 INFO:tasks.workunit.client.0.smithi163.stdout: 10 928 0.32 MB/sec execute 338 sec latency 7560.858 ms 2024-04-01T16:57:02.075 INFO:tasks.workunit.client.0.smithi163.stdout: 10 928 0.32 MB/sec execute 339 sec latency 3265.645 ms 2024-04-01T16:57:03.075 INFO:tasks.workunit.client.0.smithi163.stdout: 10 928 0.32 MB/sec execute 340 sec latency 3618.363 ms 2024-04-01T16:57:04.076 INFO:tasks.workunit.client.0.smithi163.stdout: 10 928 0.32 MB/sec execute 341 sec latency 4618.486 ms 2024-04-01T16:57:05.076 INFO:tasks.workunit.client.0.smithi163.stdout: 10 928 0.32 MB/sec execute 342 sec latency 5618.645 ms 2024-04-01T16:57:06.076 INFO:tasks.workunit.client.0.smithi163.stdout: 10 928 0.31 MB/sec execute 343 sec latency 6296.141 ms 2024-04-01T16:57:07.076 INFO:tasks.workunit.client.0.smithi163.stdout: 10 929 0.31 MB/sec execute 344 sec latency 6035.320 ms 2024-04-01T16:57:08.076 INFO:tasks.workunit.client.0.smithi163.stdout: 10 930 0.31 MB/sec execute 345 sec latency 2307.447 ms 2024-04-01T16:57:09.076 INFO:tasks.workunit.client.0.smithi163.stdout: 10 930 0.31 MB/sec execute 346 sec latency 3126.209 ms 2024-04-01T16:57:10.076 INFO:tasks.workunit.client.0.smithi163.stdout: 10 930 0.31 MB/sec execute 347 sec latency 4126.348 ms 2024-04-01T16:57:11.077 INFO:tasks.workunit.client.0.smithi163.stdout: 10 931 0.31 MB/sec execute 348 sec latency 5126.460 ms 2024-04-01T16:57:12.077 INFO:tasks.workunit.client.0.smithi163.stdout: 10 931 0.31 MB/sec execute 349 sec latency 5160.670 ms 2024-04-01T16:57:13.077 INFO:tasks.workunit.client.0.smithi163.stdout: 10 931 0.31 MB/sec execute 350 sec latency 4265.579 ms 2024-04-01T16:57:14.077 INFO:tasks.workunit.client.0.smithi163.stdout: 10 932 0.31 MB/sec execute 351 sec latency 4746.508 ms 2024-04-01T16:57:15.077 INFO:tasks.workunit.client.0.smithi163.stdout: 10 933 0.31 MB/sec execute 352 sec latency 4236.815 ms 2024-04-01T16:57:16.077 INFO:tasks.workunit.client.0.smithi163.stdout: 10 933 0.31 MB/sec execute 353 sec latency 4616.590 ms 2024-04-01T16:57:17.077 INFO:tasks.workunit.client.0.smithi163.stdout: 10 934 0.30 MB/sec execute 354 sec latency 4559.322 ms 2024-04-01T16:57:18.077 INFO:tasks.workunit.client.0.smithi163.stdout: 10 935 0.30 MB/sec execute 355 sec latency 3810.517 ms 2024-04-01T16:57:19.078 INFO:tasks.workunit.client.0.smithi163.stdout: 10 935 0.30 MB/sec execute 356 sec latency 4810.608 ms 2024-04-01T16:57:20.078 INFO:tasks.workunit.client.0.smithi163.stdout: 10 938 0.30 MB/sec execute 357 sec latency 4984.745 ms 2024-04-01T16:57:20.719 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:57:20.730 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:57:21.078 INFO:tasks.workunit.client.0.smithi163.stdout: 10 939 0.30 MB/sec execute 358 sec latency 4406.476 ms 2024-04-01T16:57:22.078 INFO:tasks.workunit.client.0.smithi163.stdout: 10 941 0.30 MB/sec execute 359 sec latency 4746.394 ms 2024-04-01T16:57:23.078 INFO:tasks.workunit.client.0.smithi163.stdout: 10 943 0.30 MB/sec execute 360 sec latency 4232.706 ms 2024-04-01T16:57:24.078 INFO:tasks.workunit.client.0.smithi163.stdout: 10 945 0.30 MB/sec execute 361 sec latency 4128.021 ms 2024-04-01T16:57:25.078 INFO:tasks.workunit.client.0.smithi163.stdout: 10 946 0.30 MB/sec execute 362 sec latency 2443.856 ms 2024-04-01T16:57:26.078 INFO:tasks.workunit.client.0.smithi163.stdout: 10 947 0.30 MB/sec execute 363 sec latency 3443.958 ms 2024-04-01T16:57:27.078 INFO:tasks.workunit.client.0.smithi163.stdout: 10 948 0.30 MB/sec execute 364 sec latency 4444.056 ms 2024-04-01T16:57:28.078 INFO:tasks.workunit.client.0.smithi163.stdout: 10 948 0.30 MB/sec execute 365 sec latency 5444.225 ms 2024-04-01T16:57:29.079 INFO:tasks.workunit.client.0.smithi163.stdout: 10 949 0.30 MB/sec execute 366 sec latency 5821.558 ms 2024-04-01T16:57:30.079 INFO:tasks.workunit.client.0.smithi163.stdout: 10 952 0.29 MB/sec execute 367 sec latency 5773.353 ms 2024-04-01T16:57:31.079 INFO:tasks.workunit.client.0.smithi163.stdout: 10 954 0.29 MB/sec execute 368 sec latency 5638.379 ms 2024-04-01T16:57:32.079 INFO:tasks.workunit.client.0.smithi163.stdout: 10 958 0.29 MB/sec execute 369 sec latency 5669.416 ms 2024-04-01T16:57:33.079 INFO:tasks.workunit.client.0.smithi163.stdout: 10 960 0.29 MB/sec execute 370 sec latency 4095.296 ms 2024-04-01T16:57:34.079 INFO:tasks.workunit.client.0.smithi163.stdout: 10 962 0.29 MB/sec execute 371 sec latency 3453.085 ms 2024-04-01T16:57:35.079 INFO:tasks.workunit.client.0.smithi163.stdout: 10 965 0.29 MB/sec execute 372 sec latency 3833.876 ms 2024-04-01T16:57:36.079 INFO:tasks.workunit.client.0.smithi163.stdout: 10 967 0.29 MB/sec execute 373 sec latency 4245.353 ms 2024-04-01T16:57:37.080 INFO:tasks.workunit.client.0.smithi163.stdout: 10 970 0.29 MB/sec execute 374 sec latency 5052.120 ms 2024-04-01T16:57:38.080 INFO:tasks.workunit.client.0.smithi163.stdout: 10 971 0.29 MB/sec execute 375 sec latency 2441.478 ms 2024-04-01T16:57:39.080 INFO:tasks.workunit.client.0.smithi163.stdout: 10 973 0.29 MB/sec execute 376 sec latency 3206.316 ms 2024-04-01T16:57:40.080 INFO:tasks.workunit.client.0.smithi163.stdout: 10 974 0.29 MB/sec execute 377 sec latency 4206.480 ms 2024-04-01T16:57:41.080 INFO:tasks.workunit.client.0.smithi163.stdout: 10 974 0.29 MB/sec execute 378 sec latency 5206.616 ms 2024-04-01T16:57:42.080 INFO:tasks.workunit.client.0.smithi163.stdout: 10 976 0.29 MB/sec execute 379 sec latency 6206.705 ms 2024-04-01T16:57:43.080 INFO:tasks.workunit.client.0.smithi163.stdout: 10 977 0.29 MB/sec execute 380 sec latency 6937.798 ms 2024-04-01T16:57:44.080 INFO:tasks.workunit.client.0.smithi163.stdout: 10 980 0.29 MB/sec execute 381 sec latency 5298.726 ms 2024-04-01T16:57:45.081 INFO:tasks.workunit.client.0.smithi163.stdout: 10 982 0.29 MB/sec execute 382 sec latency 6298.854 ms 2024-04-01T16:57:46.081 INFO:tasks.workunit.client.0.smithi163.stdout: 10 983 0.29 MB/sec execute 383 sec latency 7298.959 ms 2024-04-01T16:57:47.081 INFO:tasks.workunit.client.0.smithi163.stdout: 10 987 0.29 MB/sec execute 384 sec latency 8299.106 ms 2024-04-01T16:57:48.081 INFO:tasks.workunit.client.0.smithi163.stdout: 10 990 0.29 MB/sec execute 385 sec latency 8831.104 ms 2024-04-01T16:57:48.366 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:24:20.049 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:57:48.374 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:24:20.057 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:57:48.478 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:24:20.146 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:57:48.484 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:24:20.152 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:57:48.498 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:24:20.166 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:57:48.505 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:24:20.173 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:57:48.598 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:24:20.266 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:57:48.602 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:24:20.285 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:57:48.650 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:24:20.318 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:57:49.081 INFO:tasks.workunit.client.0.smithi163.stdout: 10 993 0.29 MB/sec execute 386 sec latency 2394.629 ms 2024-04-01T16:57:50.081 INFO:tasks.workunit.client.0.smithi163.stdout: 10 994 0.29 MB/sec execute 387 sec latency 2768.422 ms 2024-04-01T16:57:51.081 INFO:tasks.workunit.client.0.smithi163.stdout: 10 999 0.29 MB/sec execute 388 sec latency 3768.520 ms 2024-04-01T16:57:51.134 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:57:51.142 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:57:52.083 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1001 0.29 MB/sec execute 389 sec latency 4768.616 ms 2024-04-01T16:57:53.081 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1002 0.29 MB/sec execute 390 sec latency 5768.707 ms 2024-04-01T16:57:54.082 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1003 0.29 MB/sec execute 391 sec latency 6768.803 ms 2024-04-01T16:57:55.082 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1004 0.29 MB/sec execute 392 sec latency 7012.598 ms 2024-04-01T16:57:56.082 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1005 0.29 MB/sec execute 393 sec latency 5505.550 ms 2024-04-01T16:57:57.082 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1007 0.29 MB/sec execute 394 sec latency 5574.347 ms 2024-04-01T16:57:58.082 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1012 0.29 MB/sec execute 395 sec latency 6002.689 ms 2024-04-01T16:57:59.082 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1015 0.29 MB/sec execute 396 sec latency 5982.087 ms 2024-04-01T16:58:00.082 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1017 0.29 MB/sec execute 397 sec latency 5913.739 ms 2024-04-01T16:58:01.082 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1021 0.29 MB/sec execute 398 sec latency 5933.425 ms 2024-04-01T16:58:02.082 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1025 0.30 MB/sec execute 399 sec latency 4479.896 ms 2024-04-01T16:58:03.083 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1028 0.30 MB/sec execute 400 sec latency 5480.001 ms 2024-04-01T16:58:04.083 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1029 0.30 MB/sec execute 401 sec latency 6015.843 ms 2024-04-01T16:58:05.083 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1029 0.30 MB/sec execute 402 sec latency 6125.696 ms 2024-04-01T16:58:06.083 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1030 0.30 MB/sec execute 403 sec latency 5711.178 ms 2024-04-01T16:58:07.083 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1031 0.29 MB/sec execute 404 sec latency 6711.301 ms 2024-04-01T16:58:08.083 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1032 0.29 MB/sec execute 405 sec latency 6807.670 ms 2024-04-01T16:58:09.083 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1033 0.29 MB/sec execute 406 sec latency 6247.362 ms 2024-04-01T16:58:10.083 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1034 0.29 MB/sec execute 407 sec latency 2716.599 ms 2024-04-01T16:58:11.084 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1035 0.29 MB/sec execute 408 sec latency 3716.743 ms 2024-04-01T16:58:12.084 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1036 0.29 MB/sec execute 409 sec latency 4709.384 ms 2024-04-01T16:58:13.084 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1037 0.29 MB/sec execute 410 sec latency 4730.095 ms 2024-04-01T16:58:14.084 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1038 0.29 MB/sec execute 411 sec latency 4513.493 ms 2024-04-01T16:58:15.084 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1039 0.29 MB/sec execute 412 sec latency 3912.601 ms 2024-04-01T16:58:16.084 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1041 0.29 MB/sec execute 413 sec latency 4529.399 ms 2024-04-01T16:58:17.084 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1041 0.29 MB/sec execute 414 sec latency 5065.537 ms 2024-04-01T16:58:18.084 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1043 0.29 MB/sec execute 415 sec latency 5756.591 ms 2024-04-01T16:58:19.085 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1044 0.29 MB/sec execute 416 sec latency 6109.734 ms 2024-04-01T16:58:20.085 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1045 0.29 MB/sec execute 417 sec latency 6034.395 ms 2024-04-01T16:58:21.086 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1046 0.28 MB/sec execute 418 sec latency 5776.988 ms 2024-04-01T16:58:21.269 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:58:21.278 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:58:22.085 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1046 0.28 MB/sec execute 419 sec latency 6194.831 ms 2024-04-01T16:58:23.085 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1047 0.28 MB/sec execute 420 sec latency 4647.853 ms 2024-04-01T16:58:24.086 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1047 0.28 MB/sec execute 421 sec latency 4783.057 ms 2024-04-01T16:58:25.086 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1047 0.28 MB/sec execute 422 sec latency 4820.316 ms 2024-04-01T16:58:26.086 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1048 0.28 MB/sec execute 423 sec latency 4400.301 ms 2024-04-01T16:58:27.086 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1048 0.28 MB/sec execute 424 sec latency 5400.436 ms 2024-04-01T16:58:28.086 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1050 0.28 MB/sec execute 425 sec latency 5810.123 ms 2024-04-01T16:58:29.086 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1050 0.28 MB/sec execute 426 sec latency 5883.102 ms 2024-04-01T16:58:30.086 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1050 0.28 MB/sec execute 427 sec latency 5842.229 ms 2024-04-01T16:58:31.087 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1051 0.28 MB/sec execute 428 sec latency 6038.332 ms 2024-04-01T16:58:32.087 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1052 0.28 MB/sec execute 429 sec latency 6067.090 ms 2024-04-01T16:58:33.087 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1052 0.28 MB/sec execute 430 sec latency 5622.258 ms 2024-04-01T16:58:34.087 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1054 0.28 MB/sec execute 431 sec latency 5747.747 ms 2024-04-01T16:58:35.087 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1056 0.28 MB/sec execute 432 sec latency 6005.410 ms 2024-04-01T16:58:36.087 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1059 0.28 MB/sec execute 433 sec latency 5873.551 ms 2024-04-01T16:58:37.087 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1059 0.27 MB/sec execute 434 sec latency 6295.695 ms 2024-04-01T16:58:38.087 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1060 0.27 MB/sec execute 435 sec latency 6972.099 ms 2024-04-01T16:58:39.087 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1062 0.27 MB/sec execute 436 sec latency 7393.758 ms 2024-04-01T16:58:40.088 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1064 0.27 MB/sec execute 437 sec latency 1568.650 ms 2024-04-01T16:58:41.088 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1066 0.27 MB/sec execute 438 sec latency 1558.497 ms 2024-04-01T16:58:42.088 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1068 0.27 MB/sec execute 439 sec latency 2420.297 ms 2024-04-01T16:58:43.088 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1069 0.27 MB/sec execute 440 sec latency 3420.430 ms 2024-04-01T16:58:44.088 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1071 0.27 MB/sec execute 441 sec latency 4420.558 ms 2024-04-01T16:58:45.088 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1073 0.27 MB/sec execute 442 sec latency 5420.689 ms 2024-04-01T16:58:46.088 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1074 0.27 MB/sec execute 443 sec latency 6420.790 ms 2024-04-01T16:58:47.089 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1077 0.27 MB/sec execute 444 sec latency 7420.904 ms 2024-04-01T16:58:48.089 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1079 0.27 MB/sec execute 445 sec latency 8421.037 ms 2024-04-01T16:58:49.089 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1080 0.27 MB/sec execute 446 sec latency 9421.194 ms 2024-04-01T16:58:50.089 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1082 0.27 MB/sec execute 447 sec latency 10031.315 ms 2024-04-01T16:58:51.089 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1085 0.27 MB/sec execute 448 sec latency 6945.232 ms 2024-04-01T16:58:51.393 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:58:51.399 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:58:52.089 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1086 0.27 MB/sec execute 449 sec latency 7945.409 ms 2024-04-01T16:58:53.089 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1087 0.27 MB/sec execute 450 sec latency 8945.537 ms 2024-04-01T16:58:54.090 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1088 0.26 MB/sec execute 451 sec latency 9945.637 ms 2024-04-01T16:58:55.089 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1090 0.26 MB/sec execute 452 sec latency 10034.932 ms 2024-04-01T16:58:56.090 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1091 0.26 MB/sec execute 453 sec latency 8962.060 ms 2024-04-01T16:58:57.090 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1091 0.26 MB/sec execute 454 sec latency 9159.244 ms 2024-04-01T16:58:58.090 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1092 0.26 MB/sec execute 455 sec latency 8417.044 ms 2024-04-01T16:58:59.090 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1093 0.26 MB/sec execute 456 sec latency 6924.921 ms 2024-04-01T16:59:00.090 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1096 0.26 MB/sec execute 457 sec latency 6035.386 ms 2024-04-01T16:59:01.090 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1098 0.26 MB/sec execute 458 sec latency 6037.547 ms 2024-04-01T16:59:02.090 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1100 0.26 MB/sec execute 459 sec latency 5659.422 ms 2024-04-01T16:59:03.090 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1102 0.26 MB/sec execute 460 sec latency 5750.790 ms 2024-04-01T16:59:04.091 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1102 0.26 MB/sec execute 461 sec latency 4621.870 ms 2024-04-01T16:59:05.091 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1104 0.26 MB/sec execute 462 sec latency 5573.908 ms 2024-04-01T16:59:06.091 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1105 0.26 MB/sec execute 463 sec latency 4938.195 ms 2024-04-01T16:59:07.091 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1105 0.26 MB/sec execute 464 sec latency 5938.350 ms 2024-04-01T16:59:08.091 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1105 0.26 MB/sec execute 465 sec latency 6739.432 ms 2024-04-01T16:59:09.091 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1107 0.26 MB/sec execute 466 sec latency 6570.885 ms 2024-04-01T16:59:10.091 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1108 0.26 MB/sec execute 467 sec latency 6651.432 ms 2024-04-01T16:59:11.091 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1110 0.26 MB/sec execute 468 sec latency 6224.084 ms 2024-04-01T16:59:12.091 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1112 0.26 MB/sec execute 469 sec latency 7224.178 ms 2024-04-01T16:59:13.092 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1114 0.25 MB/sec execute 470 sec latency 7422.305 ms 2024-04-01T16:59:14.092 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1117 0.25 MB/sec execute 471 sec latency 4763.208 ms 2024-04-01T16:59:15.092 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1118 0.25 MB/sec execute 472 sec latency 5060.703 ms 2024-04-01T16:59:16.092 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1119 0.25 MB/sec execute 473 sec latency 4461.121 ms 2024-04-01T16:59:17.092 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1121 0.25 MB/sec execute 474 sec latency 4550.621 ms 2024-04-01T16:59:18.092 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1123 0.25 MB/sec execute 475 sec latency 5438.601 ms 2024-04-01T16:59:19.092 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1125 0.25 MB/sec execute 476 sec latency 5466.992 ms 2024-04-01T16:59:19.280 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:25:50.963 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:59:19.295 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:25:50.978 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:59:19.380 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:25:51.048 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:59:19.383 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:25:51.066 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T16:59:19.388 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:25:51.055 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:59:19.389 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:25:51.057 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:59:19.405 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:25:51.073 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:59:19.464 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:25:51.132 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T16:59:19.478 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:25:51.146 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T16:59:20.092 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1126 0.25 MB/sec execute 477 sec latency 4861.492 ms 2024-04-01T16:59:21.093 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1129 0.25 MB/sec execute 478 sec latency 1784.456 ms 2024-04-01T16:59:21.541 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:59:21.549 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:59:22.093 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1131 0.25 MB/sec execute 479 sec latency 2362.728 ms 2024-04-01T16:59:23.093 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1133 0.25 MB/sec execute 480 sec latency 2180.208 ms 2024-04-01T16:59:24.093 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1135 0.25 MB/sec execute 481 sec latency 1982.068 ms 2024-04-01T16:59:25.094 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1138 0.25 MB/sec execute 482 sec latency 2403.797 ms 2024-04-01T16:59:26.093 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1139 0.25 MB/sec execute 483 sec latency 3371.971 ms 2024-04-01T16:59:27.093 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1140 0.25 MB/sec execute 484 sec latency 3626.143 ms 2024-04-01T16:59:28.094 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1141 0.25 MB/sec execute 485 sec latency 2930.614 ms 2024-04-01T16:59:29.094 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1143 0.25 MB/sec execute 486 sec latency 3748.114 ms 2024-04-01T16:59:30.094 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1145 0.25 MB/sec execute 487 sec latency 4037.533 ms 2024-04-01T16:59:31.094 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1147 0.25 MB/sec execute 488 sec latency 2390.593 ms 2024-04-01T16:59:32.094 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1149 0.25 MB/sec execute 489 sec latency 3390.726 ms 2024-04-01T16:59:33.094 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1151 0.25 MB/sec execute 490 sec latency 4390.829 ms 2024-04-01T16:59:34.094 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1152 0.24 MB/sec execute 491 sec latency 5195.564 ms 2024-04-01T16:59:35.094 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1154 0.24 MB/sec execute 492 sec latency 3737.892 ms 2024-04-01T16:59:36.094 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1156 0.24 MB/sec execute 493 sec latency 4738.005 ms 2024-04-01T16:59:37.095 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1157 0.24 MB/sec execute 494 sec latency 5738.149 ms 2024-04-01T16:59:38.095 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1158 0.24 MB/sec execute 495 sec latency 5912.814 ms 2024-04-01T16:59:39.095 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1159 0.24 MB/sec execute 496 sec latency 6366.858 ms 2024-04-01T16:59:40.095 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1159 0.24 MB/sec execute 497 sec latency 7083.376 ms 2024-04-01T16:59:41.095 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1159 0.24 MB/sec execute 498 sec latency 7249.541 ms 2024-04-01T16:59:42.095 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1160 0.24 MB/sec execute 499 sec latency 4826.073 ms 2024-04-01T16:59:43.096 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1161 0.24 MB/sec execute 500 sec latency 5826.305 ms 2024-04-01T16:59:44.096 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1162 0.24 MB/sec execute 501 sec latency 6502.865 ms 2024-04-01T16:59:45.096 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1163 0.24 MB/sec execute 502 sec latency 5375.734 ms 2024-04-01T16:59:46.096 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1164 0.24 MB/sec execute 503 sec latency 3223.062 ms 2024-04-01T16:59:47.096 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1165 0.24 MB/sec execute 504 sec latency 4223.165 ms 2024-04-01T16:59:48.096 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1166 0.24 MB/sec execute 505 sec latency 5223.258 ms 2024-04-01T16:59:49.096 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1168 0.24 MB/sec execute 506 sec latency 5425.009 ms 2024-04-01T16:59:50.096 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1168 0.24 MB/sec execute 507 sec latency 6061.041 ms 2024-04-01T16:59:51.096 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1168 0.24 MB/sec execute 508 sec latency 4354.582 ms 2024-04-01T16:59:51.687 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:59:51.696 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T16:59:52.097 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1169 0.24 MB/sec execute 509 sec latency 5354.680 ms 2024-04-01T16:59:53.097 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1169 0.24 MB/sec execute 510 sec latency 5991.658 ms 2024-04-01T16:59:54.097 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1170 0.24 MB/sec execute 511 sec latency 5283.350 ms 2024-04-01T16:59:55.097 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1170 0.23 MB/sec execute 512 sec latency 5000.908 ms 2024-04-01T16:59:56.097 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1170 0.23 MB/sec execute 513 sec latency 5586.947 ms 2024-04-01T16:59:57.097 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1170 0.23 MB/sec execute 514 sec latency 4363.644 ms 2024-04-01T16:59:58.097 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1172 0.23 MB/sec execute 515 sec latency 5240.945 ms 2024-04-01T16:59:59.098 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1173 0.23 MB/sec execute 516 sec latency 5417.706 ms 2024-04-01T17:00:00.097 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1174 0.23 MB/sec execute 517 sec latency 5331.821 ms 2024-04-01T17:00:01.097 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1174 0.23 MB/sec execute 518 sec latency 3123.160 ms 2024-04-01T17:00:02.098 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1175 0.23 MB/sec execute 519 sec latency 4123.298 ms 2024-04-01T17:00:03.098 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1176 0.23 MB/sec execute 520 sec latency 4711.164 ms 2024-04-01T17:00:04.098 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1176 0.23 MB/sec execute 521 sec latency 5691.200 ms 2024-04-01T17:00:05.098 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1177 0.23 MB/sec execute 522 sec latency 5807.573 ms 2024-04-01T17:00:06.098 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1178 0.23 MB/sec execute 523 sec latency 4374.500 ms 2024-04-01T17:00:07.098 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1179 0.23 MB/sec execute 524 sec latency 5374.589 ms 2024-04-01T17:00:08.098 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1181 0.23 MB/sec execute 525 sec latency 6039.983 ms 2024-04-01T17:00:09.098 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1183 0.23 MB/sec execute 526 sec latency 2668.235 ms 2024-04-01T17:00:10.099 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1183 0.23 MB/sec execute 527 sec latency 2278.874 ms 2024-04-01T17:00:11.099 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1186 0.23 MB/sec execute 528 sec latency 1707.656 ms 2024-04-01T17:00:12.099 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1187 0.23 MB/sec execute 529 sec latency 1735.054 ms 2024-04-01T17:00:13.099 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1189 0.23 MB/sec execute 530 sec latency 2735.217 ms 2024-04-01T17:00:14.099 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1190 0.23 MB/sec execute 531 sec latency 3735.352 ms 2024-04-01T17:00:15.099 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1191 0.23 MB/sec execute 532 sec latency 4735.493 ms 2024-04-01T17:00:16.100 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1195 0.23 MB/sec execute 533 sec latency 5185.931 ms 2024-04-01T17:00:17.099 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1199 0.23 MB/sec execute 534 sec latency 1225.344 ms 2024-04-01T17:00:18.100 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1201 0.23 MB/sec execute 535 sec latency 1400.212 ms 2024-04-01T17:00:19.101 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1204 0.23 MB/sec execute 536 sec latency 2400.371 ms 2024-04-01T17:00:20.100 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1205 0.22 MB/sec execute 537 sec latency 3400.460 ms 2024-04-01T17:00:21.100 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1206 0.22 MB/sec execute 538 sec latency 4400.604 ms 2024-04-01T17:00:21.819 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:00:21.830 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:00:22.100 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1208 0.22 MB/sec execute 539 sec latency 4566.547 ms 2024-04-01T17:00:23.100 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1210 0.22 MB/sec execute 540 sec latency 2420.785 ms 2024-04-01T17:00:24.100 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1212 0.22 MB/sec execute 541 sec latency 2243.952 ms 2024-04-01T17:00:25.101 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1212 0.22 MB/sec execute 542 sec latency 3244.044 ms 2024-04-01T17:00:26.101 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1213 0.22 MB/sec execute 543 sec latency 4244.169 ms 2024-04-01T17:00:27.101 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1214 0.22 MB/sec execute 544 sec latency 5244.300 ms 2024-04-01T17:00:28.101 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1216 0.22 MB/sec execute 545 sec latency 6244.435 ms 2024-04-01T17:00:29.101 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1216 0.22 MB/sec execute 546 sec latency 7244.571 ms 2024-04-01T17:00:30.101 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1216 0.22 MB/sec execute 547 sec latency 8244.700 ms 2024-04-01T17:00:31.101 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1219 0.22 MB/sec execute 548 sec latency 8400.945 ms 2024-04-01T17:00:32.102 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1221 0.22 MB/sec execute 549 sec latency 6149.306 ms 2024-04-01T17:00:33.102 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1223 0.22 MB/sec execute 550 sec latency 2128.283 ms 2024-04-01T17:00:34.102 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1223 0.22 MB/sec execute 551 sec latency 3128.413 ms 2024-04-01T17:00:35.102 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1224 0.22 MB/sec execute 552 sec latency 3885.211 ms 2024-04-01T17:00:36.102 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1225 0.22 MB/sec execute 553 sec latency 4021.726 ms 2024-04-01T17:00:37.102 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1226 0.22 MB/sec execute 554 sec latency 5021.864 ms 2024-04-01T17:00:38.102 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1230 0.22 MB/sec execute 555 sec latency 6022.001 ms 2024-04-01T17:00:39.102 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1232 0.22 MB/sec execute 556 sec latency 7022.100 ms 2024-04-01T17:00:40.102 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1235 0.22 MB/sec execute 557 sec latency 7820.362 ms 2024-04-01T17:00:41.103 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1236 0.22 MB/sec execute 558 sec latency 2576.542 ms 2024-04-01T17:00:42.103 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1238 0.22 MB/sec execute 559 sec latency 1651.127 ms 2024-04-01T17:00:43.103 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1239 0.22 MB/sec execute 560 sec latency 2239.674 ms 2024-04-01T17:00:44.103 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1240 0.22 MB/sec execute 561 sec latency 3040.685 ms 2024-04-01T17:00:45.103 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1241 0.22 MB/sec execute 562 sec latency 3533.864 ms 2024-04-01T17:00:46.103 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1243 0.21 MB/sec execute 563 sec latency 3287.721 ms 2024-04-01T17:00:47.103 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1245 0.21 MB/sec execute 564 sec latency 4287.877 ms 2024-04-01T17:00:48.103 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1249 0.21 MB/sec execute 565 sec latency 5288.026 ms 2024-04-01T17:00:49.104 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1250 0.21 MB/sec execute 566 sec latency 6288.127 ms 2024-04-01T17:00:50.104 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1252 0.21 MB/sec execute 567 sec latency 6307.428 ms 2024-04-01T17:00:51.104 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1252 0.21 MB/sec execute 568 sec latency 2517.416 ms 2024-04-01T17:00:51.951 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:00:51.960 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:00:52.104 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1253 0.21 MB/sec execute 569 sec latency 2952.060 ms 2024-04-01T17:00:53.104 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1255 0.21 MB/sec execute 570 sec latency 3503.805 ms 2024-04-01T17:00:54.104 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1257 0.21 MB/sec execute 571 sec latency 4503.963 ms 2024-04-01T17:00:55.104 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1259 0.21 MB/sec execute 572 sec latency 5504.096 ms 2024-04-01T17:00:56.104 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1259 0.21 MB/sec execute 573 sec latency 6504.229 ms 2024-04-01T17:00:57.104 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1260 0.21 MB/sec execute 574 sec latency 7504.363 ms 2024-04-01T17:00:58.105 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1260 0.21 MB/sec execute 575 sec latency 8504.498 ms 2024-04-01T17:00:59.105 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1260 0.21 MB/sec execute 576 sec latency 9504.641 ms 2024-04-01T17:01:00.105 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1260 0.21 MB/sec execute 577 sec latency 10193.911 ms 2024-04-01T17:01:01.105 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1260 0.21 MB/sec execute 578 sec latency 9982.736 ms 2024-04-01T17:01:02.105 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1261 0.21 MB/sec execute 579 sec latency 10051.540 ms 2024-04-01T17:01:03.105 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1262 0.21 MB/sec execute 580 sec latency 10007.940 ms 2024-04-01T17:01:04.105 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1262 0.21 MB/sec execute 581 sec latency 6126.823 ms 2024-04-01T17:01:05.105 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1263 0.21 MB/sec execute 582 sec latency 5311.396 ms 2024-04-01T17:01:06.106 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1265 0.21 MB/sec execute 583 sec latency 5862.510 ms 2024-04-01T17:01:07.105 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1267 0.21 MB/sec execute 584 sec latency 5354.317 ms 2024-04-01T17:01:08.106 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1271 0.21 MB/sec execute 585 sec latency 4843.213 ms 2024-04-01T17:01:09.106 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1273 0.21 MB/sec execute 586 sec latency 5002.000 ms 2024-04-01T17:01:10.106 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1275 0.21 MB/sec execute 587 sec latency 3971.137 ms 2024-04-01T17:01:11.106 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1278 0.21 MB/sec execute 588 sec latency 4971.250 ms 2024-04-01T17:01:12.106 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1282 0.21 MB/sec execute 589 sec latency 5063.998 ms 2024-04-01T17:01:13.106 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1288 0.21 MB/sec execute 590 sec latency 5317.498 ms 2024-04-01T17:01:14.107 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1289 0.21 MB/sec execute 591 sec latency 6317.644 ms 2024-04-01T17:01:15.107 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1289 0.21 MB/sec execute 592 sec latency 7080.451 ms 2024-04-01T17:01:16.107 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1289 0.21 MB/sec execute 593 sec latency 7459.821 ms 2024-04-01T17:01:17.107 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1289 0.21 MB/sec execute 594 sec latency 8134.364 ms 2024-04-01T17:01:18.107 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1289 0.21 MB/sec execute 595 sec latency 6689.887 ms 2024-04-01T17:01:19.107 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1289 0.21 MB/sec execute 596 sec latency 7689.977 ms 2024-04-01T17:01:20.107 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1292 0.21 MB/sec execute 597 sec latency 7878.293 ms 2024-04-01T17:01:21.107 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1301 0.21 MB/sec execute 598 sec latency 5255.292 ms 2024-04-01T17:01:22.097 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:01:22.107 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:01:22.108 INFO:tasks.workunit.client.0.smithi163.stdout: 10 1309 0.22 MB/sec execute 599 sec latency 5015.010 ms 2024-04-01T17:01:23.108 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 600 sec 2024-04-01T17:01:24.108 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 601 sec 2024-04-01T17:01:25.108 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 602 sec 2024-04-01T17:01:26.108 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 603 sec 2024-04-01T17:01:27.108 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 604 sec 2024-04-01T17:01:28.108 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 605 sec 2024-04-01T17:01:29.108 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 606 sec 2024-04-01T17:01:30.109 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 607 sec 2024-04-01T17:01:31.110 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 608 sec 2024-04-01T17:01:32.109 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 609 sec 2024-04-01T17:01:33.109 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 610 sec 2024-04-01T17:01:34.109 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 611 sec 2024-04-01T17:01:35.109 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 612 sec 2024-04-01T17:01:36.109 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 613 sec 2024-04-01T17:01:37.109 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 614 sec 2024-04-01T17:01:38.109 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 615 sec 2024-04-01T17:01:38.895 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:28:10.578 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T17:01:38.912 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:28:10.595 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T17:01:38.916 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:28:10.584 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T17:01:38.923 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:28:10.591 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T17:01:38.924 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:28:10.592 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T17:01:38.931 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:28:10.599 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T17:01:39.040 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:28:10.707 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T17:01:39.057 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:28:10.725 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T17:01:39.109 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 616 sec 2024-04-01T17:01:39.145 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:28:10.827 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T17:01:40.110 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 617 sec 2024-04-01T17:01:41.110 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 618 sec 2024-04-01T17:01:42.110 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 619 sec 2024-04-01T17:01:43.110 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 620 sec 2024-04-01T17:01:44.110 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 621 sec 2024-04-01T17:01:45.110 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 622 sec 2024-04-01T17:01:46.110 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 623 sec 2024-04-01T17:01:47.110 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 624 sec 2024-04-01T17:01:48.111 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 625 sec 2024-04-01T17:01:49.111 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 626 sec 2024-04-01T17:01:50.111 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 627 sec 2024-04-01T17:01:51.111 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 628 sec 2024-04-01T17:01:52.111 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 629 sec 2024-04-01T17:01:52.233 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:01:52.241 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:01:53.111 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 630 sec 2024-04-01T17:01:54.111 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 631 sec 2024-04-01T17:01:55.111 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 632 sec 2024-04-01T17:01:56.112 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 633 sec 2024-04-01T17:01:57.111 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 634 sec 2024-04-01T17:01:58.112 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 635 sec 2024-04-01T17:01:59.112 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 636 sec 2024-04-01T17:02:00.112 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 637 sec 2024-04-01T17:02:01.112 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 638 sec 2024-04-01T17:02:02.112 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 639 sec 2024-04-01T17:02:03.112 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 640 sec 2024-04-01T17:02:04.112 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 641 sec 2024-04-01T17:02:05.112 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 642 sec 2024-04-01T17:02:06.113 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 643 sec 2024-04-01T17:02:07.113 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 644 sec 2024-04-01T17:02:08.113 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 645 sec 2024-04-01T17:02:09.113 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 646 sec 2024-04-01T17:02:10.113 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 647 sec 2024-04-01T17:02:11.113 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 648 sec 2024-04-01T17:02:12.114 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 649 sec 2024-04-01T17:02:13.114 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 650 sec 2024-04-01T17:02:14.114 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 651 sec 2024-04-01T17:02:15.114 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 652 sec 2024-04-01T17:02:16.114 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 653 sec 2024-04-01T17:02:17.114 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 654 sec 2024-04-01T17:02:18.114 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 655 sec 2024-04-01T17:02:19.114 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 656 sec 2024-04-01T17:02:20.114 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 657 sec 2024-04-01T17:02:21.115 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 658 sec 2024-04-01T17:02:22.115 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 659 sec 2024-04-01T17:02:22.376 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:02:22.384 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:02:23.115 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 660 sec 2024-04-01T17:02:24.115 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 661 sec 2024-04-01T17:02:25.115 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 662 sec 2024-04-01T17:02:26.115 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 663 sec 2024-04-01T17:02:27.115 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 664 sec 2024-04-01T17:02:28.116 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 665 sec 2024-04-01T17:02:29.116 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 666 sec 2024-04-01T17:02:30.116 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 667 sec 2024-04-01T17:02:31.116 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 668 sec 2024-04-01T17:02:32.116 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 669 sec 2024-04-01T17:02:33.116 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 670 sec 2024-04-01T17:02:34.116 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 671 sec 2024-04-01T17:02:35.116 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 672 sec 2024-04-01T17:02:36.117 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 673 sec 2024-04-01T17:02:37.117 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 674 sec 2024-04-01T17:02:38.117 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 675 sec 2024-04-01T17:02:39.118 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 676 sec 2024-04-01T17:02:40.117 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 677 sec 2024-04-01T17:02:41.117 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 678 sec 2024-04-01T17:02:42.117 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 679 sec 2024-04-01T17:02:43.117 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 680 sec 2024-04-01T17:02:44.118 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 681 sec 2024-04-01T17:02:45.118 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 682 sec 2024-04-01T17:02:46.118 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 683 sec 2024-04-01T17:02:47.118 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 684 sec 2024-04-01T17:02:48.118 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 685 sec 2024-04-01T17:02:49.118 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 686 sec 2024-04-01T17:02:50.118 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 687 sec 2024-04-01T17:02:51.118 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 688 sec 2024-04-01T17:02:52.119 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 689 sec 2024-04-01T17:02:52.523 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:02:52.532 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:02:53.119 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 690 sec 2024-04-01T17:02:54.119 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 691 sec 2024-04-01T17:02:55.119 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 692 sec 2024-04-01T17:02:56.119 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 693 sec 2024-04-01T17:02:57.119 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 694 sec 2024-04-01T17:02:58.119 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 695 sec 2024-04-01T17:02:59.120 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 696 sec 2024-04-01T17:03:00.120 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 697 sec 2024-04-01T17:03:01.120 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 698 sec 2024-04-01T17:03:02.120 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 699 sec 2024-04-01T17:03:03.120 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 700 sec 2024-04-01T17:03:04.120 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 701 sec 2024-04-01T17:03:05.120 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 702 sec 2024-04-01T17:03:06.120 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 703 sec 2024-04-01T17:03:07.121 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 704 sec 2024-04-01T17:03:08.121 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 705 sec 2024-04-01T17:03:09.121 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 706 sec 2024-04-01T17:03:10.121 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 707 sec 2024-04-01T17:03:11.121 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 708 sec 2024-04-01T17:03:12.121 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 709 sec 2024-04-01T17:03:13.121 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 710 sec 2024-04-01T17:03:14.121 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 711 sec 2024-04-01T17:03:15.122 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 712 sec 2024-04-01T17:03:16.122 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 713 sec 2024-04-01T17:03:17.122 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 714 sec 2024-04-01T17:03:18.122 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 715 sec 2024-04-01T17:03:19.122 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 716 sec 2024-04-01T17:03:20.122 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 717 sec 2024-04-01T17:03:21.122 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 718 sec 2024-04-01T17:03:22.122 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 719 sec 2024-04-01T17:03:22.659 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:03:22.667 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:03:23.123 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 720 sec 2024-04-01T17:03:24.123 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 721 sec 2024-04-01T17:03:25.123 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 722 sec 2024-04-01T17:03:26.123 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 723 sec 2024-04-01T17:03:27.123 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 724 sec 2024-04-01T17:03:28.123 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 725 sec 2024-04-01T17:03:29.123 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 726 sec 2024-04-01T17:03:30.123 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 727 sec 2024-04-01T17:03:31.123 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 728 sec 2024-04-01T17:03:32.123 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 729 sec 2024-04-01T17:03:33.124 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 730 sec 2024-04-01T17:03:34.124 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 731 sec 2024-04-01T17:03:35.124 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 732 sec 2024-04-01T17:03:36.124 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 733 sec 2024-04-01T17:03:37.124 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 734 sec 2024-04-01T17:03:38.124 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 735 sec 2024-04-01T17:03:39.125 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 736 sec 2024-04-01T17:03:40.125 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 737 sec 2024-04-01T17:03:41.125 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 738 sec 2024-04-01T17:03:42.125 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 739 sec 2024-04-01T17:03:43.125 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 740 sec 2024-04-01T17:03:44.125 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 741 sec 2024-04-01T17:03:45.125 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 742 sec 2024-04-01T17:03:46.126 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 743 sec 2024-04-01T17:03:47.126 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 744 sec 2024-04-01T17:03:48.126 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 745 sec 2024-04-01T17:03:49.126 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 746 sec 2024-04-01T17:03:50.126 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 747 sec 2024-04-01T17:03:51.126 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 748 sec 2024-04-01T17:03:52.126 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 749 sec 2024-04-01T17:03:52.965 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:03:52.972 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:03:53.126 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 750 sec 2024-04-01T17:03:54.127 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 751 sec 2024-04-01T17:03:55.126 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 752 sec 2024-04-01T17:03:56.127 INFO:tasks.workunit.client.0.smithi163.stdout: 10 cleanup 753 sec 2024-04-01T17:03:57.127 INFO:tasks.workunit.client.0.smithi163.stdout: 9 cleanup 754 sec 2024-04-01T17:03:58.127 INFO:tasks.workunit.client.0.smithi163.stdout: 9 cleanup 755 sec 2024-04-01T17:03:59.127 INFO:tasks.workunit.client.0.smithi163.stdout: 8 cleanup 756 sec 2024-04-01T17:04:00.127 INFO:tasks.workunit.client.0.smithi163.stdout: 8 cleanup 757 sec 2024-04-01T17:04:01.127 INFO:tasks.workunit.client.0.smithi163.stdout: 7 cleanup 758 sec 2024-04-01T17:04:02.127 INFO:tasks.workunit.client.0.smithi163.stdout: 6 cleanup 759 sec 2024-04-01T17:04:03.128 INFO:tasks.workunit.client.0.smithi163.stdout: 6 cleanup 760 sec 2024-04-01T17:04:04.128 INFO:tasks.workunit.client.0.smithi163.stdout: 6 cleanup 761 sec 2024-04-01T17:04:05.128 INFO:tasks.workunit.client.0.smithi163.stdout: 6 cleanup 762 sec 2024-04-01T17:04:06.128 INFO:tasks.workunit.client.0.smithi163.stdout: 6 cleanup 763 sec 2024-04-01T17:04:07.128 INFO:tasks.workunit.client.0.smithi163.stdout: 6 cleanup 764 sec 2024-04-01T17:04:08.128 INFO:tasks.workunit.client.0.smithi163.stdout: 6 cleanup 765 sec 2024-04-01T17:04:09.128 INFO:tasks.workunit.client.0.smithi163.stdout: 6 cleanup 766 sec 2024-04-01T17:04:10.129 INFO:tasks.workunit.client.0.smithi163.stdout: 5 cleanup 767 sec 2024-04-01T17:04:10.870 INFO:tasks.workunit.client.0.smithi163.stdout: 0 cleanup 768 sec 2024-04-01T17:04:10.870 INFO:tasks.workunit.client.0.smithi163.stdout: 2024-04-01T17:04:10.871 INFO:tasks.workunit.client.0.smithi163.stdout: Operation Count AvgLat MaxLat 2024-04-01T17:04:10.871 INFO:tasks.workunit.client.0.smithi163.stdout: ---------------------------------------- 2024-04-01T17:04:10.871 INFO:tasks.workunit.client.0.smithi163.stdout: NTCreateX 1413 1499.602 6419.418 2024-04-01T17:04:10.871 INFO:tasks.workunit.client.0.smithi163.stdout: Close 1331 11.474 140.883 2024-04-01T17:04:10.871 INFO:tasks.workunit.client.0.smithi163.stdout: Rename 100 2692.547 5962.883 2024-04-01T17:04:10.871 INFO:tasks.workunit.client.0.smithi163.stdout: Unlink 170 942.140 2141.386 2024-04-01T17:04:10.871 INFO:tasks.workunit.client.0.smithi163.stdout: Qpathinfo 890 619.959 5425.998 2024-04-01T17:04:10.871 INFO:tasks.workunit.client.0.smithi163.stdout: Qfileinfo 579 41.236 313.013 2024-04-01T17:04:10.871 INFO:tasks.workunit.client.0.smithi163.stdout: Qfsinfo 318 95.179 381.565 2024-04-01T17:04:10.871 INFO:tasks.workunit.client.0.smithi163.stdout: Sfileinfo 340 254.764 593.136 2024-04-01T17:04:10.872 INFO:tasks.workunit.client.0.smithi163.stdout: Find 412 5849.863 10193.890 2024-04-01T17:04:10.872 INFO:tasks.workunit.client.0.smithi163.stdout: WriteX 2765 61.876 838.641 2024-04-01T17:04:10.872 INFO:tasks.workunit.client.0.smithi163.stdout: ReadX 1605 0.362 34.912 2024-04-01T17:04:10.872 INFO:tasks.workunit.client.0.smithi163.stdout: Flush 240 815.575 2771.587 2024-04-01T17:04:10.872 INFO:tasks.workunit.client.0.smithi163.stdout: 2024-04-01T17:04:10.872 INFO:tasks.workunit.client.0.smithi163.stdout:Throughput 0.217151 MB/sec 10 clients 10 procs max_latency=10193.911 ms 2024-04-01T17:04:10.873 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-01T17:04:10.873 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-01T17:04:23.079 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:04:23.087 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:04:53.219 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:04:53.228 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:05:11.225 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-04-01T17:05:11.225 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-01T17:05:12.272 DEBUG:teuthology.parallel:result is None 2024-04-01T17:05:12.272 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-01T17:05:12.923 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-01T17:05:12.924 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-01T17:05:12.934 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-01T17:05:12.934 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T17:05:12.934 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T17:05:12.992 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T17:05:12.992 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T17:05:13.043 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T17:05:13.256 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.256+0000 7fd3cb200640 1 Processor -- start 2024-04-01T17:05:13.256 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.256+0000 7fd3cb200640 1 -- start start 2024-04-01T17:05:13.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.258+0000 7fd3cb200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd3cc071c20 0x7fd3cc0c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:13.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.258+0000 7fd3cb200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3cc0c7330 0x7fd3cc0c8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:13.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.258+0000 7fd3cb200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3cc0722d0 con 0x7fd3cc151530 2024-04-01T17:05:13.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.258+0000 7fd3cb200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fd3cc0c10d0 con 0x7fd3cc071c20 2024-04-01T17:05:13.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.258+0000 7fd3cb200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd3cc072070 con 0x7fd3cc0c7330 2024-04-01T17:05:13.258 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.258+0000 7fd3c9400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd3cc071c20 0x7fd3cc0c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:13.258 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.259+0000 7fd3c9e00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fd3cc151530 0x7fd3cc15b250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:57696/0 (socket says 172.21.15.163:57696) 2024-04-01T17:05:13.259 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.259+0000 7fd3c9e00640 1 -- 172.21.15.163:0/144585268 learned_addr learned my addr 172.21.15.163:0/144585268 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:13.259 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.260+0000 7fd3ca800640 1 --2- 172.21.15.163:0/144585268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3cc0c7330 0x7fd3cc0c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:13.263 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.263+0000 7fd3c9400640 1 -- 172.21.15.163:0/144585268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3cc0c7330 msgr2=0x7fd3cc0c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:13.263 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.264+0000 7fd3c9400640 1 --2- 172.21.15.163:0/144585268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3cc0c7330 0x7fd3cc0c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:13.263 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.264+0000 7fd3c9400640 1 -- 172.21.15.163:0/144585268 >> v1:172.21.15.163:6789/0 conn(0x7fd3cc151530 legacy=0x7fd3cc15b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:13.263 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.264+0000 7fd3c9400640 1 -- 172.21.15.163:0/144585268 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3cc0725b0 con 0x7fd3cc071c20 2024-04-01T17:05:13.267 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.267+0000 7fd3c9400640 1 --2- 172.21.15.163:0/144585268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3cc071c20 0x7fd3cc0c6df0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40097a0 tx=0x7fd3b402db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e459ac69e545c4b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:13.275 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.276+0000 7fd3c8a00640 1 -- 172.21.15.163:0/144585268 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b403b070 con 0x7fd3cc071c20 2024-04-01T17:05:13.275 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.276+0000 7fd3c8a00640 1 -- 172.21.15.163:0/144585268 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b402e920 con 0x7fd3cc071c20 2024-04-01T17:05:13.276 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.276+0000 7fd3c8a00640 1 -- 172.21.15.163:0/144585268 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b402ecf0 con 0x7fd3cc071c20 2024-04-01T17:05:13.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.277+0000 7fd3cb200640 1 -- 172.21.15.163:0/144585268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3cc071c20 msgr2=0x7fd3cc0c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:13.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.277+0000 7fd3cb200640 1 --2- 172.21.15.163:0/144585268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3cc071c20 0x7fd3cc0c6df0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40097a0 tx=0x7fd3b402db70 comp rx=0 tx=0).stop 2024-04-01T17:05:13.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.277+0000 7fd3cb200640 1 -- 172.21.15.163:0/144585268 shutdown_connections 2024-04-01T17:05:13.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.277+0000 7fd3cb200640 1 --2- 172.21.15.163:0/144585268 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3cc0c7330 0x7fd3cc0c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:13.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.277+0000 7fd3cb200640 1 --2- 172.21.15.163:0/144585268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3cc071c20 0x7fd3cc0c6df0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:13.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.277+0000 7fd3cb200640 1 -- 172.21.15.163:0/144585268 >> 172.21.15.163:0/144585268 conn(0x7fd3cc06f7d0 msgr2=0x7fd3cc06fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:13.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.277+0000 7fd3cb200640 1 -- 172.21.15.163:0/144585268 shutdown_connections 2024-04-01T17:05:13.277 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.277+0000 7fd3cb200640 1 -- 172.21.15.163:0/144585268 wait complete. 2024-04-01T17:05:13.279 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.280+0000 7fd3cb200640 1 Processor -- start 2024-04-01T17:05:13.280 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.280+0000 7fd3cb200640 1 -- start start 2024-04-01T17:05:13.281 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.282+0000 7fd3cb200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3cc0c7330 0x7fd3cc14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:13.281 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.282+0000 7fd3cb200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3cc151530 0x7fd3cc15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:13.281 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.282+0000 7fd3cb200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3cc14fda0 0x7fd3cc15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:13.281 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.282+0000 7fd3cb200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc0c80b0 con 0x7fd3cc0c7330 2024-04-01T17:05:13.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.282+0000 7fd3cb200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc0c65f0 con 0x7fd3cc151530 2024-04-01T17:05:13.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.282+0000 7fd3cb200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd3cc0c8230 con 0x7fd3cc14fda0 2024-04-01T17:05:13.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.282+0000 7fd3c9e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3cc0c7330 0x7fd3cc14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:13.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.283+0000 7fd3c9e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3cc0c7330 0x7fd3cc14f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37948/0 (socket says 172.21.15.163:37948) 2024-04-01T17:05:13.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.283+0000 7fd3c9e00640 1 -- 172.21.15.163:0/978698518 learned_addr learned my addr 172.21.15.163:0/978698518 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:13.283 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.283+0000 7fd3c9400640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3cc151530 0x7fd3cc15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:13.283 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.284+0000 7fd3ca800640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3cc14fda0 0x7fd3cc15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:13.286 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.287+0000 7fd3c9e00640 1 -- 172.21.15.163:0/978698518 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3cc14fda0 msgr2=0x7fd3cc15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:13.286 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.287+0000 7fd3c9e00640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3cc14fda0 0x7fd3cc15ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:13.286 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.287+0000 7fd3c9e00640 1 -- 172.21.15.163:0/978698518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3cc151530 msgr2=0x7fd3cc15a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:13.286 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.287+0000 7fd3c9e00640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3cc151530 0x7fd3cc15a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:13.287 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.287+0000 7fd3c9e00640 1 -- 172.21.15.163:0/978698518 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3cc0cb710 con 0x7fd3cc0c7330 2024-04-01T17:05:13.289 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.290+0000 7fd3c9e00640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3cc0c7330 0x7fd3cc14f860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00c3c0 tx=0x7fd3bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:13.294 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.295+0000 7fd3c2000640 1 -- 172.21.15.163:0/978698518 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc017070 con 0x7fd3cc0c7330 2024-04-01T17:05:13.294 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.295+0000 7fd3c2000640 1 -- 172.21.15.163:0/978698518 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3bc005ce0 con 0x7fd3cc0c7330 2024-04-01T17:05:13.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.295+0000 7fd3c2000640 1 -- 172.21.15.163:0/978698518 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc0072f0 con 0x7fd3cc0c7330 2024-04-01T17:05:13.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.295+0000 7fd3cb200640 1 -- 172.21.15.163:0/978698518 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3cc0cb470 con 0x7fd3cc0c7330 2024-04-01T17:05:13.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.295+0000 7fd3cb200640 1 -- 172.21.15.163:0/978698518 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3cc1f5900 con 0x7fd3cc0c7330 2024-04-01T17:05:13.296 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.296+0000 7fd3cb200640 1 -- 172.21.15.163:0/978698518 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3cc0c7790 con 0x7fd3cc0c7330 2024-04-01T17:05:13.325 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.325+0000 7fd3c2000640 1 -- 172.21.15.163:0/978698518 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd3bc01a070 con 0x7fd3cc0c7330 2024-04-01T17:05:13.326 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.327+0000 7fd3c2000640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd3a806c970 0x7fd3a806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:13.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.327+0000 7fd3c9400640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd3a806c970 0x7fd3a806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:13.328 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.329+0000 7fd3c9400640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd3a806c970 0x7fd3a806ee30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4038000 tx=0x7fd3b4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:13.628 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.629+0000 7fd3c2000640 1 -- 172.21.15.163:0/978698518 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fd3bc0570d0 con 0x7fd3cc0c7330 2024-04-01T17:05:13.629 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.630+0000 7fd3c2000640 1 -- 172.21.15.163:0/978698518 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd3cc0c7790 con 0x7fd3cc0c7330 2024-04-01T17:05:13.850 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.851+0000 7fd3cb200640 1 -- 172.21.15.163:0/978698518 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3cc0756d0 con 0x7fd3cc0c7330 2024-04-01T17:05:13.982 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.983+0000 7fd3c2000640 1 -- 172.21.15.163:0/978698518 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+16901 (secure 0 0 0) 0x7fd3bc021020 con 0x7fd3cc0c7330 2024-04-01T17:05:13.983 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T17:05:13.983 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":27,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:53.160271+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T16:34:29.028272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T16:34:31.534879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T17:05:13.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.986+0000 7fd3cb200640 1 -- 172.21.15.163:0/978698518 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd3a806c970 msgr2=0x7fd3a806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:13.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.986+0000 7fd3cb200640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd3a806c970 0x7fd3a806ee30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4038000 tx=0x7fd3b4032000 comp rx=0 tx=0).stop 2024-04-01T17:05:13.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.986+0000 7fd3cb200640 1 -- 172.21.15.163:0/978698518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3cc0c7330 msgr2=0x7fd3cc14f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:13.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.986+0000 7fd3cb200640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3cc0c7330 0x7fd3cc14f860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00c3c0 tx=0x7fd3bc00c880 comp rx=0 tx=0).stop 2024-04-01T17:05:13.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.986+0000 7fd3cb200640 1 -- 172.21.15.163:0/978698518 shutdown_connections 2024-04-01T17:05:13.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.986+0000 7fd3cb200640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd3a806c970 0x7fd3a806ee30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:13.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.986+0000 7fd3cb200640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd3cc14fda0 0x7fd3cc15ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:13.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.986+0000 7fd3cb200640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3cc151530 0x7fd3cc15a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:13.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.986+0000 7fd3cb200640 1 --2- 172.21.15.163:0/978698518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3cc0c7330 0x7fd3cc14f860 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:13.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.986+0000 7fd3cb200640 1 -- 172.21.15.163:0/978698518 >> 172.21.15.163:0/978698518 conn(0x7fd3cc06f7d0 msgr2=0x7fd3cc1551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:13.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.986+0000 7fd3cb200640 1 -- 172.21.15.163:0/978698518 shutdown_connections 2024-04-01T17:05:13.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:13.986+0000 7fd3cb200640 1 -- 172.21.15.163:0/978698518 wait complete. 2024-04-01T17:05:14.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T16:34:05.291874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T16:34:29.028272+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T16:34:31.534879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T17:05:14.010 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T17:05:14.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.214+0000 7fd70e600640 1 Processor -- start 2024-04-01T17:05:14.214 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.214+0000 7fd70e600640 1 -- start start 2024-04-01T17:05:14.215 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.216+0000 7fd70e600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd7081548f0 0x7fd7080cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:14.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.216+0000 7fd70e600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7080cb7b0 0x7fd7080ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:14.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.216+0000 7fd70e600640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fd7080c5220 0x7fd70815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:14.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.216+0000 7fd70e600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fd70806e230 con 0x7fd7081548f0 2024-04-01T17:05:14.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.216+0000 7fd70e600640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fd7080caba0 con 0x7fd7080c5220 2024-04-01T17:05:14.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.216+0000 7fd70e600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd7080cb090 con 0x7fd7080cb7b0 2024-04-01T17:05:14.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.217+0000 7fd70d200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd7081548f0 0x7fd7080cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:14.217 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.217+0000 7fd70d200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd7081548f0 0x7fd7080cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37954/0 (socket says 172.21.15.163:37954) 2024-04-01T17:05:14.217 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.217+0000 7fd70d200640 1 -- 172.21.15.163:0/3738734062 learned_addr learned my addr 172.21.15.163:0/3738734062 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:14.217 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.218+0000 7fd70dc00640 1 --2- 172.21.15.163:0/3738734062 >> v2:172.21.15.189:3300/0 conn(0x7fd7080c5220 0x7fd70815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:14.218 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.218+0000 7fd6ffe00640 1 --2- 172.21.15.163:0/3738734062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7080cb7b0 0x7fd7080ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:14.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.220+0000 7fd70d200640 1 -- 172.21.15.163:0/3738734062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7080cb7b0 msgr2=0x7fd7080ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:14.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.220+0000 7fd70d200640 1 --2- 172.21.15.163:0/3738734062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7080cb7b0 0x7fd7080ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.220+0000 7fd70d200640 1 -- 172.21.15.163:0/3738734062 >> v2:172.21.15.189:3300/0 conn(0x7fd7080c5220 msgr2=0x7fd70815dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:14.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.220+0000 7fd70d200640 1 --2- 172.21.15.163:0/3738734062 >> v2:172.21.15.189:3300/0 conn(0x7fd7080c5220 0x7fd70815dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.220+0000 7fd70d200640 1 -- 172.21.15.163:0/3738734062 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7080cb370 con 0x7fd7081548f0 2024-04-01T17:05:14.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.222+0000 7fd70d200640 1 --2- 172.21.15.163:0/3738734062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd7081548f0 0x7fd7080cc8b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd7080cdd10 tx=0x7fd6f802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fc4f679593b55b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:14.226 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.227+0000 7fd707e00640 1 -- 172.21.15.163:0/3738734062 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8034070 con 0x7fd7081548f0 2024-04-01T17:05:14.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.227+0000 7fd707e00640 1 -- 172.21.15.163:0/3738734062 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f8030860 con 0x7fd7081548f0 2024-04-01T17:05:14.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.227+0000 7fd707e00640 1 -- 172.21.15.163:0/3738734062 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8030c30 con 0x7fd7081548f0 2024-04-01T17:05:14.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.228+0000 7fd70e600640 1 -- 172.21.15.163:0/3738734062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd7081548f0 msgr2=0x7fd7080cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:14.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.228+0000 7fd70e600640 1 --2- 172.21.15.163:0/3738734062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd7081548f0 0x7fd7080cc8b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd7080cdd10 tx=0x7fd6f802b9a0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.228+0000 7fd70e600640 1 -- 172.21.15.163:0/3738734062 shutdown_connections 2024-04-01T17:05:14.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.228+0000 7fd70e600640 1 --2- 172.21.15.163:0/3738734062 >> v2:172.21.15.189:3300/0 conn(0x7fd7080c5220 0x7fd70815dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.228+0000 7fd70e600640 1 --2- 172.21.15.163:0/3738734062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7080cb7b0 0x7fd7080ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.228+0000 7fd70e600640 1 --2- 172.21.15.163:0/3738734062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd7081548f0 0x7fd7080cc8b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.228+0000 7fd70e600640 1 -- 172.21.15.163:0/3738734062 >> 172.21.15.163:0/3738734062 conn(0x7fd70808c600 msgr2=0x7fd708067280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:14.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.228+0000 7fd70e600640 1 -- 172.21.15.163:0/3738734062 shutdown_connections 2024-04-01T17:05:14.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.228+0000 7fd70e600640 1 -- 172.21.15.163:0/3738734062 wait complete. 2024-04-01T17:05:14.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.230+0000 7fd70e600640 1 Processor -- start 2024-04-01T17:05:14.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.230+0000 7fd70e600640 1 -- start start 2024-04-01T17:05:14.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.231+0000 7fd70e600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7080c5220 0x7fd7081f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:14.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.231+0000 7fd70e600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd7080cb7b0 0x7fd708156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:14.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.231+0000 7fd70e600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7081548f0 0x7fd70814f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:14.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.231+0000 7fd70e600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd7080cc330 con 0x7fd7080cb7b0 2024-04-01T17:05:14.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.231+0000 7fd70e600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7080cc050 con 0x7fd7081548f0 2024-04-01T17:05:14.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.231+0000 7fd70e600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fd7080ca820 con 0x7fd7080c5220 2024-04-01T17:05:14.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.232+0000 7fd6ffe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd7080cb7b0 0x7fd708156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:14.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.232+0000 7fd6ffe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd7080cb7b0 0x7fd708156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37964/0 (socket says 172.21.15.163:37964) 2024-04-01T17:05:14.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.232+0000 7fd6ffe00640 1 -- 172.21.15.163:0/691710753 learned_addr learned my addr 172.21.15.163:0/691710753 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:14.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.233+0000 7fd70dc00640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7081548f0 0x7fd70814f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:14.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.233+0000 7fd70d200640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7080c5220 0x7fd7081f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:14.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.236+0000 7fd6ffe00640 1 -- 172.21.15.163:0/691710753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7080c5220 msgr2=0x7fd7081f0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:14.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.236+0000 7fd6ffe00640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7080c5220 0x7fd7081f0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.236+0000 7fd6ffe00640 1 -- 172.21.15.163:0/691710753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7081548f0 msgr2=0x7fd70814f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:14.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.236+0000 7fd6ffe00640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7081548f0 0x7fd70814f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.236+0000 7fd6ffe00640 1 -- 172.21.15.163:0/691710753 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd708156a90 con 0x7fd7080cb7b0 2024-04-01T17:05:14.238 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.239+0000 7fd6ffe00640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd7080cb7b0 0x7fd708156550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000d800 tx=0x7fd6f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:14.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.243+0000 7fd705600640 1 -- 172.21.15.163:0/691710753 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000b6c0 con 0x7fd7080cb7b0 2024-04-01T17:05:14.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.243+0000 7fd705600640 1 -- 172.21.15.163:0/691710753 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f0019070 con 0x7fd7080cb7b0 2024-04-01T17:05:14.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.243+0000 7fd705600640 1 -- 172.21.15.163:0/691710753 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000ba80 con 0x7fd7080cb7b0 2024-04-01T17:05:14.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.243+0000 7fd70e600640 1 -- 172.21.15.163:0/691710753 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7081551d0 con 0x7fd7080cb7b0 2024-04-01T17:05:14.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.243+0000 7fd70e600640 1 -- 172.21.15.163:0/691710753 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd708155790 con 0x7fd7080cb7b0 2024-04-01T17:05:14.244 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.245+0000 7fd70e600640 1 -- 172.21.15.163:0/691710753 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd708073910 con 0x7fd7080cb7b0 2024-04-01T17:05:14.547 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.548+0000 7fd705600640 1 -- 172.21.15.163:0/691710753 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6f000bc20 con 0x7fd7080cb7b0 2024-04-01T17:05:14.549 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.549+0000 7fd705600640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd6e406c940 0x7fd6e406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:14.549 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.550+0000 7fd70d200640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd6e406c940 0x7fd6e406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:14.551 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.552+0000 7fd70d200640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd6e406c940 0x7fd6e406ee00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8036000 tx=0x7fd6f803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:14.575 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.576+0000 7fd705600640 1 -- 172.21.15.163:0/691710753 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fd6f0058790 con 0x7fd7080cb7b0 2024-04-01T17:05:14.576 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.577+0000 7fd705600640 1 -- 172.21.15.163:0/691710753 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd708073910 con 0x7fd7080cb7b0 2024-04-01T17:05:14.798 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.798+0000 7fd70e600640 1 -- 172.21.15.163:0/691710753 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd7080756d0 con 0x7fd7080cb7b0 2024-04-01T17:05:14.807 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.808+0000 7fd705600640 1 -- 172.21.15.163:0/691710753 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fd6f005a6f0 con 0x7fd7080cb7b0 2024-04-01T17:05:14.808 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2024-04-01T17:05:14.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.811+0000 7fd70e600640 1 -- 172.21.15.163:0/691710753 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd6e406c940 msgr2=0x7fd6e406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:14.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.811+0000 7fd70e600640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd6e406c940 0x7fd6e406ee00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8036000 tx=0x7fd6f803b040 comp rx=0 tx=0).stop 2024-04-01T17:05:14.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.811+0000 7fd70e600640 1 -- 172.21.15.163:0/691710753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd7080cb7b0 msgr2=0x7fd708156550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:14.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.811+0000 7fd70e600640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd7080cb7b0 0x7fd708156550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000d800 tx=0x7fd6f000dcc0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.811+0000 7fd70e600640 1 -- 172.21.15.163:0/691710753 shutdown_connections 2024-04-01T17:05:14.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.811+0000 7fd70e600640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fd6e406c940 0x7fd6e406ee00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.811+0000 7fd70e600640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7081548f0 0x7fd70814f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.811+0000 7fd70e600640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd7080cb7b0 0x7fd708156550 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.811+0000 7fd70e600640 1 --2- 172.21.15.163:0/691710753 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fd7080c5220 0x7fd7081f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:14.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.811+0000 7fd70e600640 1 -- 172.21.15.163:0/691710753 >> 172.21.15.163:0/691710753 conn(0x7fd70808c600 msgr2=0x7fd7080cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:14.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.811+0000 7fd70e600640 1 -- 172.21.15.163:0/691710753 shutdown_connections 2024-04-01T17:05:14.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:14.811+0000 7fd70e600640 1 -- 172.21.15.163:0/691710753 wait complete. 2024-04-01T17:05:14.832 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T17:05:15.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.046+0000 7f4432800640 1 Processor -- start 2024-04-01T17:05:15.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.046+0000 7f4432800640 1 -- start start 2024-04-01T17:05:15.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.048+0000 7f4432800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f442c151300 0x7f442c0c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:15.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.048+0000 7f4432800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442c157d40 con 0x7f442c070920 2024-04-01T17:05:15.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.048+0000 7f4432800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442c158020 con 0x7f442c1516e0 2024-04-01T17:05:15.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.048+0000 7f4432800640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f442c158300 con 0x7f442c151300 2024-04-01T17:05:15.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.050+0000 7f4422a00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f442c1516e0 0x7f442c157420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:43738/0 (socket says 172.21.15.163:43738) 2024-04-01T17:05:15.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.050+0000 7f4422a00640 1 -- 172.21.15.163:0/3813042655 learned_addr learned my addr 172.21.15.163:0/3813042655 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:15.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.051+0000 7f442b400640 1 --2- 172.21.15.163:0/3813042655 >> v2:172.21.15.189:3300/0 conn(0x7f442c151300 0x7f442c0c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:15.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.062+0000 7f442b400640 1 -- 172.21.15.163:0/3813042655 >> v1:172.21.15.189:6789/0 conn(0x7f442c1516e0 legacy=0x7f442c157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:15.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.062+0000 7f442b400640 1 -- 172.21.15.163:0/3813042655 >> v1:172.21.15.163:6789/0 conn(0x7f442c070920 legacy=0x7f442c0c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:15.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.062+0000 7f442b400640 1 -- 172.21.15.163:0/3813042655 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c0c1fd0 con 0x7f442c151300 2024-04-01T17:05:15.070 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.070+0000 7f442b400640 1 --2- 172.21.15.163:0/3813042655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f442c151300 0x7f442c0c8790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f441c0097d0 tx=0x7f441c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fe7875d7332be60 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:15.081 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.081+0000 7f442aa00640 1 -- 172.21.15.163:0/3813042655 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c035020 con 0x7f442c151300 2024-04-01T17:05:15.081 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.081+0000 7f442aa00640 1 -- 172.21.15.163:0/3813042655 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f441c031830 con 0x7f442c151300 2024-04-01T17:05:15.081 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.081+0000 7f442aa00640 1 -- 172.21.15.163:0/3813042655 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c031c00 con 0x7f442c151300 2024-04-01T17:05:15.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.082+0000 7f4432800640 1 -- 172.21.15.163:0/3813042655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f442c151300 msgr2=0x7f442c0c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:15.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.082+0000 7f4432800640 1 --2- 172.21.15.163:0/3813042655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f442c151300 0x7f442c0c8790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f441c0097d0 tx=0x7f441c02b8d0 comp rx=0 tx=0).stop 2024-04-01T17:05:15.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.082+0000 7f4432800640 1 -- 172.21.15.163:0/3813042655 shutdown_connections 2024-04-01T17:05:15.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.082+0000 7f4432800640 1 --2- 172.21.15.163:0/3813042655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f442c151300 0x7f442c0c8790 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:15.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.082+0000 7f4432800640 1 -- 172.21.15.163:0/3813042655 >> 172.21.15.163:0/3813042655 conn(0x7f442c0ccf10 msgr2=0x7f442c0cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:15.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.083+0000 7f4432800640 1 -- 172.21.15.163:0/3813042655 shutdown_connections 2024-04-01T17:05:15.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.083+0000 7f4432800640 1 -- 172.21.15.163:0/3813042655 wait complete. 2024-04-01T17:05:15.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.085+0000 7f4432800640 1 Processor -- start 2024-04-01T17:05:15.085 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.085+0000 7f4432800640 1 -- start start 2024-04-01T17:05:15.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.086+0000 7f4432800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f442c070920 0x7f442c146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:15.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.086+0000 7f4432800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f442c1516e0 0x7f442c154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:15.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.086+0000 7f4432800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f442c144f00 0x7f442c1453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:15.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.086+0000 7f4432800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f442c0b2ee0 con 0x7f442c144f00 2024-04-01T17:05:15.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.086+0000 7f4432800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f442c0c2590 con 0x7f442c1516e0 2024-04-01T17:05:15.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.086+0000 7f4432800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f442c0b3060 con 0x7f442c070920 2024-04-01T17:05:15.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.088+0000 7f442be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f442c144f00 0x7f442c1453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:15.088 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.089+0000 7f442be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f442c144f00 0x7f442c1453b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37970/0 (socket says 172.21.15.163:37970) 2024-04-01T17:05:15.088 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.089+0000 7f442be00640 1 -- 172.21.15.163:0/1782062143 learned_addr learned my addr 172.21.15.163:0/1782062143 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.093+0000 7f442be00640 1 -- 172.21.15.163:0/1782062143 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f442c070920 msgr2=0x7f442c146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.094+0000 7f442be00640 1 --2- 172.21.15.163:0/1782062143 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f442c070920 0x7f442c146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.094+0000 7f442be00640 1 -- 172.21.15.163:0/1782062143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f442c1516e0 msgr2=0x7f442c154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.094+0000 7f442be00640 1 --2- 172.21.15.163:0/1782062143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f442c1516e0 0x7f442c154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.094+0000 7f442be00640 1 -- 172.21.15.163:0/1782062143 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c1489c0 con 0x7f442c144f00 2024-04-01T17:05:15.097 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.098+0000 7f442be00640 1 --2- 172.21.15.163:0/1782062143 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f442c144f00 0x7f442c1453b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f442400c7e0 tx=0x7f442400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:15.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.100+0000 7f4423e00640 1 -- 172.21.15.163:0/1782062143 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424017070 con 0x7f442c144f00 2024-04-01T17:05:15.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.100+0000 7f4432800640 1 -- 172.21.15.163:0/1782062143 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442c148ca0 con 0x7f442c144f00 2024-04-01T17:05:15.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.100+0000 7f4432800640 1 -- 172.21.15.163:0/1782062143 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442c1449e0 con 0x7f442c144f00 2024-04-01T17:05:15.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.101+0000 7f4432800640 1 -- 172.21.15.163:0/1782062143 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442c0756d0 con 0x7f442c144f00 2024-04-01T17:05:15.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.101+0000 7f4423e00640 1 -- 172.21.15.163:0/1782062143 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4424003d80 con 0x7f442c144f00 2024-04-01T17:05:15.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.101+0000 7f4423e00640 1 -- 172.21.15.163:0/1782062143 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424021060 con 0x7f442c144f00 2024-04-01T17:05:15.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.388+0000 7f4423e00640 1 -- 172.21.15.163:0/1782062143 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f442401a070 con 0x7f442c144f00 2024-04-01T17:05:15.389 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.390+0000 7f4423e00640 1 --2- 172.21.15.163:0/1782062143 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f440806c920 0x7f440806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:15.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.391+0000 7f442b400640 1 --2- 172.21.15.163:0/1782062143 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f440806c920 0x7f440806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:15.391 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.392+0000 7f442b400640 1 --2- 172.21.15.163:0/1782062143 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f440806c920 0x7f440806ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f441c036000 tx=0x7f441c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:15.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.406+0000 7f4423e00640 1 -- 172.21.15.163:0/1782062143 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f4424057800 con 0x7f442c144f00 2024-04-01T17:05:15.406 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.407+0000 7f4423e00640 1 -- 172.21.15.163:0/1782062143 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4424059760 con 0x7f442c144f00 2024-04-01T17:05:15.616 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.617+0000 7f4432800640 1 -- 172.21.15.163:0/1782062143 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f442c0c95e0 con 0x7f442c144f00 2024-04-01T17:05:15.636 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.637+0000 7f4423e00640 1 -- 172.21.15.163:0/1782062143 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f442405da60 con 0x7f442c144f00 2024-04-01T17:05:15.637 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2024-04-01T17:05:15.640 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.640+0000 7f4432800640 1 -- 172.21.15.163:0/1782062143 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f440806c920 msgr2=0x7f440806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:15.640 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.640+0000 7f4432800640 1 --2- 172.21.15.163:0/1782062143 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f440806c920 0x7f440806ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f441c036000 tx=0x7f441c030000 comp rx=0 tx=0).stop 2024-04-01T17:05:15.640 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.640+0000 7f4432800640 1 -- 172.21.15.163:0/1782062143 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f442c144f00 msgr2=0x7f442c1453b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:15.640 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.640+0000 7f4432800640 1 --2- 172.21.15.163:0/1782062143 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f442c144f00 0x7f442c1453b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f442400c7e0 tx=0x7f442400cca0 comp rx=0 tx=0).stop 2024-04-01T17:05:15.640 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.640+0000 7f4432800640 1 -- 172.21.15.163:0/1782062143 shutdown_connections 2024-04-01T17:05:15.640 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.640+0000 7f4432800640 1 --2- 172.21.15.163:0/1782062143 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f440806c920 0x7f440806ede0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:15.640 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.640+0000 7f4432800640 1 --2- 172.21.15.163:0/1782062143 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f442c144f00 0x7f442c1453b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:15.640 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.640+0000 7f4432800640 1 --2- 172.21.15.163:0/1782062143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f442c1516e0 0x7f442c154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:15.640 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.640+0000 7f4432800640 1 --2- 172.21.15.163:0/1782062143 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f442c070920 0x7f442c146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:15.640 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.640+0000 7f4432800640 1 -- 172.21.15.163:0/1782062143 >> 172.21.15.163:0/1782062143 conn(0x7f442c0ccf10 msgr2=0x7f442c1573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:15.641 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.640+0000 7f4432800640 1 -- 172.21.15.163:0/1782062143 shutdown_connections 2024-04-01T17:05:15.641 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.640+0000 7f4432800640 1 -- 172.21.15.163:0/1782062143 wait complete. 2024-04-01T17:05:15.659 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T17:05:15.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.867+0000 7ff143200640 1 Processor -- start 2024-04-01T17:05:15.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.867+0000 7ff143200640 1 -- start start 2024-04-01T17:05:15.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.868+0000 7ff143200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff13c0c7e40 0x7ff13c0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:15.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.868+0000 7ff143200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13c15a5c0 0x7ff13c0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:15.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.868+0000 7ff143200640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff13c154c70 con 0x7ff13c154890 2024-04-01T17:05:15.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.868+0000 7ff143200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7ff13c0c94a0 con 0x7ff13c0c7e40 2024-04-01T17:05:15.868 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.868+0000 7ff143200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff13c15ab90 con 0x7ff13c15a5c0 2024-04-01T17:05:15.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.870+0000 7ff141e00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ff13c154890 0x7ff13c0c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:43740/0 (socket says 172.21.15.163:43740) 2024-04-01T17:05:15.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.870+0000 7ff141e00640 1 -- 172.21.15.163:0/2096058297 learned_addr learned my addr 172.21.15.163:0/2096058297 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:15.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.871+0000 7ff142800640 1 --2- 172.21.15.163:0/2096058297 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13c15a5c0 0x7ff13c0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:15.878 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.878+0000 7ff142800640 1 -- 172.21.15.163:0/2096058297 >> v2:172.21.15.163:3300/0 conn(0x7ff13c0c7e40 msgr2=0x7ff13c0ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:15.878 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.878+0000 7ff141400640 1 --2- 172.21.15.163:0/2096058297 >> v2:172.21.15.163:3300/0 conn(0x7ff13c0c7e40 0x7ff13c0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:15.878 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.879+0000 7ff142800640 1 --2- 172.21.15.163:0/2096058297 >> v2:172.21.15.163:3300/0 conn(0x7ff13c0c7e40 0x7ff13c0ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:15.878 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.879+0000 7ff142800640 1 -- 172.21.15.163:0/2096058297 >> v1:172.21.15.189:6789/0 conn(0x7ff13c154890 legacy=0x7ff13c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:15.879 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.879+0000 7ff142800640 1 -- 172.21.15.163:0/2096058297 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13c15ae70 con 0x7ff13c15a5c0 2024-04-01T17:05:15.885 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.886+0000 7ff142800640 1 --2- 172.21.15.163:0/2096058297 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13c15a5c0 0x7ff13c0cd0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff138009d90 tx=0x7ff13802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b261a8280949d7ba server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:15.999 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.999+0000 7ff140a00640 1 -- 172.21.15.163:0/2096058297 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff138039070 con 0x7ff13c15a5c0 2024-04-01T17:05:15.999 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.999+0000 7ff140a00640 1 -- 172.21.15.163:0/2096058297 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13802cce0 con 0x7ff13c15a5c0 2024-04-01T17:05:15.999 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:15.999+0000 7ff140a00640 1 -- 172.21.15.163:0/2096058297 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff138034660 con 0x7ff13c15a5c0 2024-04-01T17:05:16.000 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.000+0000 7ff143200640 1 -- 172.21.15.163:0/2096058297 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13c15a5c0 msgr2=0x7ff13c0cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:16.000 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.000+0000 7ff143200640 1 --2- 172.21.15.163:0/2096058297 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13c15a5c0 0x7ff13c0cd0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff138009d90 tx=0x7ff13802bf30 comp rx=0 tx=0).stop 2024-04-01T17:05:16.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.001+0000 7ff143200640 1 -- 172.21.15.163:0/2096058297 shutdown_connections 2024-04-01T17:05:16.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.001+0000 7ff143200640 1 --2- 172.21.15.163:0/2096058297 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13c15a5c0 0x7ff13c0cd0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:16.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.001+0000 7ff143200640 1 --2- 172.21.15.163:0/2096058297 >> v2:172.21.15.163:3300/0 conn(0x7ff13c0c7e40 0x7ff13c0ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:16.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.001+0000 7ff143200640 1 -- 172.21.15.163:0/2096058297 >> 172.21.15.163:0/2096058297 conn(0x7ff13c0678b0 msgr2=0x7ff13c072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:16.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.001+0000 7ff143200640 1 -- 172.21.15.163:0/2096058297 shutdown_connections 2024-04-01T17:05:16.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.001+0000 7ff143200640 1 -- 172.21.15.163:0/2096058297 wait complete. 2024-04-01T17:05:16.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.004+0000 7ff143200640 1 Processor -- start 2024-04-01T17:05:16.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.004+0000 7ff143200640 1 -- start start 2024-04-01T17:05:16.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.005+0000 7ff143200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13c0c7e40 0x7ff13c159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:16.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.005+0000 7ff143200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13c154890 0x7ff13c1e63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:16.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.005+0000 7ff143200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff13c15a5c0 0x7ff13c1441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:16.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.005+0000 7ff143200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c0c96f0 con 0x7ff13c15a5c0 2024-04-01T17:05:16.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.005+0000 7ff143200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c15b430 con 0x7ff13c0c7e40 2024-04-01T17:05:16.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.005+0000 7ff143200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff13c0c84c0 con 0x7ff13c154890 2024-04-01T17:05:16.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.007+0000 7ff142800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff13c15a5c0 0x7ff13c1441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:16.007 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.007+0000 7ff141400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13c154890 0x7ff13c1e63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:16.007 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.007+0000 7ff142800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff13c15a5c0 0x7ff13c1441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37988/0 (socket says 172.21.15.163:37988) 2024-04-01T17:05:16.007 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.007+0000 7ff142800640 1 -- 172.21.15.163:0/2718248591 learned_addr learned my addr 172.21.15.163:0/2718248591 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:16.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.016+0000 7ff142800640 1 -- 172.21.15.163:0/2718248591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13c154890 msgr2=0x7ff13c1e63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:16.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.016+0000 7ff142800640 1 --2- 172.21.15.163:0/2718248591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13c154890 0x7ff13c1e63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:16.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.016+0000 7ff142800640 1 -- 172.21.15.163:0/2718248591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13c0c7e40 msgr2=0x7ff13c159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:16.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.016+0000 7ff142800640 1 --2- 172.21.15.163:0/2718248591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13c0c7e40 0x7ff13c159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:16.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.016+0000 7ff142800640 1 -- 172.21.15.163:0/2718248591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13c1e76f0 con 0x7ff13c15a5c0 2024-04-01T17:05:16.021 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.021+0000 7ff142800640 1 --2- 172.21.15.163:0/2718248591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff13c15a5c0 0x7ff13c1441c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff138009eb0 tx=0x7ff138004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:16.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.028+0000 7ff136000640 1 -- 172.21.15.163:0/2718248591 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff138044020 con 0x7ff13c15a5c0 2024-04-01T17:05:16.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.028+0000 7ff136000640 1 -- 172.21.15.163:0/2718248591 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13803f670 con 0x7ff13c15a5c0 2024-04-01T17:05:16.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.028+0000 7ff136000640 1 -- 172.21.15.163:0/2718248591 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff138039040 con 0x7ff13c15a5c0 2024-04-01T17:05:16.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.028+0000 7ff143200640 1 -- 172.21.15.163:0/2718248591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13c1e7990 con 0x7ff13c15a5c0 2024-04-01T17:05:16.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.028+0000 7ff143200640 1 -- 172.21.15.163:0/2718248591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff13c1f1130 con 0x7ff13c15a5c0 2024-04-01T17:05:16.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.030+0000 7ff143200640 1 -- 172.21.15.163:0/2718248591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff13c0756d0 con 0x7ff13c15a5c0 2024-04-01T17:05:16.068 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.069+0000 7ff136000640 1 -- 172.21.15.163:0/2718248591 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff138047020 con 0x7ff13c15a5c0 2024-04-01T17:05:16.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.070+0000 7ff136000640 1 --2- 172.21.15.163:0/2718248591 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff12006c940 0x7ff12006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:16.070 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.070+0000 7ff141e00640 1 --2- 172.21.15.163:0/2718248591 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff12006c940 0x7ff12006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:16.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.071+0000 7ff141e00640 1 --2- 172.21.15.163:0/2718248591 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff12006c940 0x7ff12006ee00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff130000f60 tx=0x7ff130007a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:16.405 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.405+0000 7ff136000640 1 -- 172.21.15.163:0/2718248591 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7ff13807a9c0 con 0x7ff13c15a5c0 2024-04-01T17:05:16.406 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.406+0000 7ff136000640 1 -- 172.21.15.163:0/2718248591 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff13804e030 con 0x7ff13c15a5c0 2024-04-01T17:05:16.633 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.634+0000 7ff143200640 1 -- 172.21.15.163:0/2718248591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff13c0c9070 con 0x7ff13c15a5c0 2024-04-01T17:05:16.654 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.654+0000 7ff136000640 1 -- 172.21.15.163:0/2718248591 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ff13807d020 con 0x7ff13c15a5c0 2024-04-01T17:05:16.654 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2024-04-01T17:05:16.657 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.657+0000 7ff143200640 1 -- 172.21.15.163:0/2718248591 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff12006c940 msgr2=0x7ff12006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:16.658 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.657+0000 7ff143200640 1 --2- 172.21.15.163:0/2718248591 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff12006c940 0x7ff12006ee00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff130000f60 tx=0x7ff130007a80 comp rx=0 tx=0).stop 2024-04-01T17:05:16.658 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.657+0000 7ff143200640 1 -- 172.21.15.163:0/2718248591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff13c15a5c0 msgr2=0x7ff13c1441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:16.658 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.657+0000 7ff143200640 1 --2- 172.21.15.163:0/2718248591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff13c15a5c0 0x7ff13c1441c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff138009eb0 tx=0x7ff138004a40 comp rx=0 tx=0).stop 2024-04-01T17:05:16.658 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.657+0000 7ff143200640 1 -- 172.21.15.163:0/2718248591 shutdown_connections 2024-04-01T17:05:16.658 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.657+0000 7ff143200640 1 --2- 172.21.15.163:0/2718248591 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff12006c940 0x7ff12006ee00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:16.658 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.657+0000 7ff143200640 1 --2- 172.21.15.163:0/2718248591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff13c15a5c0 0x7ff13c1441c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:16.658 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.657+0000 7ff143200640 1 --2- 172.21.15.163:0/2718248591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff13c154890 0x7ff13c1e63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:16.658 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.657+0000 7ff143200640 1 --2- 172.21.15.163:0/2718248591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13c0c7e40 0x7ff13c159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:16.658 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.658+0000 7ff143200640 1 -- 172.21.15.163:0/2718248591 >> 172.21.15.163:0/2718248591 conn(0x7ff13c0678b0 msgr2=0x7ff13c1533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:16.658 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.658+0000 7ff143200640 1 -- 172.21.15.163:0/2718248591 shutdown_connections 2024-04-01T17:05:16.658 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.658+0000 7ff143200640 1 -- 172.21.15.163:0/2718248591 wait complete. 2024-04-01T17:05:16.681 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-01T17:05:16.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.891+0000 7fb51d400640 1 Processor -- start 2024-04-01T17:05:16.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.891+0000 7fb51d400640 1 -- start start 2024-04-01T17:05:16.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.893+0000 7fb51d400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fb51806dfb0 0x7fb51815a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:16.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.893+0000 7fb51d400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51806c9e0 con 0x7fb51806c410 2024-04-01T17:05:16.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.893+0000 7fb51d400640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51806ccc0 con 0x7fb518154ae0 2024-04-01T17:05:16.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.893+0000 7fb51d400640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fb51806cfa0 con 0x7fb51806dfb0 2024-04-01T17:05:16.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.895+0000 7fb516800640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb518154ae0 0x7fb5180ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:43754/0 (socket says 172.21.15.163:43754) 2024-04-01T17:05:16.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.895+0000 7fb516800640 1 -- 172.21.15.163:0/2003493747 learned_addr learned my addr 172.21.15.163:0/2003493747 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:16.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.896+0000 7fb50de00640 1 --2- 172.21.15.163:0/2003493747 >> v2:172.21.15.189:3300/0 conn(0x7fb51806dfb0 0x7fb51815a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:16.907 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.908+0000 7fb50de00640 1 -- 172.21.15.163:0/2003493747 >> v1:172.21.15.189:6789/0 conn(0x7fb518154ae0 legacy=0x7fb5180ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:16.907 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.908+0000 7fb50de00640 1 -- 172.21.15.163:0/2003493747 >> v1:172.21.15.163:6789/0 conn(0x7fb51806c410 legacy=0x7fb5180cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:16.907 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.908+0000 7fb50de00640 1 -- 172.21.15.163:0/2003493747 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51806d280 con 0x7fb51806dfb0 2024-04-01T17:05:16.927 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:16.927+0000 7fb50de00640 1 --2- 172.21.15.163:0/2003493747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb51806dfb0 0x7fb51815a740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb5000097a0 tx=0x7fb50002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d691242a4b9ab51 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:17.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.001+0000 7fb515e00640 1 -- 172.21.15.163:0/2003493747 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500035020 con 0x7fb51806dfb0 2024-04-01T17:05:17.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.001+0000 7fb515e00640 1 -- 172.21.15.163:0/2003493747 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb500031830 con 0x7fb51806dfb0 2024-04-01T17:05:17.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.001+0000 7fb515e00640 1 -- 172.21.15.163:0/2003493747 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500031c00 con 0x7fb51806dfb0 2024-04-01T17:05:17.002 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.002+0000 7fb51d400640 1 -- 172.21.15.163:0/2003493747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb51806dfb0 msgr2=0x7fb51815a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:17.002 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.002+0000 7fb51d400640 1 --2- 172.21.15.163:0/2003493747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb51806dfb0 0x7fb51815a740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb5000097a0 tx=0x7fb50002b8d0 comp rx=0 tx=0).stop 2024-04-01T17:05:17.002 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.003+0000 7fb51d400640 1 -- 172.21.15.163:0/2003493747 shutdown_connections 2024-04-01T17:05:17.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.003+0000 7fb51d400640 1 --2- 172.21.15.163:0/2003493747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb51806dfb0 0x7fb51815a740 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:17.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.003+0000 7fb51d400640 1 -- 172.21.15.163:0/2003493747 >> 172.21.15.163:0/2003493747 conn(0x7fb5180676a0 msgr2=0x7fb518067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:17.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.003+0000 7fb51d400640 1 -- 172.21.15.163:0/2003493747 shutdown_connections 2024-04-01T17:05:17.003 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.003+0000 7fb51d400640 1 -- 172.21.15.163:0/2003493747 wait complete. 2024-04-01T17:05:17.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.007+0000 7fb51d400640 1 Processor -- start 2024-04-01T17:05:17.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.007+0000 7fb51d400640 1 -- start start 2024-04-01T17:05:17.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.008+0000 7fb51d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb51806c410 0x7fb5180b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:17.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.008+0000 7fb51d400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb51806dfb0 0x7fb518152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:17.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.009+0000 7fb51d400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb518154ae0 0x7fb5181f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:17.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.009+0000 7fb51d400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb5180cd860 con 0x7fb518154ae0 2024-04-01T17:05:17.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.009+0000 7fb51d400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb5180cd6e0 con 0x7fb51806c410 2024-04-01T17:05:17.008 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.009+0000 7fb51d400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb5180cc4c0 con 0x7fb51806dfb0 2024-04-01T17:05:17.010 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.011+0000 7fb50de00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb51806dfb0 0x7fb518152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:17.011 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.011+0000 7fb517200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb518154ae0 0x7fb5181f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:17.011 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.012+0000 7fb50de00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb51806dfb0 0x7fb518152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:51210/0 (socket says 172.21.15.163:51210) 2024-04-01T17:05:17.011 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.012+0000 7fb50de00640 1 -- 172.21.15.163:0/3520144190 learned_addr learned my addr 172.21.15.163:0/3520144190 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:17.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.017+0000 7fb516800640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb51806c410 0x7fb5180b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:17.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.017+0000 7fb517200640 1 -- 172.21.15.163:0/3520144190 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb51806dfb0 msgr2=0x7fb518152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:17.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.017+0000 7fb517200640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb51806dfb0 0x7fb518152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:17.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.017+0000 7fb517200640 1 -- 172.21.15.163:0/3520144190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb51806c410 msgr2=0x7fb5180b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:17.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.017+0000 7fb517200640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb51806c410 0x7fb5180b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:17.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.017+0000 7fb517200640 1 -- 172.21.15.163:0/3520144190 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5181e3ca0 con 0x7fb518154ae0 2024-04-01T17:05:17.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.020+0000 7fb517200640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb518154ae0 0x7fb5181f0760 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb51000c410 tx=0x7fb51000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:17.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.028+0000 7fb50f400640 1 -- 172.21.15.163:0/3520144190 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510011790 con 0x7fb518154ae0 2024-04-01T17:05:17.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.028+0000 7fb50f400640 1 -- 172.21.15.163:0/3520144190 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb510017070 con 0x7fb518154ae0 2024-04-01T17:05:17.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.028+0000 7fb50f400640 1 -- 172.21.15.163:0/3520144190 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510011bb0 con 0x7fb518154ae0 2024-04-01T17:05:17.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.029+0000 7fb51d400640 1 -- 172.21.15.163:0/3520144190 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5181e3f80 con 0x7fb518154ae0 2024-04-01T17:05:17.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.029+0000 7fb51d400640 1 -- 172.21.15.163:0/3520144190 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5181e4540 con 0x7fb518154ae0 2024-04-01T17:05:17.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.030+0000 7fb51d400640 1 -- 172.21.15.163:0/3520144190 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb518073bb0 con 0x7fb518154ae0 2024-04-01T17:05:17.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.157+0000 7fb50f400640 1 -- 172.21.15.163:0/3520144190 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb510007020 con 0x7fb518154ae0 2024-04-01T17:05:17.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.158+0000 7fb50f400640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb4f406c940 0x7fb4f406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:17.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.159+0000 7fb516800640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb4f406c940 0x7fb4f406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:17.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.161+0000 7fb516800640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb4f406c940 0x7fb4f406ee00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb508005c00 tx=0x7fb508009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:17.497 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.497+0000 7fb50f400640 1 -- 172.21.15.163:0/3520144190 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fb510057e00 con 0x7fb518154ae0 2024-04-01T17:05:17.498 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.498+0000 7fb50f400640 1 -- 172.21.15.163:0/3520144190 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb510021020 con 0x7fb518154ae0 2024-04-01T17:05:17.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.730+0000 7fb51d400640 1 -- 172.21.15.163:0/3520144190 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb5180756d0 con 0x7fb518154ae0 2024-04-01T17:05:17.749 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.749+0000 7fb50f400640 1 -- 172.21.15.163:0/3520144190 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fb51005a460 con 0x7fb518154ae0 2024-04-01T17:05:17.749 INFO:teuthology.orchestra.run.smithi163.stderr:listed 0 entries 2024-04-01T17:05:17.752 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.752+0000 7fb51d400640 1 -- 172.21.15.163:0/3520144190 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb4f406c940 msgr2=0x7fb4f406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:17.752 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.752+0000 7fb51d400640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb4f406c940 0x7fb4f406ee00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb508005c00 tx=0x7fb508009040 comp rx=0 tx=0).stop 2024-04-01T17:05:17.752 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.752+0000 7fb51d400640 1 -- 172.21.15.163:0/3520144190 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb518154ae0 msgr2=0x7fb5181f0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:17.753 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.752+0000 7fb51d400640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb518154ae0 0x7fb5181f0760 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb51000c410 tx=0x7fb51000c8d0 comp rx=0 tx=0).stop 2024-04-01T17:05:17.753 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.752+0000 7fb51d400640 1 -- 172.21.15.163:0/3520144190 shutdown_connections 2024-04-01T17:05:17.753 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.752+0000 7fb51d400640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb4f406c940 0x7fb4f406ee00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:17.753 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.752+0000 7fb51d400640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb518154ae0 0x7fb5181f0760 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:17.753 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.752+0000 7fb51d400640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb51806dfb0 0x7fb518152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:17.753 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.752+0000 7fb51d400640 1 --2- 172.21.15.163:0/3520144190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb51806c410 0x7fb5180b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:17.753 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.752+0000 7fb51d400640 1 -- 172.21.15.163:0/3520144190 >> 172.21.15.163:0/3520144190 conn(0x7fb5180676a0 msgr2=0x7fb5181585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:17.753 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.753+0000 7fb51d400640 1 -- 172.21.15.163:0/3520144190 shutdown_connections 2024-04-01T17:05:17.753 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:17.753+0000 7fb51d400640 1 -- 172.21.15.163:0/3520144190 wait complete. 2024-04-01T17:05:17.772 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-01T17:05:17.772 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T17:05:17.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T17:05:18.026 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.026+0000 7fcc3b000640 1 Processor -- start 2024-04-01T17:05:18.026 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.027+0000 7fcc3b000640 1 -- start start 2024-04-01T17:05:18.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.028+0000 7fcc3b000640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fcc340c1da0 0x7fcc340c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:18.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.028+0000 7fcc3b000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 0x7fcc3415f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:18.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.028+0000 7fcc3b000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc34162080 con 0x7fcc340735e0 2024-04-01T17:05:18.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.028+0000 7fcc3b000640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fcc34163020 con 0x7fcc340c1da0 2024-04-01T17:05:18.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.028+0000 7fcc3b000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcc3406f740 con 0x7fcc3415f270 2024-04-01T17:05:18.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.029+0000 7fcc33400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fcc340735e0 0x7fcc34071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:57726/0 (socket says 172.21.15.163:57726) 2024-04-01T17:05:18.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.029+0000 7fcc33400640 1 -- 172.21.15.163:0/1663999614 learned_addr learned my addr 172.21.15.163:0/1663999614 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:18.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.030+0000 7fcc39000640 1 --2- 172.21.15.163:0/1663999614 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 0x7fcc3415f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:18.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.032+0000 7fcc32a00640 1 -- 172.21.15.163:0/1663999614 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425385273 0 0) 0x7fcc1c001490 con 0x7fcc340735e0 2024-04-01T17:05:18.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.033+0000 7fcc32a00640 1 -- 172.21.15.163:0/1663999614 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc14003520 con 0x7fcc340735e0 2024-04-01T17:05:18.037 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.037+0000 7fcc39000640 1 -- 172.21.15.163:0/1663999614 >> v2:172.21.15.189:3300/0 conn(0x7fcc340c1da0 msgr2=0x7fcc340c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:18.037 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.037+0000 7fcc39000640 1 --2- 172.21.15.163:0/1663999614 >> v2:172.21.15.189:3300/0 conn(0x7fcc340c1da0 0x7fcc340c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:18.037 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.037+0000 7fcc39000640 1 -- 172.21.15.163:0/1663999614 >> v1:172.21.15.163:6789/0 conn(0x7fcc340735e0 legacy=0x7fcc34071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:18.037 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.037+0000 7fcc39000640 1 -- 172.21.15.163:0/1663999614 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3415ea90 con 0x7fcc3415f270 2024-04-01T17:05:18.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.048+0000 7fcc39000640 1 --2- 172.21.15.163:0/1663999614 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 0x7fcc3415f6e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0097a0 tx=0x7fcc2c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42054a274a7aae97 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:18.060 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.061+0000 7fcc32a00640 1 -- 172.21.15.163:0/1663999614 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c035020 con 0x7fcc3415f270 2024-04-01T17:05:18.060 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.061+0000 7fcc32a00640 1 -- 172.21.15.163:0/1663999614 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2c031830 con 0x7fcc3415f270 2024-04-01T17:05:18.061 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.061+0000 7fcc32a00640 1 -- 172.21.15.163:0/1663999614 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c031c00 con 0x7fcc3415f270 2024-04-01T17:05:18.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.062+0000 7fcc3b000640 1 -- 172.21.15.163:0/1663999614 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 msgr2=0x7fcc3415f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:18.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.062+0000 7fcc3b000640 1 --2- 172.21.15.163:0/1663999614 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 0x7fcc3415f6e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0097a0 tx=0x7fcc2c02b8d0 comp rx=0 tx=0).stop 2024-04-01T17:05:18.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.062+0000 7fcc3b000640 1 -- 172.21.15.163:0/1663999614 shutdown_connections 2024-04-01T17:05:18.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.062+0000 7fcc3b000640 1 --2- 172.21.15.163:0/1663999614 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 0x7fcc3415f6e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:18.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.062+0000 7fcc3b000640 1 --2- 172.21.15.163:0/1663999614 >> v2:172.21.15.189:3300/0 conn(0x7fcc340c1da0 0x7fcc340c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:18.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.062+0000 7fcc3b000640 1 -- 172.21.15.163:0/1663999614 >> 172.21.15.163:0/1663999614 conn(0x7fcc340cbe20 msgr2=0x7fcc340cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:18.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.063+0000 7fcc3b000640 1 -- 172.21.15.163:0/1663999614 shutdown_connections 2024-04-01T17:05:18.063 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.063+0000 7fcc3b000640 1 -- 172.21.15.163:0/1663999614 wait complete. 2024-04-01T17:05:18.066 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.066+0000 7fcc3b000640 1 Processor -- start 2024-04-01T17:05:18.066 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.066+0000 7fcc3b000640 1 -- start start 2024-04-01T17:05:18.068 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.068+0000 7fcc3b000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc340735e0 0x7fcc341f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:18.068 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.068+0000 7fcc3b000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc340c1da0 0x7fcc341541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:18.068 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.068+0000 7fcc3b000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 0x7fcc340c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:18.068 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.068+0000 7fcc3b000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3406fc70 con 0x7fcc340c1da0 2024-04-01T17:05:18.068 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.068+0000 7fcc3b000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3406f990 con 0x7fcc340735e0 2024-04-01T17:05:18.068 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.068+0000 7fcc3b000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fcc3406ff50 con 0x7fcc3415f270 2024-04-01T17:05:18.070 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.071+0000 7fcc39000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 0x7fcc340c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:18.072 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.073+0000 7fcc39000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 0x7fcc340c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:51228/0 (socket says 172.21.15.163:51228) 2024-04-01T17:05:18.072 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.073+0000 7fcc39000640 1 -- 172.21.15.163:0/4204064913 learned_addr learned my addr 172.21.15.163:0/4204064913 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:18.072 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.073+0000 7fcc33e00640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc340735e0 0x7fcc341f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:18.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.077+0000 7fcc33400640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc340c1da0 0x7fcc341541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:18.081 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.082+0000 7fcc39000640 1 -- 172.21.15.163:0/4204064913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc340735e0 msgr2=0x7fcc341f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:18.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.082+0000 7fcc39000640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc340735e0 0x7fcc341f4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:18.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.082+0000 7fcc39000640 1 -- 172.21.15.163:0/4204064913 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc340c1da0 msgr2=0x7fcc341541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:18.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.082+0000 7fcc39000640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc340c1da0 0x7fcc341541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:18.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.082+0000 7fcc39000640 1 -- 172.21.15.163:0/4204064913 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc341ea7e0 con 0x7fcc3415f270 2024-04-01T17:05:18.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.090+0000 7fcc39000640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 0x7fcc340c8b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c02bee0 tx=0x7fcc2c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:18.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.194+0000 7fcc2be00640 1 -- 172.21.15.163:0/4204064913 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c035040 con 0x7fcc3415f270 2024-04-01T17:05:18.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.194+0000 7fcc2be00640 1 -- 172.21.15.163:0/4204064913 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2c03f070 con 0x7fcc3415f270 2024-04-01T17:05:18.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.194+0000 7fcc2be00640 1 -- 172.21.15.163:0/4204064913 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c03bb40 con 0x7fcc3415f270 2024-04-01T17:05:18.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.194+0000 7fcc3b000640 1 -- 172.21.15.163:0/4204064913 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc341eaa80 con 0x7fcc3415f270 2024-04-01T17:05:18.194 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.194+0000 7fcc3b000640 1 -- 172.21.15.163:0/4204064913 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc341e9340 con 0x7fcc3415f270 2024-04-01T17:05:18.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.196+0000 7fcc3b000640 1 -- 172.21.15.163:0/4204064913 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc34072880 con 0x7fcc3415f270 2024-04-01T17:05:18.486 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.486+0000 7fcc2be00640 1 -- 172.21.15.163:0/4204064913 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc2c038020 con 0x7fcc3415f270 2024-04-01T17:05:18.488 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.488+0000 7fcc2be00640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fcc1006c940 0x7fcc1006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:18.488 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.489+0000 7fcc33e00640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fcc1006c940 0x7fcc1006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:18.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.491+0000 7fcc33e00640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fcc1006c940 0x7fcc1006ee00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcc240098e0 tx=0x7fcc24009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:18.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.494+0000 7fcc2be00640 1 -- 172.21.15.163:0/4204064913 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fcc2c0798c0 con 0x7fcc3415f270 2024-04-01T17:05:18.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.512+0000 7fcc2be00640 1 -- 172.21.15.163:0/4204064913 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcc2c07b820 con 0x7fcc3415f270 2024-04-01T17:05:18.735 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.736+0000 7fcc3b000640 1 -- 172.21.15.163:0/4204064913 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc341e97e0 con 0x7fcc3415f270 2024-04-01T17:05:18.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.828+0000 7fcc2be00640 1 -- 172.21.15.163:0/4204064913 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+16901 (secure 0 0 0) 0x7fcc2c07fb20 con 0x7fcc3415f270 2024-04-01T17:05:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T17:05:18.828 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":27,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:53.160271+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T16:34:29.028272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T16:34:31.534879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T17:05:18.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.831+0000 7fcc3b000640 1 -- 172.21.15.163:0/4204064913 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fcc1006c940 msgr2=0x7fcc1006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:18.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.831+0000 7fcc3b000640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fcc1006c940 0x7fcc1006ee00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcc240098e0 tx=0x7fcc24009060 comp rx=0 tx=0).stop 2024-04-01T17:05:18.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.831+0000 7fcc3b000640 1 -- 172.21.15.163:0/4204064913 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 msgr2=0x7fcc340c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:18.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.831+0000 7fcc3b000640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 0x7fcc340c8b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c02bee0 tx=0x7fcc2c0046c0 comp rx=0 tx=0).stop 2024-04-01T17:05:18.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.831+0000 7fcc3b000640 1 -- 172.21.15.163:0/4204064913 shutdown_connections 2024-04-01T17:05:18.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.831+0000 7fcc3b000640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fcc1006c940 0x7fcc1006ee00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:18.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.831+0000 7fcc3b000640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fcc3415f270 0x7fcc340c8b20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:18.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.831+0000 7fcc3b000640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc340c1da0 0x7fcc341541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:18.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.831+0000 7fcc3b000640 1 --2- 172.21.15.163:0/4204064913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc340735e0 0x7fcc341f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:18.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.831+0000 7fcc3b000640 1 -- 172.21.15.163:0/4204064913 >> 172.21.15.163:0/4204064913 conn(0x7fcc340cbe20 msgr2=0x7fcc34071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:18.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.831+0000 7fcc3b000640 1 -- 172.21.15.163:0/4204064913 shutdown_connections 2024-04-01T17:05:18.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:18.831+0000 7fcc3b000640 1 -- 172.21.15.163:0/4204064913 wait complete. 2024-04-01T17:05:18.850 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T16:34:05.291874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T16:34:29.028272+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T16:34:31.534879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T17:05:18.851 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T17:05:19.060 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.060+0000 7fe560800640 1 Processor -- start 2024-04-01T17:05:19.060 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.060+0000 7fe560800640 1 -- start start 2024-04-01T17:05:19.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.062+0000 7fe560800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55806eec0 0x7fe558158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:19.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.062+0000 7fe560800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fe558158bb0 0x7fe558159040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:19.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.062+0000 7fe560800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5580c7620 con 0x7fe558152a10 2024-04-01T17:05:19.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.062+0000 7fe560800640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fe558152df0 con 0x7fe558158bb0 2024-04-01T17:05:19.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.062+0000 7fe560800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe55806f320 con 0x7fe55806eec0 2024-04-01T17:05:19.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.063+0000 7fe55de00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fe558152a10 0x7fe5580c4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:57738/0 (socket says 172.21.15.163:57738) 2024-04-01T17:05:19.062 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.063+0000 7fe55de00640 1 -- 172.21.15.163:0/3240942591 learned_addr learned my addr 172.21.15.163:0/3240942591 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:19.063 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.064+0000 7fe55e800640 1 --2- 172.21.15.163:0/3240942591 >> v2:172.21.15.189:3300/0 conn(0x7fe558158bb0 0x7fe558159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:19.063 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.064+0000 7fe55d400640 1 --2- 172.21.15.163:0/3240942591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55806eec0 0x7fe558158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:19.066 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.066+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086776278 0 0) 0x7fe5580c7620 con 0x7fe558152a10 2024-04-01T17:05:19.066 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.066+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe540003520 con 0x7fe558152a10 2024-04-01T17:05:19.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2754546600 0 0) 0x7fe540003520 con 0x7fe558152a10 2024-04-01T17:05:19.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55806eec0 msgr2=0x7fe558158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:19.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 --2- 172.21.15.163:0/3240942591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55806eec0 0x7fe558158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:19.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 >> v2:172.21.15.189:3300/0 conn(0x7fe558158bb0 msgr2=0x7fe558159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:19.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 --2- 172.21.15.163:0/3240942591 >> v2:172.21.15.189:3300/0 conn(0x7fe558158bb0 0x7fe558159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:19.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55806ead0 con 0x7fe558152a10 2024-04-01T17:05:19.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7fe54c001670 con 0x7fe558152a10 2024-04-01T17:05:19.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 >> v1:172.21.15.163:6789/0 conn(0x7fe558152a10 legacy=0x7fe5580c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:19.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 --2- 172.21.15.163:0/3240942591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5400039b0 0x7fe540003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:19.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 --2- 172.21.15.163:0/3240942591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55806eec0 0x7fe540004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:19.072 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 --2- 172.21.15.163:0/3240942591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe540004d40 0x7fe5400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:19.072 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe558152df0 con 0x7fe5400039b0 2024-04-01T17:05:19.072 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe55806f320 con 0x7fe540004d40 2024-04-01T17:05:19.072 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.071+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe54000fdd0 con 0x7fe55806eec0 2024-04-01T17:05:19.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.075+0000 7fe55de00640 1 --2- 172.21.15.163:0/3240942591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5400039b0 0x7fe540003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:19.080 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.080+0000 7fe55e800640 1 --2- 172.21.15.163:0/3240942591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe540004d40 0x7fe5400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:19.081 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.082+0000 7fe55d400640 1 --2- 172.21.15.163:0/3240942591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55806eec0 0x7fe540004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:19.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.084+0000 7fe55de00640 1 -- 172.21.15.163:0/3240942591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55806eec0 msgr2=0x7fe540004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:19.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.084+0000 7fe55de00640 1 --2- 172.21.15.163:0/3240942591 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55806eec0 0x7fe540004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:19.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.084+0000 7fe55de00640 1 -- 172.21.15.163:0/3240942591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe540004d40 msgr2=0x7fe5400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:19.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.084+0000 7fe55de00640 1 --2- 172.21.15.163:0/3240942591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe540004d40 0x7fe5400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:19.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.084+0000 7fe55de00640 1 -- 172.21.15.163:0/3240942591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe540003520 con 0x7fe5400039b0 2024-04-01T17:05:19.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.089+0000 7fe55de00640 1 --2- 172.21.15.163:0/3240942591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5400039b0 0x7fe540003dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00c190 tx=0x7fe540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511af3d83c96721 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:19.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.094+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c007c60 con 0x7fe5400039b0 2024-04-01T17:05:19.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.099+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54c030070 con 0x7fe5400039b0 2024-04-01T17:05:19.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.099+0000 7fe55ca00640 1 -- 172.21.15.163:0/3240942591 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c005d30 con 0x7fe5400039b0 2024-04-01T17:05:19.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.100+0000 7fe560800640 1 -- 172.21.15.163:0/3240942591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5400039b0 msgr2=0x7fe540003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:19.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.100+0000 7fe560800640 1 --2- 172.21.15.163:0/3240942591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5400039b0 0x7fe540003dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00c190 tx=0x7fe540005830 comp rx=0 tx=0).stop 2024-04-01T17:05:19.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.101+0000 7fe55e800640 1 -- 172.21.15.163:0/3240942591 reap_dead start 2024-04-01T17:05:19.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.101+0000 7fe560800640 1 -- 172.21.15.163:0/3240942591 shutdown_connections 2024-04-01T17:05:19.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.101+0000 7fe560800640 1 -- 172.21.15.163:0/3240942591 >> 172.21.15.163:0/3240942591 conn(0x7fe5580c8a00 msgr2=0x7fe5580c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:19.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.101+0000 7fe560800640 1 -- 172.21.15.163:0/3240942591 shutdown_connections 2024-04-01T17:05:19.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.101+0000 7fe560800640 1 -- 172.21.15.163:0/3240942591 wait complete. 2024-04-01T17:05:19.104 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.105+0000 7fe560800640 1 Processor -- start 2024-04-01T17:05:19.104 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.105+0000 7fe560800640 1 -- start start 2024-04-01T17:05:19.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.107+0000 7fe560800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe55814b360 0x7fe5581efe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:19.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.107+0000 7fe560800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55814b740 0x7fe5581ec410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:19.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.107+0000 7fe560800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5580c2d90 0x7fe5581ec950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:19.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.107+0000 7fe560800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe5580c7e50 con 0x7fe5580c2d90 2024-04-01T17:05:19.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.107+0000 7fe560800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5580c7b70 con 0x7fe55814b360 2024-04-01T17:05:19.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.107+0000 7fe560800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fe5580c8130 con 0x7fe55814b740 2024-04-01T17:05:19.108 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.109+0000 7fe55d400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55814b740 0x7fe5581ec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:19.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.110+0000 7fe55d400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55814b740 0x7fe5581ec410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:51260/0 (socket says 172.21.15.163:51260) 2024-04-01T17:05:19.109 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.110+0000 7fe55d400640 1 -- 172.21.15.163:0/2956016077 learned_addr learned my addr 172.21.15.163:0/2956016077 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:19.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.111+0000 7fe55de00640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe55814b360 0x7fe5581efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:19.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.112+0000 7fe55e800640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5580c2d90 0x7fe5581ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:19.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.121+0000 7fe55d400640 1 -- 172.21.15.163:0/2956016077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe55814b360 msgr2=0x7fe5581efe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:19.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.121+0000 7fe55d400640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe55814b360 0x7fe5581efe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:19.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.121+0000 7fe55d400640 1 -- 172.21.15.163:0/2956016077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5580c2d90 msgr2=0x7fe5581ec950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:19.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.121+0000 7fe55d400640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5580c2d90 0x7fe5581ec950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:19.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.121+0000 7fe55d400640 1 -- 172.21.15.163:0/2956016077 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5580ca5b0 con 0x7fe55814b740 2024-04-01T17:05:19.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.128+0000 7fe55d400640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55814b740 0x7fe5581ec410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe548011570 tx=0x7fe548011a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:19.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.139+0000 7fe552000640 1 -- 172.21.15.163:0/2956016077 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548015930 con 0x7fe55814b740 2024-04-01T17:05:19.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.139+0000 7fe552000640 1 -- 172.21.15.163:0/2956016077 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe548015ad0 con 0x7fe55814b740 2024-04-01T17:05:19.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.139+0000 7fe552000640 1 -- 172.21.15.163:0/2956016077 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54800f460 con 0x7fe55814b740 2024-04-01T17:05:19.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.139+0000 7fe560800640 1 -- 172.21.15.163:0/2956016077 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5581ebf10 con 0x7fe55814b740 2024-04-01T17:05:19.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.139+0000 7fe560800640 1 -- 172.21.15.163:0/2956016077 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5580c1bc0 con 0x7fe55814b740 2024-04-01T17:05:19.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.141+0000 7fe560800640 1 -- 172.21.15.163:0/2956016077 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5580756d0 con 0x7fe55814b740 2024-04-01T17:05:19.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.508+0000 7fe552000640 1 -- 172.21.15.163:0/2956016077 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe54800f600 con 0x7fe55814b740 2024-04-01T17:05:19.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.510+0000 7fe552000640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe53c06c970 0x7fe53c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:19.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.511+0000 7fe55de00640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe53c06c970 0x7fe53c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:19.512 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.513+0000 7fe55de00640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe53c06c970 0x7fe53c06ee30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe54c034000 tx=0x7fe54c007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:19.517 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.518+0000 7fe552000640 1 -- 172.21.15.163:0/2956016077 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fe5480584b0 con 0x7fe55814b740 2024-04-01T17:05:19.551 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.551+0000 7fe552000640 1 -- 172.21.15.163:0/2956016077 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe5580ca5b0 con 0x7fe55814b740 2024-04-01T17:05:19.768 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.769+0000 7fe560800640 1 -- 172.21.15.163:0/2956016077 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe5580c63d0 con 0x7fe55814b740 2024-04-01T17:05:19.783 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.783+0000 7fe552000640 1 -- 172.21.15.163:0/2956016077 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fe548019030 con 0x7fe55814b740 2024-04-01T17:05:19.783 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2024-04-01T17:05:19.786 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.786+0000 7fe560800640 1 -- 172.21.15.163:0/2956016077 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe53c06c970 msgr2=0x7fe53c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:19.786 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.786+0000 7fe560800640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe53c06c970 0x7fe53c06ee30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe54c034000 tx=0x7fe54c007000 comp rx=0 tx=0).stop 2024-04-01T17:05:19.786 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.786+0000 7fe560800640 1 -- 172.21.15.163:0/2956016077 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55814b740 msgr2=0x7fe5581ec410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:19.786 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.786+0000 7fe560800640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55814b740 0x7fe5581ec410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe548011570 tx=0x7fe548011a30 comp rx=0 tx=0).stop 2024-04-01T17:05:19.786 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.786+0000 7fe560800640 1 -- 172.21.15.163:0/2956016077 shutdown_connections 2024-04-01T17:05:19.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.786+0000 7fe560800640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fe53c06c970 0x7fe53c06ee30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:19.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.786+0000 7fe560800640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5580c2d90 0x7fe5581ec950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:19.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.786+0000 7fe560800640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fe55814b740 0x7fe5581ec410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:19.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.786+0000 7fe560800640 1 --2- 172.21.15.163:0/2956016077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe55814b360 0x7fe5581efe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:19.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.786+0000 7fe560800640 1 -- 172.21.15.163:0/2956016077 >> 172.21.15.163:0/2956016077 conn(0x7fe5580c8a00 msgr2=0x7fe5580c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:19.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.787+0000 7fe560800640 1 -- 172.21.15.163:0/2956016077 shutdown_connections 2024-04-01T17:05:19.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:19.787+0000 7fe560800640 1 -- 172.21.15.163:0/2956016077 wait complete. 2024-04-01T17:05:19.806 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T17:05:20.012 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.012+0000 7f4932800640 1 Processor -- start 2024-04-01T17:05:20.012 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.013+0000 7f4932800640 1 -- start start 2024-04-01T17:05:20.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.014+0000 7f4932800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f492c0caa40 0x7f492c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:20.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.014+0000 7f4932800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c0cae80 con 0x7f492c154730 2024-04-01T17:05:20.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.014+0000 7f4932800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c06c590 con 0x7f492c0cd370 2024-04-01T17:05:20.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.014+0000 7f4932800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f492c06c870 con 0x7f492c0caa40 2024-04-01T17:05:20.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.015+0000 7f492b400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f492c154730 0x7f492c15b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:57740/0 (socket says 172.21.15.163:57740) 2024-04-01T17:05:20.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.015+0000 7f492b400640 1 -- 172.21.15.163:0/879297151 learned_addr learned my addr 172.21.15.163:0/879297151 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:20.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.016+0000 7f492aa00640 1 --2- 172.21.15.163:0/879297151 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f492c0caa40 0x7f492c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:20.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.018+0000 7f492a000640 1 -- 172.21.15.163:0/879297151 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595835444 0 0) 0x7f492c0cae80 con 0x7f492c154730 2024-04-01T17:05:20.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.018+0000 7f492a000640 1 -- 172.21.15.163:0/879297151 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f490c003520 con 0x7f492c154730 2024-04-01T17:05:20.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.020+0000 7f492aa00640 1 -- 172.21.15.163:0/879297151 >> v1:172.21.15.189:6789/0 conn(0x7f492c0cd370 legacy=0x7f492c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:20.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.020+0000 7f492aa00640 1 -- 172.21.15.163:0/879297151 >> v1:172.21.15.163:6789/0 conn(0x7f492c154730 legacy=0x7f492c15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:20.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.020+0000 7f492aa00640 1 -- 172.21.15.163:0/879297151 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c06cb50 con 0x7f492c0caa40 2024-04-01T17:05:20.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.024+0000 7f492aa00640 1 --2- 172.21.15.163:0/879297151 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f492c0caa40 0x7f492c0cce30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4914009dc0 tx=0x7f491402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=333674f42b97625c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:20.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.028+0000 7f492a000640 1 -- 172.21.15.163:0/879297151 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914039070 con 0x7f492c0caa40 2024-04-01T17:05:20.031 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.032+0000 7f492a000640 1 -- 172.21.15.163:0/879297151 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f491402ccd0 con 0x7f492c0caa40 2024-04-01T17:05:20.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.032+0000 7f4932800640 1 -- 172.21.15.163:0/879297151 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f492c0caa40 msgr2=0x7f492c0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:20.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.032+0000 7f4932800640 1 --2- 172.21.15.163:0/879297151 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f492c0caa40 0x7f492c0cce30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4914009dc0 tx=0x7f491402bf20 comp rx=0 tx=0).stop 2024-04-01T17:05:20.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.032+0000 7f4932800640 1 -- 172.21.15.163:0/879297151 shutdown_connections 2024-04-01T17:05:20.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.032+0000 7f4932800640 1 --2- 172.21.15.163:0/879297151 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f492c0caa40 0x7f492c0cce30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:20.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.032+0000 7f4932800640 1 -- 172.21.15.163:0/879297151 >> 172.21.15.163:0/879297151 conn(0x7f492c067460 msgr2=0x7f492c067870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:20.033 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.033+0000 7f4932800640 1 -- 172.21.15.163:0/879297151 shutdown_connections 2024-04-01T17:05:20.033 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.033+0000 7f4932800640 1 -- 172.21.15.163:0/879297151 wait complete. 2024-04-01T17:05:20.034 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.035+0000 7f4932800640 1 Processor -- start 2024-04-01T17:05:20.034 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.035+0000 7f4932800640 1 -- start start 2024-04-01T17:05:20.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.036+0000 7f4932800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f492c0caa40 0x7f492c1479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:20.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.036+0000 7f4932800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f492c0cd370 0x7f492c0c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:20.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.036+0000 7f4932800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f492c154730 0x7f492c1f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:20.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.036+0000 7f4932800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f492c06dfc0 con 0x7f492c0caa40 2024-04-01T17:05:20.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.036+0000 7f4932800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f492c06d110 con 0x7f492c154730 2024-04-01T17:05:20.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.036+0000 7f4932800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f492c154b10 con 0x7f492c0cd370 2024-04-01T17:05:20.037 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.037+0000 7f492b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f492c0caa40 0x7f492c1479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:20.037 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.037+0000 7f492b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f492c0caa40 0x7f492c1479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38008/0 (socket says 172.21.15.163:38008) 2024-04-01T17:05:20.037 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.037+0000 7f492b400640 1 -- 172.21.15.163:0/1664023328 learned_addr learned my addr 172.21.15.163:0/1664023328 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:20.040 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.041+0000 7f492aa00640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f492c0cd370 0x7f492c0c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:20.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.041+0000 7f492b400640 1 -- 172.21.15.163:0/1664023328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f492c0cd370 msgr2=0x7f492c0c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:20.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.041+0000 7f492b400640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f492c0cd370 0x7f492c0c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:20.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.041+0000 7f492b400640 1 -- 172.21.15.163:0/1664023328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f492c154730 msgr2=0x7f492c1f4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:20.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.041+0000 7f492b400640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f492c154730 0x7f492c1f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:20.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.041+0000 7f492b400640 1 -- 172.21.15.163:0/1664023328 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c0d09c0 con 0x7f492c0caa40 2024-04-01T17:05:20.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.041+0000 7f492aa00640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f492c0cd370 0x7f492c0c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T17:05:20.043 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.044+0000 7f492b400640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f492c0caa40 0x7f492c1479b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f491c00c3c0 tx=0x7f491c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:20.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.049+0000 7f4923400640 1 -- 172.21.15.163:0/1664023328 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c017070 con 0x7f492c0caa40 2024-04-01T17:05:20.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.049+0000 7f4923400640 1 -- 172.21.15.163:0/1664023328 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f491c005ce0 con 0x7f492c0caa40 2024-04-01T17:05:20.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.049+0000 7f4923400640 1 -- 172.21.15.163:0/1664023328 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c0072f0 con 0x7f492c0caa40 2024-04-01T17:05:20.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.049+0000 7f4932800640 1 -- 172.21.15.163:0/1664023328 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492c0d0c80 con 0x7f492c0caa40 2024-04-01T17:05:20.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.049+0000 7f4932800640 1 -- 172.21.15.163:0/1664023328 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492c0cee10 con 0x7f492c0caa40 2024-04-01T17:05:20.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.050+0000 7f4932800640 1 -- 172.21.15.163:0/1664023328 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492c073bb0 con 0x7f492c0caa40 2024-04-01T17:05:20.386 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.387+0000 7f4923400640 1 -- 172.21.15.163:0/1664023328 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f491c01a070 con 0x7f492c0caa40 2024-04-01T17:05:20.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.391+0000 7f4923400640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f490806c970 0x7f490806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:20.391 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.392+0000 7f492aa00640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f490806c970 0x7f490806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:20.393 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.393+0000 7f492aa00640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f490806c970 0x7f490806ee30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4914036000 tx=0x7f4914030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:20.467 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.467+0000 7f4923400640 1 -- 172.21.15.163:0/1664023328 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f491c057160 con 0x7f492c0caa40 2024-04-01T17:05:20.467 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.468+0000 7f4923400640 1 -- 172.21.15.163:0/1664023328 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f491c021020 con 0x7f492c0caa40 2024-04-01T17:05:20.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.696+0000 7f4932800640 1 -- 172.21.15.163:0/1664023328 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f492c0756d0 con 0x7f492c0caa40 2024-04-01T17:05:20.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.808+0000 7f4923400640 1 -- 172.21.15.163:0/1664023328 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f491c0597c0 con 0x7f492c0caa40 2024-04-01T17:05:20.808 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2024-04-01T17:05:20.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.812+0000 7f4932800640 1 -- 172.21.15.163:0/1664023328 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f490806c970 msgr2=0x7f490806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:20.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.812+0000 7f4932800640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f490806c970 0x7f490806ee30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4914036000 tx=0x7f4914030000 comp rx=0 tx=0).stop 2024-04-01T17:05:20.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.812+0000 7f4932800640 1 -- 172.21.15.163:0/1664023328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f492c0caa40 msgr2=0x7f492c1479b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:20.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.812+0000 7f4932800640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f492c0caa40 0x7f492c1479b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f491c00c3c0 tx=0x7f491c00c880 comp rx=0 tx=0).stop 2024-04-01T17:05:20.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.812+0000 7f4932800640 1 -- 172.21.15.163:0/1664023328 shutdown_connections 2024-04-01T17:05:20.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.812+0000 7f4932800640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f490806c970 0x7f490806ee30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:20.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.812+0000 7f4932800640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f492c154730 0x7f492c1f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:20.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.812+0000 7f4932800640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f492c0cd370 0x7f492c0c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:20.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.812+0000 7f4932800640 1 --2- 172.21.15.163:0/1664023328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f492c0caa40 0x7f492c1479b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:20.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.812+0000 7f4932800640 1 -- 172.21.15.163:0/1664023328 >> 172.21.15.163:0/1664023328 conn(0x7f492c067460 msgr2=0x7f492c151e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:20.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.812+0000 7f4932800640 1 -- 172.21.15.163:0/1664023328 shutdown_connections 2024-04-01T17:05:20.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:20.812+0000 7f4932800640 1 -- 172.21.15.163:0/1664023328 wait complete. 2024-04-01T17:05:20.839 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T17:05:21.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.047+0000 7f6e6a400640 1 Processor -- start 2024-04-01T17:05:21.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.047+0000 7f6e6a400640 1 -- start start 2024-04-01T17:05:21.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.048+0000 7f6e6a400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6e64073450 0x7f6e640c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:21.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.048+0000 7f6e6a400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e640c7cf0 0x7f6e640c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:21.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.048+0000 7f6e6a400640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e640c73a0 con 0x7f6e64151880 2024-04-01T17:05:21.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.048+0000 7f6e6a400640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6e64157460 con 0x7f6e64073450 2024-04-01T17:05:21.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.048+0000 7f6e6a400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6e640739b0 con 0x7f6e640c7cf0 2024-04-01T17:05:21.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.050+0000 7f6e69a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e640c7cf0 0x7f6e640c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:21.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.051+0000 7f6e69a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e640c7cf0 0x7f6e640c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:54164/0 (socket says 172.21.15.163:54164) 2024-04-01T17:05:21.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.051+0000 7f6e69a00640 1 -- 172.21.15.163:0/3238729119 learned_addr learned my addr 172.21.15.163:0/3238729119 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:21.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.051+0000 7f6e5be00640 1 --2- 172.21.15.163:0/3238729119 >> v2:172.21.15.189:3300/0 conn(0x7f6e64073450 0x7f6e640c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:21.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.055+0000 7f6e69a00640 1 -- 172.21.15.163:0/3238729119 >> v2:172.21.15.189:3300/0 conn(0x7f6e64073450 msgr2=0x7f6e640c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:21.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.055+0000 7f6e69a00640 1 --2- 172.21.15.163:0/3238729119 >> v2:172.21.15.189:3300/0 conn(0x7f6e64073450 0x7f6e640c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.055+0000 7f6e69a00640 1 -- 172.21.15.163:0/3238729119 >> v1:172.21.15.189:6789/0 conn(0x7f6e64151880 legacy=0x7f6e64071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:21.054 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.055+0000 7f6e69a00640 1 -- 172.21.15.163:0/3238729119 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e64157720 con 0x7f6e640c7cf0 2024-04-01T17:05:21.059 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.059+0000 7f6e69a00640 1 --2- 172.21.15.163:0/3238729119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e640c7cf0 0x7f6e640c8b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009e50 tx=0x7f6e5c02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c12600d6c76d581d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:21.064 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.064+0000 7f6e63e00640 1 -- 172.21.15.163:0/3238729119 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c02ca70 con 0x7f6e640c7cf0 2024-04-01T17:05:21.068 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.068+0000 7f6e63e00640 1 -- 172.21.15.163:0/3238729119 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5c02cc10 con 0x7f6e640c7cf0 2024-04-01T17:05:21.068 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.068+0000 7f6e63e00640 1 -- 172.21.15.163:0/3238729119 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0343f0 con 0x7f6e640c7cf0 2024-04-01T17:05:21.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.069+0000 7f6e6a400640 1 -- 172.21.15.163:0/3238729119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e640c7cf0 msgr2=0x7f6e640c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:21.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.069+0000 7f6e6a400640 1 --2- 172.21.15.163:0/3238729119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e640c7cf0 0x7f6e640c8b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009e50 tx=0x7f6e5c02bed0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.069+0000 7f6e6a400640 1 -- 172.21.15.163:0/3238729119 shutdown_connections 2024-04-01T17:05:21.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.069+0000 7f6e6a400640 1 --2- 172.21.15.163:0/3238729119 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e640c7cf0 0x7f6e640c8b20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.069+0000 7f6e6a400640 1 --2- 172.21.15.163:0/3238729119 >> v2:172.21.15.189:3300/0 conn(0x7f6e64073450 0x7f6e640c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.069+0000 7f6e6a400640 1 -- 172.21.15.163:0/3238729119 >> 172.21.15.163:0/3238729119 conn(0x7f6e6406b540 msgr2=0x7f6e6406b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:21.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.069+0000 7f6e6a400640 1 -- 172.21.15.163:0/3238729119 shutdown_connections 2024-04-01T17:05:21.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.069+0000 7f6e6a400640 1 -- 172.21.15.163:0/3238729119 wait complete. 2024-04-01T17:05:21.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.072+0000 7f6e6a400640 1 Processor -- start 2024-04-01T17:05:21.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.072+0000 7f6e6a400640 1 -- start start 2024-04-01T17:05:21.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.074+0000 7f6e6a400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e64073450 0x7f6e640cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:21.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.074+0000 7f6e6a400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e640c7cf0 0x7f6e641f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:21.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.074+0000 7f6e6a400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e64151880 0x7f6e64147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:21.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.074+0000 7f6e6a400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6e64157fc0 con 0x7f6e64073450 2024-04-01T17:05:21.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.074+0000 7f6e6a400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e64157ce0 con 0x7f6e64151880 2024-04-01T17:05:21.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.074+0000 7f6e6a400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6e64072350 con 0x7f6e640c7cf0 2024-04-01T17:05:21.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.075+0000 7f6e69000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e64073450 0x7f6e640cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:21.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.075+0000 7f6e5be00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e640c7cf0 0x7f6e641f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:21.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.075+0000 7f6e69000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e64073450 0x7f6e640cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:49092/0 (socket says 172.21.15.163:49092) 2024-04-01T17:05:21.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.075+0000 7f6e69000640 1 -- 172.21.15.163:0/1950726675 learned_addr learned my addr 172.21.15.163:0/1950726675 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:21.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.075+0000 7f6e69a00640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e64151880 0x7f6e64147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:21.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.079+0000 7f6e69000640 1 -- 172.21.15.163:0/1950726675 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e640c7cf0 msgr2=0x7f6e641f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:21.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.079+0000 7f6e69000640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e640c7cf0 0x7f6e641f48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.079+0000 7f6e69000640 1 -- 172.21.15.163:0/1950726675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e64151880 msgr2=0x7f6e64147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:21.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.079+0000 7f6e69000640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e64151880 0x7f6e64147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.079+0000 7f6e69000640 1 -- 172.21.15.163:0/1950726675 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e640ca7c0 con 0x7f6e64073450 2024-04-01T17:05:21.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.082+0000 7f6e69000640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e64073450 0x7f6e640cb390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400c460 tx=0x7f6e5400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:21.085 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.085+0000 7f6e61600640 1 -- 172.21.15.163:0/1950726675 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54016020 con 0x7f6e64073450 2024-04-01T17:05:21.085 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.085+0000 7f6e6a400640 1 -- 172.21.15.163:0/1950726675 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e640cc330 con 0x7f6e64073450 2024-04-01T17:05:21.085 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.085+0000 7f6e6a400640 1 -- 172.21.15.163:0/1950726675 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e640c9ce0 con 0x7f6e64073450 2024-04-01T17:05:21.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.087+0000 7f6e6a400640 1 -- 172.21.15.163:0/1950726675 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e640c6d50 con 0x7f6e64073450 2024-04-01T17:05:21.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.088+0000 7f6e61600640 1 -- 172.21.15.163:0/1950726675 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e54012830 con 0x7f6e64073450 2024-04-01T17:05:21.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.088+0000 7f6e61600640 1 -- 172.21.15.163:0/1950726675 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54003860 con 0x7f6e64073450 2024-04-01T17:05:21.378 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.378+0000 7f6e61600640 1 -- 172.21.15.163:0/1950726675 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e54019020 con 0x7f6e64073450 2024-04-01T17:05:21.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.380+0000 7f6e61600640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6e4006c8f0 0x7f6e4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:21.380 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.381+0000 7f6e5be00640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6e4006c8f0 0x7f6e4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:21.382 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.382+0000 7f6e5be00640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6e4006c8f0 0x7f6e4006edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6e641564c0 tx=0x7f6e4c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:21.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.391+0000 7f6e61600640 1 -- 172.21.15.163:0/1950726675 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f6e54057af0 con 0x7f6e64073450 2024-04-01T17:05:21.391 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.391+0000 7f6e61600640 1 -- 172.21.15.163:0/1950726675 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6e640c6d50 con 0x7f6e64073450 2024-04-01T17:05:21.606 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.607+0000 7f6e6a400640 1 -- 172.21.15.163:0/1950726675 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6e640b2230 con 0x7f6e64073450 2024-04-01T17:05:21.626 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.627+0000 7f6e61600640 1 -- 172.21.15.163:0/1950726675 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f6e640b2230 con 0x7f6e64073450 2024-04-01T17:05:21.627 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2024-04-01T17:05:21.630 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.630+0000 7f6e6a400640 1 -- 172.21.15.163:0/1950726675 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6e4006c8f0 msgr2=0x7f6e4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:21.630 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.630+0000 7f6e6a400640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6e4006c8f0 0x7f6e4006edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6e641564c0 tx=0x7f6e4c009190 comp rx=0 tx=0).stop 2024-04-01T17:05:21.630 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.630+0000 7f6e6a400640 1 -- 172.21.15.163:0/1950726675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e64073450 msgr2=0x7f6e640cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:21.630 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.630+0000 7f6e6a400640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e64073450 0x7f6e640cb390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400c460 tx=0x7f6e5400c920 comp rx=0 tx=0).stop 2024-04-01T17:05:21.630 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.630+0000 7f6e6a400640 1 -- 172.21.15.163:0/1950726675 shutdown_connections 2024-04-01T17:05:21.630 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.630+0000 7f6e6a400640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6e4006c8f0 0x7f6e4006edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.630 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.630+0000 7f6e6a400640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e64151880 0x7f6e64147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.630 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.630+0000 7f6e6a400640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6e640c7cf0 0x7f6e641f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.630 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.630+0000 7f6e6a400640 1 --2- 172.21.15.163:0/1950726675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e64073450 0x7f6e640cb390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.630+0000 7f6e6a400640 1 -- 172.21.15.163:0/1950726675 >> 172.21.15.163:0/1950726675 conn(0x7f6e6406b540 msgr2=0x7f6e64072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:21.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.630+0000 7f6e6a400640 1 -- 172.21.15.163:0/1950726675 shutdown_connections 2024-04-01T17:05:21.631 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.630+0000 7f6e6a400640 1 -- 172.21.15.163:0/1950726675 wait complete. 2024-04-01T17:05:21.648 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-01T17:05:21.851 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.851+0000 7f4dcb400640 1 Processor -- start 2024-04-01T17:05:21.851 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.852+0000 7f4dcb400640 1 -- start start 2024-04-01T17:05:21.853 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.853+0000 7f4dcb400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4dc406e490 0x7f4dc4071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:21.853 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.853+0000 7f4dcb400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc4072570 con 0x7f4dc4154a60 2024-04-01T17:05:21.853 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.853+0000 7f4dcb400640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc40c2080 con 0x7f4dc40c6d50 2024-04-01T17:05:21.853 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.853+0000 7f4dcb400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc40c2360 con 0x7f4dc406e490 2024-04-01T17:05:21.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.855+0000 7f4dbbe00640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f4dc40c6d50 0x7f4dc406dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:43730/0 (socket says 172.21.15.163:43730) 2024-04-01T17:05:21.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.855+0000 7f4dbbe00640 1 -- 172.21.15.163:0/1818782931 learned_addr learned my addr 172.21.15.163:0/1818782931 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:21.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.857+0000 7f4dc9400640 1 --2- 172.21.15.163:0/1818782931 >> v2:172.21.15.163:3300/0 conn(0x7f4dc406e490 0x7f4dc4071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:21.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.862+0000 7f4dc3e00640 1 -- 172.21.15.163:0/1818782931 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482192323 0 0) 0x7f4dc40c2080 con 0x7f4dc40c6d50 2024-04-01T17:05:21.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.862+0000 7f4dc3e00640 1 -- 172.21.15.163:0/1818782931 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4da8003520 con 0x7f4dc40c6d50 2024-04-01T17:05:21.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.867+0000 7f4dc9400640 1 -- 172.21.15.163:0/1818782931 >> v1:172.21.15.189:6789/0 conn(0x7f4dc40c6d50 legacy=0x7f4dc406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:21.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.867+0000 7f4dc9400640 1 -- 172.21.15.163:0/1818782931 >> v1:172.21.15.163:6789/0 conn(0x7f4dc4154a60 legacy=0x7f4dc4073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:21.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.867+0000 7f4dc9400640 1 -- 172.21.15.163:0/1818782931 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc40c2640 con 0x7f4dc406e490 2024-04-01T17:05:21.879 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.880+0000 7f4dc9400640 1 --2- 172.21.15.163:0/1818782931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4dc406e490 0x7f4dc4071ee0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009d90 tx=0x7f4dbc02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ed584340c8d4ca server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:21.890 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.890+0000 7f4dc3e00640 1 -- 172.21.15.163:0/1818782931 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc039070 con 0x7f4dc406e490 2024-04-01T17:05:21.890 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.890+0000 7f4dc3e00640 1 -- 172.21.15.163:0/1818782931 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dbc02cd80 con 0x7f4dc406e490 2024-04-01T17:05:21.890 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.890+0000 7f4dc3e00640 1 -- 172.21.15.163:0/1818782931 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc034660 con 0x7f4dc406e490 2024-04-01T17:05:21.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.891+0000 7f4dcb400640 1 -- 172.21.15.163:0/1818782931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4dc406e490 msgr2=0x7f4dc4071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:21.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.891+0000 7f4dcb400640 1 --2- 172.21.15.163:0/1818782931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4dc406e490 0x7f4dc4071ee0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009d90 tx=0x7f4dbc02bfd0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.892+0000 7f4dcb400640 1 -- 172.21.15.163:0/1818782931 shutdown_connections 2024-04-01T17:05:21.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.892+0000 7f4dcb400640 1 --2- 172.21.15.163:0/1818782931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4dc406e490 0x7f4dc4071ee0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.892+0000 7f4dcb400640 1 -- 172.21.15.163:0/1818782931 >> 172.21.15.163:0/1818782931 conn(0x7f4dc40cbe20 msgr2=0x7f4dc40cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:21.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.892+0000 7f4dcb400640 1 -- 172.21.15.163:0/1818782931 shutdown_connections 2024-04-01T17:05:21.892 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.892+0000 7f4dcb400640 1 -- 172.21.15.163:0/1818782931 wait complete. 2024-04-01T17:05:21.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.894+0000 7f4dcb400640 1 Processor -- start 2024-04-01T17:05:21.894 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.895+0000 7f4dcb400640 1 -- start start 2024-04-01T17:05:21.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.896+0000 7f4dcb400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4dc406e490 0x7f4dc414e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:21.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.896+0000 7f4dcb400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4dc40c6d50 0x7f4dc414c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:21.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.896+0000 7f4dcb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4dc4154a60 0x7f4dc414c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:21.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.896+0000 7f4dcb400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc4073920 con 0x7f4dc406e490 2024-04-01T17:05:21.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.896+0000 7f4dcb400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc40c1d80 con 0x7f4dc4154a60 2024-04-01T17:05:21.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.896+0000 7f4dcb400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc4073aa0 con 0x7f4dc40c6d50 2024-04-01T17:05:21.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.897+0000 7f4dc8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4dc406e490 0x7f4dc414e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:21.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.897+0000 7f4dc8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4dc406e490 0x7f4dc414e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:49106/0 (socket says 172.21.15.163:49106) 2024-04-01T17:05:21.897 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.897+0000 7f4dc9400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4dc4154a60 0x7f4dc414c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:21.897 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.897+0000 7f4dc8a00640 1 -- 172.21.15.163:0/2153082954 learned_addr learned my addr 172.21.15.163:0/2153082954 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:21.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.899+0000 7f4dbbe00640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4dc40c6d50 0x7f4dc414c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:21.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.901+0000 7f4dc8a00640 1 -- 172.21.15.163:0/2153082954 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4dc40c6d50 msgr2=0x7f4dc414c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:21.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.901+0000 7f4dc8a00640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4dc40c6d50 0x7f4dc414c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.901+0000 7f4dc8a00640 1 -- 172.21.15.163:0/2153082954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4dc4154a60 msgr2=0x7f4dc414c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:21.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.901+0000 7f4dc8a00640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4dc4154a60 0x7f4dc414c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:21.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.901+0000 7f4dc8a00640 1 -- 172.21.15.163:0/2153082954 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc415ea20 con 0x7f4dc406e490 2024-04-01T17:05:21.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.904+0000 7f4dc8a00640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4dc406e490 0x7f4dc414e110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c3c0 tx=0x7f4db400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:21.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.909+0000 7f4dc1600640 1 -- 172.21.15.163:0/2153082954 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db40052d0 con 0x7f4dc406e490 2024-04-01T17:05:21.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.910+0000 7f4dc1600640 1 -- 172.21.15.163:0/2153082954 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db4005490 con 0x7f4dc406e490 2024-04-01T17:05:21.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.910+0000 7f4dc1600640 1 -- 172.21.15.163:0/2153082954 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4007260 con 0x7f4dc406e490 2024-04-01T17:05:21.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.910+0000 7f4dcb400640 1 -- 172.21.15.163:0/2153082954 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc415dea0 con 0x7f4dc406e490 2024-04-01T17:05:21.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.910+0000 7f4dcb400640 1 -- 172.21.15.163:0/2153082954 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc415e460 con 0x7f4dc406e490 2024-04-01T17:05:21.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.911+0000 7f4dcb400640 1 -- 172.21.15.163:0/2153082954 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc4152280 con 0x7f4dc406e490 2024-04-01T17:05:21.934 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.935+0000 7f4dc1600640 1 -- 172.21.15.163:0/2153082954 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4db4007400 con 0x7f4dc406e490 2024-04-01T17:05:21.935 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.936+0000 7f4dc1600640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f4da006c970 0x7f4da006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:21.936 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.936+0000 7f4dbbe00640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f4da006c970 0x7f4da006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:21.937 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:21.938+0000 7f4dbbe00640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f4da006c970 0x7f4da006ee30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4072000 tx=0x7f4dac007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:22.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.227+0000 7f4dc1600640 1 -- 172.21.15.163:0/2153082954 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f4db4057650 con 0x7f4dc406e490 2024-04-01T17:05:22.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.228+0000 7f4dc1600640 1 -- 172.21.15.163:0/2153082954 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4dc4152280 con 0x7f4dc406e490 2024-04-01T17:05:22.468 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.468+0000 7f4dcb400640 1 -- 172.21.15.163:0/2153082954 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4dc40756d0 con 0x7f4dc406e490 2024-04-01T17:05:22.475 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.475+0000 7f4dc1600640 1 -- 172.21.15.163:0/2153082954 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f4db40595b0 con 0x7f4dc406e490 2024-04-01T17:05:22.475 INFO:teuthology.orchestra.run.smithi163.stderr:listed 0 entries 2024-04-01T17:05:22.478 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.478+0000 7f4dcb400640 1 -- 172.21.15.163:0/2153082954 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f4da006c970 msgr2=0x7f4da006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:22.479 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.478+0000 7f4dcb400640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f4da006c970 0x7f4da006ee30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4072000 tx=0x7f4dac007d30 comp rx=0 tx=0).stop 2024-04-01T17:05:22.479 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.478+0000 7f4dcb400640 1 -- 172.21.15.163:0/2153082954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4dc406e490 msgr2=0x7f4dc414e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:22.479 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.478+0000 7f4dcb400640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4dc406e490 0x7f4dc414e110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c3c0 tx=0x7f4db400c880 comp rx=0 tx=0).stop 2024-04-01T17:05:22.479 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.478+0000 7f4dcb400640 1 -- 172.21.15.163:0/2153082954 shutdown_connections 2024-04-01T17:05:22.479 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.478+0000 7f4dcb400640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f4da006c970 0x7f4da006ee30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:22.479 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.478+0000 7f4dcb400640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4dc4154a60 0x7f4dc414c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:22.479 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.478+0000 7f4dcb400640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4dc40c6d50 0x7f4dc414c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:22.479 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.478+0000 7f4dcb400640 1 --2- 172.21.15.163:0/2153082954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4dc406e490 0x7f4dc414e110 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:22.479 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.478+0000 7f4dcb400640 1 -- 172.21.15.163:0/2153082954 >> 172.21.15.163:0/2153082954 conn(0x7f4dc40cbe20 msgr2=0x7f4dc40c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:22.479 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.479+0000 7f4dcb400640 1 -- 172.21.15.163:0/2153082954 shutdown_connections 2024-04-01T17:05:22.479 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:22.479+0000 7f4dcb400640 1 -- 172.21.15.163:0/2153082954 wait complete. 2024-04-01T17:05:22.497 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi163.front.sepia.ceph.com... 2024-04-01T17:05:22.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T17:05:22.497 DEBUG:teuthology.orchestra.run.smithi163:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-01T17:05:22.592 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:05:22.643 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:ceph-fuse[45195]: fuse finished with error 0 and tester_r 0 2024-04-01T17:05:23.357 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:05:23.365 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:05:23.500 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:==00:00:30:00.110 45195== 2024-04-01T17:05:23.500 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:==00:00:30:00.110 45195== Exit program on first error (--exit-on-first-error=yes) 2024-04-01T17:05:23.686 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:daemon-helper: command failed with exit status 42 2024-04-01T17:05:28.694 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-01T17:05:28.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2024-04-01T17:05:28.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T17:05:28.695 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-01T17:05:28.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T17:05:28.753 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-04-01T17:05:28.798 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-01T17:05:28.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T17:05:28.799 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T17:05:28.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T17:05:28.941 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2024-04-01T17:05:29.056 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-01T17:05:29.066 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-01T17:05:29.067 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T17:05:29.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.254+0000 7fc9efe00640 1 Processor -- start 2024-04-01T17:05:29.255 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.255+0000 7fc9efe00640 1 -- start start 2024-04-01T17:05:29.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.256+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f0159010 0x7fc9f00c5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:29.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.256+0000 7fc9efe00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9f0072090 con 0x7fc9f00c57a0 2024-04-01T17:05:29.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.256+0000 7fc9efe00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9f015bb90 con 0x7fc9f00c8fe0 2024-04-01T17:05:29.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.256+0000 7fc9efe00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f015b960 con 0x7fc9f0159010 2024-04-01T17:05:29.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.257+0000 7fc9ef400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fc9f00c57a0 0x7fc9f0072540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:39974/0 (socket says 172.21.15.163:39974) 2024-04-01T17:05:29.257 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.257+0000 7fc9ef400640 1 -- 172.21.15.163:0/2407375537 learned_addr learned my addr 172.21.15.163:0/2407375537 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:29.258 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.258+0000 7fc9e6000640 1 --2- 172.21.15.163:0/2407375537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f0159010 0x7fc9f00c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:29.261 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.260+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3472181920 0 0) 0x7fc9f0072090 con 0x7fc9f00c57a0 2024-04-01T17:05:29.261 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.260+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9d4003520 con 0x7fc9f00c57a0 2024-04-01T17:05:29.264 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.263+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4271085553 0 0) 0x7fc9f015bb90 con 0x7fc9f00c8fe0 2024-04-01T17:05:29.264 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.263+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9f0072090 con 0x7fc9f00c8fe0 2024-04-01T17:05:29.265 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1207166762 0 0) 0x7fc9d4003520 con 0x7fc9f00c57a0 2024-04-01T17:05:29.265 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f0159010 msgr2=0x7fc9f00c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:29.265 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 --2- 172.21.15.163:0/2407375537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f0159010 0x7fc9f00c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:29.265 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 >> v1:172.21.15.189:6789/0 conn(0x7fc9f00c8fe0 legacy=0x7fc9f006be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:29.265 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f006c560 con 0x7fc9f00c57a0 2024-04-01T17:05:29.265 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7fc9e80019f0 con 0x7fc9f00c57a0 2024-04-01T17:05:29.265 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 >> v1:172.21.15.163:6789/0 conn(0x7fc9f00c57a0 legacy=0x7fc9f0072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:29.265 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 --2- 172.21.15.163:0/2407375537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9d4003b70 0x7fc9d4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:29.266 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 --2- 172.21.15.163:0/2407375537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f0159010 0x7fc9d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:29.266 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 --2- 172.21.15.163:0/2407375537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9d4004d40 0x7fc9d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:29.266 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d400ba70 con 0x7fc9d4004d40 2024-04-01T17:05:29.266 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d400bc20 con 0x7fc9d4003b70 2024-04-01T17:05:29.266 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.264+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d400be20 con 0x7fc9f0159010 2024-04-01T17:05:29.268 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.268+0000 7fc9ef400640 1 --2- 172.21.15.163:0/2407375537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9d4004d40 0x7fc9d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:29.272 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.271+0000 7fc9e6000640 1 --2- 172.21.15.163:0/2407375537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f0159010 0x7fc9d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:29.274 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.274+0000 7fc9ef400640 1 -- 172.21.15.163:0/2407375537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f0159010 msgr2=0x7fc9d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:29.274 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.274+0000 7fc9ef400640 1 --2- 172.21.15.163:0/2407375537 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f0159010 0x7fc9d4004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:29.274 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.274+0000 7fc9ef400640 1 -- 172.21.15.163:0/2407375537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9d4003b70 msgr2=0x7fc9d4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:29.274 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.274+0000 7fc9ef400640 1 --2- 172.21.15.163:0/2407375537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9d4003b70 0x7fc9d4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:29.274 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.274+0000 7fc9ef400640 1 -- 172.21.15.163:0/2407375537 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d4003520 con 0x7fc9d4004d40 2024-04-01T17:05:29.278 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.278+0000 7fc9ef400640 1 --2- 172.21.15.163:0/2407375537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9d4004d40 0x7fc9d40051c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800a750 tx=0x7fc9d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d266c10f6683f0e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:29.288 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.287+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e800a370 con 0x7fc9d4004d40 2024-04-01T17:05:29.288 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.287+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e8034630 con 0x7fc9d4004d40 2024-04-01T17:05:29.288 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.287+0000 7fc9ee000640 1 -- 172.21.15.163:0/2407375537 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8034a60 con 0x7fc9d4004d40 2024-04-01T17:05:29.289 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.289+0000 7fc9efe00640 1 -- 172.21.15.163:0/2407375537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9d4004d40 msgr2=0x7fc9d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:29.289 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.289+0000 7fc9efe00640 1 --2- 172.21.15.163:0/2407375537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9d4004d40 0x7fc9d40051c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800a750 tx=0x7fc9d4005830 comp rx=0 tx=0).stop 2024-04-01T17:05:29.289 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.289+0000 7fc9ef400640 1 -- 172.21.15.163:0/2407375537 reap_dead start 2024-04-01T17:05:29.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.289+0000 7fc9efe00640 1 -- 172.21.15.163:0/2407375537 shutdown_connections 2024-04-01T17:05:29.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.289+0000 7fc9efe00640 1 -- 172.21.15.163:0/2407375537 >> 172.21.15.163:0/2407375537 conn(0x7fc9f006f7d0 msgr2=0x7fc9f006fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:29.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.289+0000 7fc9efe00640 1 -- 172.21.15.163:0/2407375537 shutdown_connections 2024-04-01T17:05:29.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.289+0000 7fc9efe00640 1 -- 172.21.15.163:0/2407375537 wait complete. 2024-04-01T17:05:29.292 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.292+0000 7fc9efe00640 1 Processor -- start 2024-04-01T17:05:29.292 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.292+0000 7fc9efe00640 1 -- start start 2024-04-01T17:05:29.294 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.293+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9d4004d40 0x7fc9f01f0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:29.294 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.293+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f014b820 0x7fc9f0157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:29.294 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.293+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9f014cee0 0x7fc9f014d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:29.294 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.293+0000 7fc9efe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f015c410 con 0x7fc9d4004d40 2024-04-01T17:05:29.294 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.293+0000 7fc9efe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f015c130 con 0x7fc9f014cee0 2024-04-01T17:05:29.294 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.293+0000 7fc9efe00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f015c6f0 con 0x7fc9f014b820 2024-04-01T17:05:29.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.294+0000 7fc9eea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9d4004d40 0x7fc9f01f0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:29.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.295+0000 7fc9eea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9d4004d40 0x7fc9f01f0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:49116/0 (socket says 172.21.15.163:49116) 2024-04-01T17:05:29.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.295+0000 7fc9eea00640 1 -- 172.21.15.163:0/3652551054 learned_addr learned my addr 172.21.15.163:0/3652551054 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:29.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.295+0000 7fc9ef400640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9f014cee0 0x7fc9f014d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:29.296 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.295+0000 7fc9e6000640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f014b820 0x7fc9f0157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:29.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.298+0000 7fc9eea00640 1 -- 172.21.15.163:0/3652551054 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f014b820 msgr2=0x7fc9f0157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:29.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.298+0000 7fc9eea00640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f014b820 0x7fc9f0157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:29.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.298+0000 7fc9eea00640 1 -- 172.21.15.163:0/3652551054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9f014cee0 msgr2=0x7fc9f014d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:29.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.298+0000 7fc9eea00640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9f014cee0 0x7fc9f014d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:29.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.298+0000 7fc9eea00640 1 -- 172.21.15.163:0/3652551054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f014bcb0 con 0x7fc9d4004d40 2024-04-01T17:05:29.301 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.301+0000 7fc9eea00640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9d4004d40 0x7fc9f01f0650 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c550 tx=0x7fc9e000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:29.306 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.305+0000 7fc9e7400640 1 -- 172.21.15.163:0/3652551054 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00052d0 con 0x7fc9d4004d40 2024-04-01T17:05:29.306 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.305+0000 7fc9e7400640 1 -- 172.21.15.163:0/3652551054 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e0005470 con 0x7fc9d4004d40 2024-04-01T17:05:29.306 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.306+0000 7fc9e7400640 1 -- 172.21.15.163:0/3652551054 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0012870 con 0x7fc9d4004d40 2024-04-01T17:05:29.306 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.306+0000 7fc9efe00640 1 -- 172.21.15.163:0/3652551054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f00b0ef0 con 0x7fc9d4004d40 2024-04-01T17:05:29.306 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.306+0000 7fc9efe00640 1 -- 172.21.15.163:0/3652551054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f014c9c0 con 0x7fc9d4004d40 2024-04-01T17:05:29.308 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.307+0000 7fc9efe00640 1 -- 172.21.15.163:0/3652551054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f00756d0 con 0x7fc9d4004d40 2024-04-01T17:05:29.330 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.330+0000 7fc9e7400640 1 -- 172.21.15.163:0/3652551054 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9e0012a10 con 0x7fc9d4004d40 2024-04-01T17:05:29.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.330+0000 7fc9e7400640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc9cc06c940 0x7fc9cc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:29.331 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.331+0000 7fc9e6000640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc9cc06c940 0x7fc9cc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:29.332 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.332+0000 7fc9e6000640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc9cc06c940 0x7fc9cc06ee00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0158a80 tx=0x7fc9d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:29.632 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.631+0000 7fc9e7400640 1 -- 172.21.15.163:0/3652551054 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fc9e00580c0 con 0x7fc9d4004d40 2024-04-01T17:05:29.633 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.632+0000 7fc9e7400640 1 -- 172.21.15.163:0/3652551054 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc9e005a020 con 0x7fc9d4004d40 2024-04-01T17:05:29.851 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.850+0000 7fc9efe00640 1 -- 172.21.15.163:0/3652551054 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9f00b0ca0 con 0x7fc9cc06c940 2024-04-01T17:05:29.862 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.861+0000 7fc9e7400640 1 -- 172.21.15.163:0/3652551054 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252714 (secure 0 0 0) 0x7fc9f00b0ca0 con 0x7fc9cc06c940 2024-04-01T17:05:29.866 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T17:05:29.868 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T17:05:29.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.867+0000 7fc9efe00640 1 -- 172.21.15.163:0/3652551054 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc9cc06c940 msgr2=0x7fc9cc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:29.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.867+0000 7fc9efe00640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc9cc06c940 0x7fc9cc06ee00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0158a80 tx=0x7fc9d8008040 comp rx=0 tx=0).stop 2024-04-01T17:05:29.869 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.867+0000 7fc9efe00640 1 -- 172.21.15.163:0/3652551054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9d4004d40 msgr2=0x7fc9f01f0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:29.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.867+0000 7fc9efe00640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9d4004d40 0x7fc9f01f0650 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c550 tx=0x7fc9e000ca10 comp rx=0 tx=0).stop 2024-04-01T17:05:29.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.868+0000 7fc9efe00640 1 -- 172.21.15.163:0/3652551054 shutdown_connections 2024-04-01T17:05:29.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.868+0000 7fc9efe00640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc9cc06c940 0x7fc9cc06ee00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:29.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.868+0000 7fc9efe00640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9f014cee0 0x7fc9f014d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:29.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.868+0000 7fc9efe00640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc9f014b820 0x7fc9f0157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:29.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.868+0000 7fc9efe00640 1 --2- 172.21.15.163:0/3652551054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9d4004d40 0x7fc9f01f0650 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:29.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.868+0000 7fc9efe00640 1 -- 172.21.15.163:0/3652551054 >> 172.21.15.163:0/3652551054 conn(0x7fc9f006f7d0 msgr2=0x7fc9f015aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:29.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.868+0000 7fc9efe00640 1 -- 172.21.15.163:0/3652551054 shutdown_connections 2024-04-01T17:05:29.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:29.868+0000 7fc9efe00640 1 -- 172.21.15.163:0/3652551054 wait complete. 2024-04-01T17:05:29.886 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":967,"stamp":"2024-04-01T17:05:28.584335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23181253,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":535,"num_read_kb":554,"num_write":8981,"num_write_kb":279196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8111,"ondisk_log_size":8111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":334400,"kb_used_data":47552,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754640320,"statfs":{"total":773094113280,"available":772751687680,"internally_reserved":0,"allocated":48693248,"data_stored":47217626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":293654068},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10214,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004536"},"pg_stats":[{"pgid":"3.3f","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.153864+0000","last_change":"2024-04-01T16:34:34.033508+0000","last_active":"2024-04-01T17:05:23.153864+0000","last_peered":"2024-04-01T17:05:23.153864+0000","last_clean":"2024-04-01T17:05:23.153864+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T17:05:23.153864+0000","last_undegraded":"2024-04-01T17:05:23.153864+0000","last_fullsized":"2024-04-01T17:05:23.153864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'41","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.047351+0000","last_change":"2024-04-01T16:34:34.065375+0000","last_active":"2024-04-01T17:05:23.047351+0000","last_peered":"2024-04-01T17:05:23.047351+0000","last_clean":"2024-04-01T17:05:23.047351+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T17:05:23.047351+0000","last_undegraded":"2024-04-01T17:05:23.047351+0000","last_fullsized":"2024-04-01T17:05:23.047351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":1086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'48","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.306554+0000","last_change":"2024-04-01T16:34:34.084618+0000","last_active":"2024-04-01T17:05:23.306554+0000","last_peered":"2024-04-01T17:05:23.306554+0000","last_clean":"2024-04-01T17:05:23.306554+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T17:05:23.306554+0000","last_undegraded":"2024-04-01T17:05:23.306554+0000","last_fullsized":"2024-04-01T17:05:23.306554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:43.530081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.231935+0000","last_change":"2024-04-01T16:34:34.088694+0000","last_active":"2024-04-01T17:05:23.231935+0000","last_peered":"2024-04-01T17:05:23.231935+0000","last_clean":"2024-04-01T17:05:23.231935+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T17:05:23.231935+0000","last_undegraded":"2024-04-01T17:05:23.231935+0000","last_fullsized":"2024-04-01T17:05:23.231935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.154843+0000","last_change":"2024-04-01T16:34:34.085765+0000","last_active":"2024-04-01T17:05:23.154843+0000","last_peered":"2024-04-01T17:05:23.154843+0000","last_clean":"2024-04-01T17:05:23.154843+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T17:05:23.154843+0000","last_undegraded":"2024-04-01T17:05:23.154843+0000","last_fullsized":"2024-04-01T17:05:23.154843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'60","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.234713+0000","last_change":"2024-04-01T16:34:34.066150+0000","last_active":"2024-04-01T17:05:23.234713+0000","last_peered":"2024-04-01T17:05:23.234713+0000","last_clean":"2024-04-01T17:05:23.234713+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T17:05:23.234713+0000","last_undegraded":"2024-04-01T17:05:23.234713+0000","last_fullsized":"2024-04-01T17:05:23.234713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:08:56.651785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":2601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'34","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.147912+0000","last_change":"2024-04-01T16:34:34.072924+0000","last_active":"2024-04-01T17:05:23.147912+0000","last_peered":"2024-04-01T17:05:23.147912+0000","last_clean":"2024-04-01T17:05:23.147912+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T17:05:23.147912+0000","last_undegraded":"2024-04-01T17:05:23.147912+0000","last_fullsized":"2024-04-01T17:05:23.147912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'42","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.196568+0000","last_change":"2024-04-01T16:34:34.088361+0000","last_active":"2024-04-01T17:05:23.196568+0000","last_peered":"2024-04-01T17:05:23.196568+0000","last_clean":"2024-04-01T17:05:23.196568+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T17:05:23.196568+0000","last_undegraded":"2024-04-01T17:05:23.196568+0000","last_fullsized":"2024-04-01T17:05:23.196568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":1328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'48","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.155956+0000","last_change":"2024-04-01T16:34:34.038534+0000","last_active":"2024-04-01T17:05:23.155956+0000","last_peered":"2024-04-01T17:05:23.155956+0000","last_clean":"2024-04-01T17:05:23.155956+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T17:05:23.155956+0000","last_undegraded":"2024-04-01T17:05:23.155956+0000","last_fullsized":"2024-04-01T17:05:23.155956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:54.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.252389+0000","last_change":"2024-04-01T16:34:34.040513+0000","last_active":"2024-04-01T17:05:23.252389+0000","last_peered":"2024-04-01T17:05:23.252389+0000","last_clean":"2024-04-01T17:05:23.252389+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T17:05:23.252389+0000","last_undegraded":"2024-04-01T17:05:23.252389+0000","last_fullsized":"2024-04-01T17:05:23.252389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'36","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.244142+0000","last_change":"2024-04-01T16:34:34.038167+0000","last_active":"2024-04-01T17:05:23.244142+0000","last_peered":"2024-04-01T17:05:23.244142+0000","last_clean":"2024-04-01T17:05:23.244142+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T17:05:23.244142+0000","last_undegraded":"2024-04-01T17:05:23.244142+0000","last_fullsized":"2024-04-01T17:05:23.244142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'32","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.961219+0000","last_change":"2024-04-01T16:34:34.035177+0000","last_active":"2024-04-01T17:05:22.961219+0000","last_peered":"2024-04-01T17:05:22.961219+0000","last_clean":"2024-04-01T17:05:22.961219+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T17:05:22.961219+0000","last_undegraded":"2024-04-01T17:05:22.961219+0000","last_fullsized":"2024-04-01T17:05:22.961219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:37.711846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'66","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.197419+0000","last_change":"2024-04-01T16:34:34.086031+0000","last_active":"2024-04-01T17:05:23.197419+0000","last_peered":"2024-04-01T17:05:23.197419+0000","last_clean":"2024-04-01T17:05:23.197419+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T17:05:23.197419+0000","last_undegraded":"2024-04-01T17:05:23.197419+0000","last_fullsized":"2024-04-01T17:05:23.197419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'46","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.312882+0000","last_change":"2024-04-01T16:34:34.071535+0000","last_active":"2024-04-01T17:05:23.312882+0000","last_peered":"2024-04-01T17:05:23.312882+0000","last_clean":"2024-04-01T17:05:23.312882+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T17:05:23.312882+0000","last_undegraded":"2024-04-01T17:05:23.312882+0000","last_fullsized":"2024-04-01T17:05:23.312882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:45.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'45","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.053260+0000","last_change":"2024-04-01T16:34:33.904701+0000","last_active":"2024-04-01T17:05:23.053260+0000","last_peered":"2024-04-01T17:05:23.053260+0000","last_clean":"2024-04-01T17:05:23.053260+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T17:05:23.053260+0000","last_undegraded":"2024-04-01T17:05:23.053260+0000","last_fullsized":"2024-04-01T17:05:23.053260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":3152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'51","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.231758+0000","last_change":"2024-04-01T16:34:34.064695+0000","last_active":"2024-04-01T17:05:23.231758+0000","last_peered":"2024-04-01T17:05:23.231758+0000","last_clean":"2024-04-01T17:05:23.231758+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T17:05:23.231758+0000","last_undegraded":"2024-04-01T17:05:23.231758+0000","last_fullsized":"2024-04-01T17:05:23.231758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.798148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'54","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.234026+0000","last_change":"2024-04-01T16:34:34.032994+0000","last_active":"2024-04-01T17:05:23.234026+0000","last_peered":"2024-04-01T17:05:23.234026+0000","last_clean":"2024-04-01T17:05:23.234026+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T17:05:23.234026+0000","last_undegraded":"2024-04-01T17:05:23.234026+0000","last_fullsized":"2024-04-01T17:05:23.234026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":6831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'56","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.047424+0000","last_change":"2024-04-01T16:34:34.082238+0000","last_active":"2024-04-01T17:05:23.047424+0000","last_peered":"2024-04-01T17:05:23.047424+0000","last_clean":"2024-04-01T17:05:23.047424+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T17:05:23.047424+0000","last_undegraded":"2024-04-01T17:05:23.047424+0000","last_fullsized":"2024-04-01T17:05:23.047424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.147694+0000","last_change":"2024-04-01T16:34:34.083056+0000","last_active":"2024-04-01T17:05:23.147694+0000","last_peered":"2024-04-01T17:05:23.147694+0000","last_clean":"2024-04-01T17:05:23.147694+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T17:05:23.147694+0000","last_undegraded":"2024-04-01T17:05:23.147694+0000","last_fullsized":"2024-04-01T17:05:23.147694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"27'66","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.248285+0000","last_change":"2024-04-01T16:34:34.034017+0000","last_active":"2024-04-01T17:05:23.248285+0000","last_peered":"2024-04-01T17:05:23.248285+0000","last_clean":"2024-04-01T17:05:23.248285+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T17:05:23.248285+0000","last_undegraded":"2024-04-01T17:05:23.248285+0000","last_fullsized":"2024-04-01T17:05:23.248285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:33.976417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"27'53","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.303894+0000","last_change":"2024-04-01T16:34:34.068541+0000","last_active":"2024-04-01T17:05:23.303894+0000","last_peered":"2024-04-01T17:05:23.303894+0000","last_clean":"2024-04-01T17:05:23.303894+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T17:05:23.303894+0000","last_undegraded":"2024-04-01T17:05:23.303894+0000","last_fullsized":"2024-04-01T17:05:23.303894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:29.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"27'41","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.234841+0000","last_change":"2024-04-01T16:34:34.031774+0000","last_active":"2024-04-01T17:05:23.234841+0000","last_peered":"2024-04-01T17:05:23.234841+0000","last_clean":"2024-04-01T17:05:23.234841+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T17:05:23.234841+0000","last_undegraded":"2024-04-01T17:05:23.234841+0000","last_fullsized":"2024-04-01T17:05:23.234841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:39.294525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'56","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.193241+0000","last_change":"2024-04-01T16:34:34.090324+0000","last_active":"2024-04-01T17:05:23.193241+0000","last_peered":"2024-04-01T17:05:23.193241+0000","last_clean":"2024-04-01T17:05:23.193241+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T17:05:23.193241+0000","last_undegraded":"2024-04-01T17:05:23.193241+0000","last_fullsized":"2024-04-01T17:05:23.193241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:55:40.168021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":6379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'42","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.231684+0000","last_change":"2024-04-01T16:34:34.083544+0000","last_active":"2024-04-01T17:05:23.231684+0000","last_peered":"2024-04-01T17:05:23.231684+0000","last_clean":"2024-04-01T17:05:23.231684+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T17:05:23.231684+0000","last_undegraded":"2024-04-01T17:05:23.231684+0000","last_fullsized":"2024-04-01T17:05:23.231684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.185570+0000","last_change":"2024-04-01T16:34:34.090721+0000","last_active":"2024-04-01T17:05:23.185570+0000","last_peered":"2024-04-01T17:05:23.185570+0000","last_clean":"2024-04-01T17:05:23.185570+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T17:05:23.185570+0000","last_undegraded":"2024-04-01T17:05:23.185570+0000","last_fullsized":"2024-04-01T17:05:23.185570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"27'56","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.252181+0000","last_change":"2024-04-01T16:34:54.510600+0000","last_active":"2024-04-01T17:05:23.252181+0000","last_peered":"2024-04-01T17:05:23.252181+0000","last_clean":"2024-04-01T17:05:23.252181+0000","last_became_active":"2024-04-01T16:34:54.510173+0000","last_became_peered":"2024-04-01T16:34:54.510173+0000","last_unstale":"2024-04-01T17:05:23.252181+0000","last_undegraded":"2024-04-01T17:05:23.252181+0000","last_fullsized":"2024-04-01T17:05:23.252181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.100547+0000","last_change":"2024-04-01T16:34:34.091911+0000","last_active":"2024-04-01T17:05:23.100547+0000","last_peered":"2024-04-01T17:05:23.100547+0000","last_clean":"2024-04-01T17:05:23.100547+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T17:05:23.100547+0000","last_undegraded":"2024-04-01T17:05:23.100547+0000","last_fullsized":"2024-04-01T17:05:23.100547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"27'25","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.197490+0000","last_change":"2024-04-01T16:34:34.091540+0000","last_active":"2024-04-01T17:05:23.197490+0000","last_peered":"2024-04-01T17:05:23.197490+0000","last_clean":"2024-04-01T17:05:23.197490+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T17:05:23.197490+0000","last_undegraded":"2024-04-01T17:05:23.197490+0000","last_fullsized":"2024-04-01T17:05:23.197490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.242571+0000","last_change":"2024-04-01T16:34:34.087634+0000","last_active":"2024-04-01T17:05:23.242571+0000","last_peered":"2024-04-01T17:05:23.242571+0000","last_clean":"2024-04-01T17:05:23.242571+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T17:05:23.242571+0000","last_undegraded":"2024-04-01T17:05:23.242571+0000","last_fullsized":"2024-04-01T17:05:23.242571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:12.994756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"27'56","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.230780+0000","last_change":"2024-04-01T16:34:34.084026+0000","last_active":"2024-04-01T17:05:23.230780+0000","last_peered":"2024-04-01T17:05:23.230780+0000","last_clean":"2024-04-01T17:05:23.230780+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T17:05:23.230780+0000","last_undegraded":"2024-04-01T17:05:23.230780+0000","last_fullsized":"2024-04-01T17:05:23.230780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"27'46","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.039983+0000","last_change":"2024-04-01T16:34:34.088300+0000","last_active":"2024-04-01T17:05:23.039983+0000","last_peered":"2024-04-01T17:05:23.039983+0000","last_clean":"2024-04-01T17:05:23.039983+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T17:05:23.039983+0000","last_undegraded":"2024-04-01T17:05:23.039983+0000","last_fullsized":"2024-04-01T17:05:23.039983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"27'56","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.248072+0000","last_change":"2024-04-01T16:34:34.068348+0000","last_active":"2024-04-01T17:05:23.248072+0000","last_peered":"2024-04-01T17:05:23.248072+0000","last_clean":"2024-04-01T17:05:23.248072+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T17:05:23.248072+0000","last_undegraded":"2024-04-01T17:05:23.248072+0000","last_fullsized":"2024-04-01T17:05:23.248072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":5837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"27'29","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.953396+0000","last_change":"2024-04-01T16:34:33.901019+0000","last_active":"2024-04-01T17:05:22.953396+0000","last_peered":"2024-04-01T17:05:22.953396+0000","last_clean":"2024-04-01T17:05:22.953396+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T17:05:22.953396+0000","last_undegraded":"2024-04-01T17:05:22.953396+0000","last_fullsized":"2024-04-01T17:05:22.953396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:08:37.254438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'509","reported_seq":546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:50.054268+0000","last_change":"2024-04-01T16:34:31.489434+0000","last_active":"2024-04-01T17:04:50.054268+0000","last_peered":"2024-04-01T17:04:50.054268+0000","last_clean":"2024-04-01T17:04:50.054268+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T17:04:50.054268+0000","last_undegraded":"2024-04-01T17:04:50.054268+0000","last_fullsized":"2024-04-01T17:04:50.054268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'34","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.304501+0000","last_change":"2024-04-01T16:34:34.065342+0000","last_active":"2024-04-01T17:05:23.304501+0000","last_peered":"2024-04-01T17:05:23.304501+0000","last_clean":"2024-04-01T17:05:23.304501+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T17:05:23.304501+0000","last_undegraded":"2024-04-01T17:05:23.304501+0000","last_fullsized":"2024-04-01T17:05:23.304501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:56.911106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"27'432","reported_seq":469,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:50.048564+0000","last_change":"2024-04-01T16:34:31.530201+0000","last_active":"2024-04-01T17:04:50.048564+0000","last_peered":"2024-04-01T17:04:50.048564+0000","last_clean":"2024-04-01T17:04:50.048564+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T17:04:50.048564+0000","last_undegraded":"2024-04-01T17:04:50.048564+0000","last_fullsized":"2024-04-01T17:04:50.048564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.160707+0000","last_change":"2024-04-01T16:34:31.528238+0000","last_active":"2024-04-01T17:04:55.160707+0000","last_peered":"2024-04-01T17:04:55.160707+0000","last_clean":"2024-04-01T17:04:55.160707+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T17:04:55.160707+0000","last_undegraded":"2024-04-01T17:04:55.160707+0000","last_fullsized":"2024-04-01T17:04:55.160707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'57","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.193288+0000","last_change":"2024-04-01T16:34:34.091302+0000","last_active":"2024-04-01T17:05:23.193288+0000","last_peered":"2024-04-01T17:05:23.193288+0000","last_clean":"2024-04-01T17:05:23.193288+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T17:05:23.193288+0000","last_undegraded":"2024-04-01T17:05:23.193288+0000","last_fullsized":"2024-04-01T17:05:23.193288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":3573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:50.021371+0000","last_change":"2024-04-01T16:34:31.567946+0000","last_active":"2024-04-01T17:04:50.021371+0000","last_peered":"2024-04-01T17:04:50.021371+0000","last_clean":"2024-04-01T17:04:50.021371+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T17:04:50.021371+0000","last_undegraded":"2024-04-01T17:04:50.021371+0000","last_fullsized":"2024-04-01T17:04:50.021371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'43","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.108678+0000","last_change":"2024-04-01T16:34:34.088894+0000","last_active":"2024-04-01T17:05:23.108678+0000","last_peered":"2024-04-01T17:05:23.108678+0000","last_clean":"2024-04-01T17:05:23.108678+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T17:05:23.108678+0000","last_undegraded":"2024-04-01T17:05:23.108678+0000","last_fullsized":"2024-04-01T17:05:23.108678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:20.052132+0000","last_change":"2024-04-01T16:34:31.566997+0000","last_active":"2024-04-01T17:04:20.052132+0000","last_peered":"2024-04-01T17:04:20.052132+0000","last_clean":"2024-04-01T17:04:20.052132+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T17:04:20.052132+0000","last_undegraded":"2024-04-01T17:04:20.052132+0000","last_fullsized":"2024-04-01T17:04:20.052132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'70","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.229858+0000","last_change":"2024-04-01T16:34:34.030831+0000","last_active":"2024-04-01T17:05:23.229858+0000","last_peered":"2024-04-01T17:05:23.229858+0000","last_clean":"2024-04-01T17:05:23.229858+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T17:05:23.229858+0000","last_undegraded":"2024-04-01T17:05:23.229858+0000","last_fullsized":"2024-04-01T17:05:23.229858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:36.765896+0000","last_change":"2024-04-01T16:34:31.569927+0000","last_active":"2024-04-01T17:04:36.765896+0000","last_peered":"2024-04-01T17:04:36.765896+0000","last_clean":"2024-04-01T17:04:36.765896+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T17:04:36.765896+0000","last_undegraded":"2024-04-01T17:04:36.765896+0000","last_fullsized":"2024-04-01T17:04:36.765896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:41.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'48","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.240843+0000","last_change":"2024-04-01T16:34:34.068959+0000","last_active":"2024-04-01T17:05:23.240843+0000","last_peered":"2024-04-01T17:05:23.240843+0000","last_clean":"2024-04-01T17:05:23.240843+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T17:05:23.240843+0000","last_undegraded":"2024-04-01T17:05:23.240843+0000","last_fullsized":"2024-04-01T17:05:23.240843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:58:57.685708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"27'309","reported_seq":346,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:14.920828+0000","last_change":"2024-04-01T16:34:31.562792+0000","last_active":"2024-04-01T17:05:14.920828+0000","last_peered":"2024-04-01T17:05:14.920828+0000","last_clean":"2024-04-01T17:05:14.920828+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T17:05:14.920828+0000","last_undegraded":"2024-04-01T17:05:14.920828+0000","last_fullsized":"2024-04-01T17:05:14.920828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:55.684911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'53","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.962968+0000","last_change":"2024-04-01T16:34:33.916652+0000","last_active":"2024-04-01T17:05:22.962968+0000","last_peered":"2024-04-01T17:05:22.962968+0000","last_clean":"2024-04-01T17:05:22.962968+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T17:05:22.962968+0000","last_undegraded":"2024-04-01T17:05:22.962968+0000","last_fullsized":"2024-04-01T17:05:22.962968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":3009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"27'798","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.806557+0000","last_change":"2024-04-01T16:34:31.531366+0000","last_active":"2024-04-01T17:05:06.806557+0000","last_peered":"2024-04-01T17:05:06.806557+0000","last_clean":"2024-04-01T17:05:06.806557+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T17:05:06.806557+0000","last_undegraded":"2024-04-01T17:05:06.806557+0000","last_fullsized":"2024-04-01T17:05:06.806557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'42","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.147953+0000","last_change":"2024-04-01T16:34:34.085449+0000","last_active":"2024-04-01T17:05:23.147953+0000","last_peered":"2024-04-01T17:05:23.147953+0000","last_clean":"2024-04-01T17:05:23.147953+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T17:05:23.147953+0000","last_undegraded":"2024-04-01T17:05:23.147953+0000","last_fullsized":"2024-04-01T17:05:23.147953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.756876+0000","last_change":"2024-04-01T16:34:31.444458+0000","last_active":"2024-04-01T17:05:06.756876+0000","last_peered":"2024-04-01T17:05:06.756876+0000","last_clean":"2024-04-01T17:05:06.756876+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T17:05:06.756876+0000","last_undegraded":"2024-04-01T17:05:06.756876+0000","last_fullsized":"2024-04-01T17:05:06.756876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'50","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.304146+0000","last_change":"2024-04-01T16:34:34.071521+0000","last_active":"2024-04-01T17:05:23.304146+0000","last_peered":"2024-04-01T17:05:23.304146+0000","last_clean":"2024-04-01T17:05:23.304146+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T17:05:23.304146+0000","last_undegraded":"2024-04-01T17:05:23.304146+0000","last_fullsized":"2024-04-01T17:05:23.304146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:36:13.618956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:12.982073+0000","last_change":"2024-04-01T16:34:31.566202+0000","last_active":"2024-04-01T17:05:12.982073+0000","last_peered":"2024-04-01T17:05:12.982073+0000","last_clean":"2024-04-01T17:05:12.982073+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T17:05:12.982073+0000","last_undegraded":"2024-04-01T17:05:12.982073+0000","last_fullsized":"2024-04-01T17:05:12.982073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:54.543283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'72","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.182012+0000","last_change":"2024-04-01T16:34:33.930561+0000","last_active":"2024-04-01T17:05:23.182012+0000","last_peered":"2024-04-01T17:05:23.182012+0000","last_clean":"2024-04-01T17:05:23.182012+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T17:05:23.182012+0000","last_undegraded":"2024-04-01T17:05:23.182012+0000","last_fullsized":"2024-04-01T17:05:23.182012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":8452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:43.856695+0000","last_change":"2024-04-01T16:34:31.535895+0000","last_active":"2024-04-01T17:04:43.856695+0000","last_peered":"2024-04-01T17:04:43.856695+0000","last_clean":"2024-04-01T17:04:43.856695+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T17:04:43.856695+0000","last_undegraded":"2024-04-01T17:04:43.856695+0000","last_fullsized":"2024-04-01T17:04:43.856695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:36:43.780845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'37","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.245430+0000","last_change":"2024-04-01T16:34:34.068194+0000","last_active":"2024-04-01T17:05:23.245430+0000","last_peered":"2024-04-01T17:05:23.245430+0000","last_clean":"2024-04-01T17:05:23.245430+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T17:05:23.245430+0000","last_undegraded":"2024-04-01T17:05:23.245430+0000","last_fullsized":"2024-04-01T17:05:23.245430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:11.860033+0000","last_change":"2024-04-01T16:34:31.515495+0000","last_active":"2024-04-01T17:05:11.860033+0000","last_peered":"2024-04-01T17:05:11.860033+0000","last_clean":"2024-04-01T17:05:11.860033+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T17:05:11.860033+0000","last_undegraded":"2024-04-01T17:05:11.860033+0000","last_fullsized":"2024-04-01T17:05:11.860033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:26:56.217819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.149246+0000","last_change":"2024-04-01T16:34:33.926318+0000","last_active":"2024-04-01T17:05:23.149246+0000","last_peered":"2024-04-01T17:05:23.149246+0000","last_clean":"2024-04-01T17:05:23.149246+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T17:05:23.149246+0000","last_undegraded":"2024-04-01T17:05:23.149246+0000","last_fullsized":"2024-04-01T17:05:23.149246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:43.876931+0000","last_change":"2024-04-01T16:34:31.440349+0000","last_active":"2024-04-01T17:04:43.876931+0000","last_peered":"2024-04-01T17:04:43.876931+0000","last_clean":"2024-04-01T17:04:43.876931+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T17:04:43.876931+0000","last_undegraded":"2024-04-01T17:04:43.876931+0000","last_fullsized":"2024-04-01T17:04:43.876931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:29.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'29","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.146008+0000","last_change":"2024-04-01T16:34:33.931211+0000","last_active":"2024-04-01T17:05:23.146008+0000","last_peered":"2024-04-01T17:05:23.146008+0000","last_clean":"2024-04-01T17:05:23.146008+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T17:05:23.146008+0000","last_undegraded":"2024-04-01T17:05:23.146008+0000","last_fullsized":"2024-04-01T17:05:23.146008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:15:45.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:03:46.712894+0000","last_change":"2024-04-01T16:34:31.512433+0000","last_active":"2024-04-01T17:03:46.712894+0000","last_peered":"2024-04-01T17:03:46.712894+0000","last_clean":"2024-04-01T17:03:46.712894+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T17:03:46.712894+0000","last_undegraded":"2024-04-01T17:03:46.712894+0000","last_fullsized":"2024-04-01T17:03:46.712894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:16.032012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'39","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.155875+0000","last_change":"2024-04-01T16:34:33.930791+0000","last_active":"2024-04-01T17:05:23.155875+0000","last_peered":"2024-04-01T17:05:23.155875+0000","last_clean":"2024-04-01T17:05:23.155875+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T17:05:23.155875+0000","last_undegraded":"2024-04-01T17:05:23.155875+0000","last_fullsized":"2024-04-01T17:05:23.155875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:53.102054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.177195+0000","last_change":"2024-04-01T16:34:31.509375+0000","last_active":"2024-04-01T17:04:55.177195+0000","last_peered":"2024-04-01T17:04:55.177195+0000","last_clean":"2024-04-01T17:04:55.177195+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T17:04:55.177195+0000","last_undegraded":"2024-04-01T17:04:55.177195+0000","last_fullsized":"2024-04-01T17:04:55.177195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'50","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.230734+0000","last_change":"2024-04-01T16:34:34.085219+0000","last_active":"2024-04-01T17:05:23.230734+0000","last_peered":"2024-04-01T17:05:23.230734+0000","last_clean":"2024-04-01T17:05:23.230734+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T17:05:23.230734+0000","last_undegraded":"2024-04-01T17:05:23.230734+0000","last_fullsized":"2024-04-01T17:05:23.230734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"27'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:03:46.712863+0000","last_change":"2024-04-01T16:34:31.562761+0000","last_active":"2024-04-01T17:03:46.712863+0000","last_peered":"2024-04-01T17:03:46.712863+0000","last_clean":"2024-04-01T17:03:46.712863+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T17:03:46.712863+0000","last_undegraded":"2024-04-01T17:03:46.712863+0000","last_fullsized":"2024-04-01T17:03:46.712863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:23:33.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'41","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.148743+0000","last_change":"2024-04-01T16:34:34.039521+0000","last_active":"2024-04-01T17:05:23.148743+0000","last_peered":"2024-04-01T17:05:23.148743+0000","last_clean":"2024-04-01T17:05:23.148743+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T17:05:23.148743+0000","last_undegraded":"2024-04-01T17:05:23.148743+0000","last_fullsized":"2024-04-01T17:05:23.148743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":4631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:02:11.703709+0000","last_change":"2024-04-01T16:34:08.195697+0000","last_active":"2024-04-01T17:02:11.703709+0000","last_peered":"2024-04-01T17:02:11.703709+0000","last_clean":"2024-04-01T17:02:11.703709+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T17:02:11.703709+0000","last_undegraded":"2024-04-01T17:02:11.703709+0000","last_fullsized":"2024-04-01T17:02:11.703709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_clean_scrub_stamp":"2024-04-01T16:34:06.247737+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:05:51.067541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.810588+0000","last_change":"2024-04-01T16:34:31.569697+0000","last_active":"2024-04-01T17:05:06.810588+0000","last_peered":"2024-04-01T17:05:06.810588+0000","last_clean":"2024-04-01T17:05:06.810588+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T17:05:06.810588+0000","last_undegraded":"2024-04-01T17:05:06.810588+0000","last_fullsized":"2024-04-01T17:05:06.810588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.736852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.192829+0000","last_change":"2024-04-01T16:34:34.087298+0000","last_active":"2024-04-01T17:05:23.192829+0000","last_peered":"2024-04-01T17:05:23.192829+0000","last_clean":"2024-04-01T17:05:23.192829+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T17:05:23.192829+0000","last_undegraded":"2024-04-01T17:05:23.192829+0000","last_fullsized":"2024-04-01T17:05:23.192829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:36.417042+0000","last_change":"2024-04-01T16:34:31.509150+0000","last_active":"2024-04-01T17:04:36.417042+0000","last_peered":"2024-04-01T17:04:36.417042+0000","last_clean":"2024-04-01T17:04:36.417042+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T17:04:36.417042+0000","last_undegraded":"2024-04-01T17:04:36.417042+0000","last_fullsized":"2024-04-01T17:04:36.417042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'25","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.312341+0000","last_change":"2024-04-01T16:34:34.068444+0000","last_active":"2024-04-01T17:05:23.312341+0000","last_peered":"2024-04-01T17:05:23.312341+0000","last_clean":"2024-04-01T17:05:23.312341+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T17:05:23.312341+0000","last_undegraded":"2024-04-01T17:05:23.312341+0000","last_fullsized":"2024-04-01T17:05:23.312341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:04.104676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"27'432","reported_seq":890,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:15.893893+0000","last_change":"2024-04-01T16:34:31.512295+0000","last_active":"2024-04-01T17:05:15.893893+0000","last_peered":"2024-04-01T17:05:15.893893+0000","last_clean":"2024-04-01T17:05:15.893893+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T17:05:15.893893+0000","last_undegraded":"2024-04-01T17:05:15.893893+0000","last_fullsized":"2024-04-01T17:05:15.893893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:35.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110595,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":419,"num_read_kb":454,"num_write":427,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'53","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.051145+0000","last_change":"2024-04-01T16:34:34.083194+0000","last_active":"2024-04-01T17:05:23.051145+0000","last_peered":"2024-04-01T17:05:23.051145+0000","last_clean":"2024-04-01T17:05:23.051145+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T17:05:23.051145+0000","last_undegraded":"2024-04-01T17:05:23.051145+0000","last_fullsized":"2024-04-01T17:05:23.051145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:43.692930+0000","last_change":"2024-04-01T16:34:31.569571+0000","last_active":"2024-04-01T17:04:43.692930+0000","last_peered":"2024-04-01T17:04:43.692930+0000","last_clean":"2024-04-01T17:04:43.692930+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T17:04:43.692930+0000","last_undegraded":"2024-04-01T17:04:43.692930+0000","last_fullsized":"2024-04-01T17:04:43.692930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:10.626933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'26","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.958089+0000","last_change":"2024-04-01T16:34:34.063200+0000","last_active":"2024-04-01T17:05:22.958089+0000","last_peered":"2024-04-01T17:05:22.958089+0000","last_clean":"2024-04-01T17:05:22.958089+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T17:05:22.958089+0000","last_undegraded":"2024-04-01T17:05:22.958089+0000","last_fullsized":"2024-04-01T17:05:22.958089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:18.399835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":2569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.819009+0000","last_change":"2024-04-01T16:34:31.512508+0000","last_active":"2024-04-01T17:05:06.819009+0000","last_peered":"2024-04-01T17:05:06.819009+0000","last_clean":"2024-04-01T17:05:06.819009+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T17:05:06.819009+0000","last_undegraded":"2024-04-01T17:05:06.819009+0000","last_fullsized":"2024-04-01T17:05:06.819009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'34","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.042783+0000","last_change":"2024-04-01T16:34:54.510347+0000","last_active":"2024-04-01T17:05:23.042783+0000","last_peered":"2024-04-01T17:05:23.042783+0000","last_clean":"2024-04-01T17:05:23.042783+0000","last_became_active":"2024-04-01T16:34:54.509976+0000","last_became_peered":"2024-04-01T16:34:54.509976+0000","last_unstale":"2024-04-01T17:05:23.042783+0000","last_undegraded":"2024-04-01T17:05:23.042783+0000","last_fullsized":"2024-04-01T17:05:23.042783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:41:48.631612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:01.205221+0000","last_change":"2024-04-01T16:34:31.426647+0000","last_active":"2024-04-01T17:05:01.205221+0000","last_peered":"2024-04-01T17:05:01.205221+0000","last_clean":"2024-04-01T17:05:01.205221+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T17:05:01.205221+0000","last_undegraded":"2024-04-01T17:05:01.205221+0000","last_fullsized":"2024-04-01T17:05:01.205221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:36.926701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.053284+0000","last_change":"2024-04-01T16:34:34.087431+0000","last_active":"2024-04-01T17:05:23.053284+0000","last_peered":"2024-04-01T17:05:23.053284+0000","last_clean":"2024-04-01T17:05:23.053284+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T17:05:23.053284+0000","last_undegraded":"2024-04-01T17:05:23.053284+0000","last_fullsized":"2024-04-01T17:05:23.053284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"27'1149","reported_seq":1188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:13.942307+0000","last_change":"2024-04-01T16:34:31.528790+0000","last_active":"2024-04-01T17:05:13.942307+0000","last_peered":"2024-04-01T17:05:13.942307+0000","last_clean":"2024-04-01T17:05:13.942307+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T17:05:13.942307+0000","last_undegraded":"2024-04-01T17:05:13.942307+0000","last_fullsized":"2024-04-01T17:05:13.942307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1149,"log_dups_size":0,"ondisk_log_size":1149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2752,"num_write_kb":935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.196350+0000","last_change":"2024-04-01T16:34:34.085832+0000","last_active":"2024-04-01T17:05:23.196350+0000","last_peered":"2024-04-01T17:05:23.196350+0000","last_clean":"2024-04-01T17:05:23.196350+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T17:05:23.196350+0000","last_undegraded":"2024-04-01T17:05:23.196350+0000","last_fullsized":"2024-04-01T17:05:23.196350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:00.278120+0000","last_change":"2024-04-01T16:34:31.534057+0000","last_active":"2024-04-01T17:05:00.278120+0000","last_peered":"2024-04-01T17:05:00.278120+0000","last_clean":"2024-04-01T17:05:00.278120+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T17:05:00.278120+0000","last_undegraded":"2024-04-01T17:05:00.278120+0000","last_fullsized":"2024-04-01T17:05:00.278120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'56","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.243128+0000","last_change":"2024-04-01T16:34:34.073261+0000","last_active":"2024-04-01T17:05:23.243128+0000","last_peered":"2024-04-01T17:05:23.243128+0000","last_clean":"2024-04-01T17:05:23.243128+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T17:05:23.243128+0000","last_undegraded":"2024-04-01T17:05:23.243128+0000","last_fullsized":"2024-04-01T17:05:23.243128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:38.619969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":6288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:00.296785+0000","last_change":"2024-04-01T16:34:31.423531+0000","last_active":"2024-04-01T17:05:00.296785+0000","last_peered":"2024-04-01T17:05:00.296785+0000","last_clean":"2024-04-01T17:05:00.296785+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T17:05:00.296785+0000","last_undegraded":"2024-04-01T17:05:00.296785+0000","last_fullsized":"2024-04-01T17:05:00.296785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'38","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.472817+0000","last_change":"2024-04-01T16:34:34.086029+0000","last_active":"2024-04-01T17:04:55.472817+0000","last_peered":"2024-04-01T17:04:55.472817+0000","last_clean":"2024-04-01T17:04:55.472817+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T17:04:55.472817+0000","last_undegraded":"2024-04-01T17:04:55.472817+0000","last_fullsized":"2024-04-01T17:04:55.472817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:53.554803+0000","last_change":"2024-04-01T16:34:31.509351+0000","last_active":"2024-04-01T17:04:53.554803+0000","last_peered":"2024-04-01T17:04:53.554803+0000","last_clean":"2024-04-01T17:04:53.554803+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T17:04:53.554803+0000","last_undegraded":"2024-04-01T17:04:53.554803+0000","last_fullsized":"2024-04-01T17:04:53.554803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'43","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.192179+0000","last_change":"2024-04-01T16:34:34.091932+0000","last_active":"2024-04-01T17:05:23.192179+0000","last_peered":"2024-04-01T17:05:23.192179+0000","last_clean":"2024-04-01T17:05:23.192179+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T17:05:23.192179+0000","last_undegraded":"2024-04-01T17:05:23.192179+0000","last_fullsized":"2024-04-01T17:05:23.192179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:11:00.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.177952+0000","last_change":"2024-04-01T16:34:31.517513+0000","last_active":"2024-04-01T17:04:55.177952+0000","last_peered":"2024-04-01T17:04:55.177952+0000","last_clean":"2024-04-01T17:04:55.177952+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T17:04:55.177952+0000","last_undegraded":"2024-04-01T17:04:55.177952+0000","last_fullsized":"2024-04-01T17:04:55.177952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:31.608594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'58","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.051569+0000","last_change":"2024-04-01T16:34:55.004709+0000","last_active":"2024-04-01T17:05:23.051569+0000","last_peered":"2024-04-01T17:05:23.051569+0000","last_clean":"2024-04-01T17:05:23.051569+0000","last_became_active":"2024-04-01T16:34:55.003987+0000","last_became_peered":"2024-04-01T16:34:55.003987+0000","last_unstale":"2024-04-01T17:05:23.051569+0000","last_undegraded":"2024-04-01T17:05:23.051569+0000","last_fullsized":"2024-04-01T17:05:23.051569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"27'622","reported_seq":660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:20.069789+0000","last_change":"2024-04-01T16:34:31.444603+0000","last_active":"2024-04-01T17:04:20.069789+0000","last_peered":"2024-04-01T17:04:20.069789+0000","last_clean":"2024-04-01T17:04:20.069789+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T17:04:20.069789+0000","last_undegraded":"2024-04-01T17:04:20.069789+0000","last_fullsized":"2024-04-01T17:04:20.069789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.245866+0000","last_change":"2024-04-01T16:34:34.034061+0000","last_active":"2024-04-01T17:05:23.245866+0000","last_peered":"2024-04-01T17:05:23.245866+0000","last_clean":"2024-04-01T17:05:23.245866+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T17:05:23.245866+0000","last_undegraded":"2024-04-01T17:05:23.245866+0000","last_fullsized":"2024-04-01T17:05:23.245866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"27'54","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.047264+0000","last_change":"2024-04-01T16:34:55.011962+0000","last_active":"2024-04-01T17:05:23.047264+0000","last_peered":"2024-04-01T17:05:23.047264+0000","last_clean":"2024-04-01T17:05:23.047264+0000","last_became_active":"2024-04-01T16:34:55.011400+0000","last_became_peered":"2024-04-01T16:34:55.011400+0000","last_unstale":"2024-04-01T17:05:23.047264+0000","last_undegraded":"2024-04-01T17:05:23.047264+0000","last_fullsized":"2024-04-01T17:05:23.047264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:14:52.381836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":3157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:49.977812+0000","last_change":"2024-04-01T16:34:31.563882+0000","last_active":"2024-04-01T17:04:49.977812+0000","last_peered":"2024-04-01T17:04:49.977812+0000","last_clean":"2024-04-01T17:04:49.977812+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T17:04:49.977812+0000","last_undegraded":"2024-04-01T17:04:49.977812+0000","last_fullsized":"2024-04-01T17:04:49.977812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:27.209535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'35","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.233213+0000","last_change":"2024-04-01T16:34:34.034904+0000","last_active":"2024-04-01T17:05:23.233213+0000","last_peered":"2024-04-01T17:05:23.233213+0000","last_clean":"2024-04-01T17:05:23.233213+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T17:05:23.233213+0000","last_undegraded":"2024-04-01T17:05:23.233213+0000","last_fullsized":"2024-04-01T17:05:23.233213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:00.297118+0000","last_change":"2024-04-01T16:34:31.530246+0000","last_active":"2024-04-01T17:05:00.297118+0000","last_peered":"2024-04-01T17:05:00.297118+0000","last_clean":"2024-04-01T17:05:00.297118+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T17:05:00.297118+0000","last_undegraded":"2024-04-01T17:05:00.297118+0000","last_fullsized":"2024-04-01T17:05:00.297118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:48.430325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"27'50","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.312112+0000","last_change":"2024-04-01T16:34:34.066381+0000","last_active":"2024-04-01T17:05:23.312112+0000","last_peered":"2024-04-01T17:05:23.312112+0000","last_clean":"2024-04-01T17:05:23.312112+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T17:05:23.312112+0000","last_undegraded":"2024-04-01T17:05:23.312112+0000","last_fullsized":"2024-04-01T17:05:23.312112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:10.824493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":6181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"27'145","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.699552+0000","last_change":"2024-04-01T16:34:31.490535+0000","last_active":"2024-04-01T17:05:22.699552+0000","last_peered":"2024-04-01T17:05:22.699552+0000","last_clean":"2024-04-01T17:05:22.699552+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T17:05:22.699552+0000","last_undegraded":"2024-04-01T17:05:22.699552+0000","last_fullsized":"2024-04-01T17:05:22.699552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:24.709969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507300,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.184093+0000","last_change":"2024-04-01T16:34:34.087097+0000","last_active":"2024-04-01T17:05:23.184093+0000","last_peered":"2024-04-01T17:05:23.184093+0000","last_clean":"2024-04-01T17:05:23.184093+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T17:05:23.184093+0000","last_undegraded":"2024-04-01T17:05:23.184093+0000","last_fullsized":"2024-04-01T17:05:23.184093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:17:48.287828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'621","reported_seq":660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:03:41.727213+0000","last_change":"2024-04-01T16:34:31.420599+0000","last_active":"2024-04-01T17:03:41.727213+0000","last_peered":"2024-04-01T17:03:41.727213+0000","last_clean":"2024-04-01T17:03:41.727213+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T17:03:41.727213+0000","last_undegraded":"2024-04-01T17:03:41.727213+0000","last_fullsized":"2024-04-01T17:03:41.727213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2204,"num_write_kb":251439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2871,"ondisk_log_size":2871,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22590885,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":419,"num_read_kb":454,"num_write":6618,"num_write_kb":25341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45244416,"data_stored":45181770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5123,"ondisk_log_size":5123,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509820,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52644,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319196,"statfs":{"total":96636764160,"available":96582856704,"internally_reserved":0,"allocated":13463552,"data_stored":13280752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509822,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":217485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509818,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41772,"kb_used_data":6436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330068,"statfs":{"total":96636764160,"available":96593989632,"internally_reserved":0,"allocated":6590464,"data_stored":6399500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509819,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":106980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509820,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43816,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328024,"statfs":{"total":96636764160,"available":96591896576,"internally_reserved":0,"allocated":8683520,"data_stored":8495624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542525,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47972,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323868,"statfs":{"total":96636764160,"available":96587640832,"internally_reserved":0,"allocated":8679424,"data_stored":8496170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542523,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49556,"kb_used_data":10060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322284,"statfs":{"total":96636764160,"available":96586018816,"internally_reserved":0,"allocated":10301440,"data_stored":10114065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542526,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35620,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336220,"statfs":{"total":96636764160,"available":96600289280,"internally_reserved":0,"allocated":290816,"data_stored":107050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5713920,"data_stored":5702242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":110595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10018816,"data_stored":10007175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8389280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T17:05:29.892 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T17:05:30.135 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.134+0000 7f5138800640 1 Processor -- start 2024-04-01T17:05:30.135 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.134+0000 7f5138800640 1 -- start start 2024-04-01T17:05:30.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.135+0000 7f5138800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5130152830 0x7f5130072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:30.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.136+0000 7f5138800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f51300c6b30 0x7f5130072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:30.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.136+0000 7f5138800640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51300737f0 con 0x7f5130071ee0 2024-04-01T17:05:30.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.136+0000 7f5138800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f5130152c10 con 0x7f5130152830 2024-04-01T17:05:30.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.136+0000 7f5138800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f51300c72d0 con 0x7f51300c6b30 2024-04-01T17:05:30.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.137+0000 7f5135e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5130152830 0x7f5130072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:30.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.137+0000 7f5135e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5130152830 0x7f5130072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:49120/0 (socket says 172.21.15.163:49120) 2024-04-01T17:05:30.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.137+0000 7f5135e00640 1 -- 172.21.15.163:0/943948768 learned_addr learned my addr 172.21.15.163:0/943948768 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:30.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.138+0000 7f5135400640 1 --2- 172.21.15.163:0/943948768 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f51300c6b30 0x7f5130072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:30.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.140+0000 7f5135e00640 1 -- 172.21.15.163:0/943948768 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f51300c6b30 msgr2=0x7f5130072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:30.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.140+0000 7f5135e00640 1 --2- 172.21.15.163:0/943948768 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f51300c6b30 0x7f5130072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:30.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.140+0000 7f5135e00640 1 -- 172.21.15.163:0/943948768 >> v1:172.21.15.189:6789/0 conn(0x7f5130071ee0 legacy=0x7f513015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:30.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.140+0000 7f5135e00640 1 -- 172.21.15.163:0/943948768 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51300c75b0 con 0x7f5130152830 2024-04-01T17:05:30.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.142+0000 7f5135e00640 1 --2- 172.21.15.163:0/943948768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5130152830 0x7f5130072900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5124009870 tx=0x7f512402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98add8699800f326 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:30.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.146+0000 7f5134a00640 1 -- 172.21.15.163:0/943948768 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124034070 con 0x7f5130152830 2024-04-01T17:05:30.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.147+0000 7f5134a00640 1 -- 172.21.15.163:0/943948768 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5124030840 con 0x7f5130152830 2024-04-01T17:05:30.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.147+0000 7f5134a00640 1 -- 172.21.15.163:0/943948768 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124030c10 con 0x7f5130152830 2024-04-01T17:05:30.148 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.147+0000 7f5138800640 1 -- 172.21.15.163:0/943948768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5130152830 msgr2=0x7f5130072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:30.148 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.148+0000 7f5138800640 1 --2- 172.21.15.163:0/943948768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5130152830 0x7f5130072900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5124009870 tx=0x7f512402b980 comp rx=0 tx=0).stop 2024-04-01T17:05:30.148 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.148+0000 7f5138800640 1 -- 172.21.15.163:0/943948768 shutdown_connections 2024-04-01T17:05:30.148 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.148+0000 7f5138800640 1 --2- 172.21.15.163:0/943948768 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f51300c6b30 0x7f5130072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:30.149 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.148+0000 7f5138800640 1 --2- 172.21.15.163:0/943948768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5130152830 0x7f5130072900 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:30.149 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.148+0000 7f5138800640 1 -- 172.21.15.163:0/943948768 >> 172.21.15.163:0/943948768 conn(0x7f51300cbe20 msgr2=0x7f51300cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:30.149 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.148+0000 7f5138800640 1 -- 172.21.15.163:0/943948768 shutdown_connections 2024-04-01T17:05:30.149 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.148+0000 7f5138800640 1 -- 172.21.15.163:0/943948768 wait complete. 2024-04-01T17:05:30.150 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.149+0000 7f5138800640 1 Processor -- start 2024-04-01T17:05:30.150 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.150+0000 7f5138800640 1 -- start start 2024-04-01T17:05:30.151 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.151+0000 7f5138800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5130071ee0 0x7f513014de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:30.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.151+0000 7f5138800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f51300c6b30 0x7f5130158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:30.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.151+0000 7f5138800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5130152830 0x7f513006f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:30.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.151+0000 7f5138800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5130073a90 con 0x7f5130071ee0 2024-04-01T17:05:30.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.151+0000 7f5138800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f51300c7b70 con 0x7f5130152830 2024-04-01T17:05:30.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.151+0000 7f5138800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f51300707f0 con 0x7f51300c6b30 2024-04-01T17:05:30.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.151+0000 7f5135e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5130071ee0 0x7f513014de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:30.153 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.152+0000 7f5135e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5130071ee0 0x7f513014de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:49134/0 (socket says 172.21.15.163:49134) 2024-04-01T17:05:30.153 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.152+0000 7f5135e00640 1 -- 172.21.15.163:0/482409340 learned_addr learned my addr 172.21.15.163:0/482409340 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:30.153 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.152+0000 7f5135400640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f51300c6b30 0x7f5130158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:30.153 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.152+0000 7f5136800640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5130152830 0x7f513006f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:30.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.156+0000 7f5135e00640 1 -- 172.21.15.163:0/482409340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f51300c6b30 msgr2=0x7f5130158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:30.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.156+0000 7f5135e00640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f51300c6b30 0x7f5130158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:30.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.156+0000 7f5135e00640 1 -- 172.21.15.163:0/482409340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5130152830 msgr2=0x7f513006f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:30.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.156+0000 7f5135e00640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5130152830 0x7f513006f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:30.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.156+0000 7f5135e00640 1 -- 172.21.15.163:0/482409340 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51301f3b30 con 0x7f5130071ee0 2024-04-01T17:05:30.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.158+0000 7f5135e00640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5130071ee0 0x7f513014de60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5124000c00 tx=0x7f5124004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:30.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.162+0000 7f512a000640 1 -- 172.21.15.163:0/482409340 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124048070 con 0x7f5130071ee0 2024-04-01T17:05:30.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.162+0000 7f512a000640 1 -- 172.21.15.163:0/482409340 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5124030640 con 0x7f5130071ee0 2024-04-01T17:05:30.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.162+0000 7f512a000640 1 -- 172.21.15.163:0/482409340 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124034040 con 0x7f5130071ee0 2024-04-01T17:05:30.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.162+0000 7f5138800640 1 -- 172.21.15.163:0/482409340 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5130159530 con 0x7f5130071ee0 2024-04-01T17:05:30.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.162+0000 7f5138800640 1 -- 172.21.15.163:0/482409340 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51301f40d0 con 0x7f5130071ee0 2024-04-01T17:05:30.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.164+0000 7f5138800640 1 -- 172.21.15.163:0/482409340 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51300756d0 con 0x7f5130071ee0 2024-04-01T17:05:30.186 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.185+0000 7f512a000640 1 -- 172.21.15.163:0/482409340 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f512404b070 con 0x7f5130071ee0 2024-04-01T17:05:30.187 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.186+0000 7f512a000640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f511406c970 0x7f511406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:30.187 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.187+0000 7f5135400640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f511406c970 0x7f511406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:30.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.187+0000 7f5135400640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f511406c970 0x7f511406ee30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f51301560c0 tx=0x7f5120008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:30.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.188+0000 7f512a000640 1 -- 172.21.15.163:0/482409340 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f5124079df0 con 0x7f5130071ee0 2024-04-01T17:05:30.541 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.540+0000 7f512a000640 1 -- 172.21.15.163:0/482409340 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5124052020 con 0x7f5130071ee0 2024-04-01T17:05:30.744 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.744+0000 7f5138800640 1 -- 172.21.15.163:0/482409340 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51300726e0 con 0x7f511406c970 2024-04-01T17:05:30.755 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.755+0000 7f512a000640 1 -- 172.21.15.163:0/482409340 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252685 (secure 0 0 0) 0x7f51300726e0 con 0x7f511406c970 2024-04-01T17:05:30.758 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T17:05:30.760 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T17:05:30.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.759+0000 7f5138800640 1 -- 172.21.15.163:0/482409340 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f511406c970 msgr2=0x7f511406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:30.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.759+0000 7f5138800640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f511406c970 0x7f511406ee30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f51301560c0 tx=0x7f5120008040 comp rx=0 tx=0).stop 2024-04-01T17:05:30.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.759+0000 7f5138800640 1 -- 172.21.15.163:0/482409340 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5130071ee0 msgr2=0x7f513014de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:30.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.759+0000 7f5138800640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5130071ee0 0x7f513014de60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5124000c00 tx=0x7f5124004730 comp rx=0 tx=0).stop 2024-04-01T17:05:30.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.760+0000 7f5138800640 1 -- 172.21.15.163:0/482409340 shutdown_connections 2024-04-01T17:05:30.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.760+0000 7f5138800640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f511406c970 0x7f511406ee30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:30.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.760+0000 7f5138800640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5130152830 0x7f513006f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:30.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.760+0000 7f5138800640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f51300c6b30 0x7f5130158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:30.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.760+0000 7f5138800640 1 --2- 172.21.15.163:0/482409340 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5130071ee0 0x7f513014de60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:30.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.760+0000 7f5138800640 1 -- 172.21.15.163:0/482409340 >> 172.21.15.163:0/482409340 conn(0x7f51300cbe20 msgr2=0x7f513014fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:30.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.760+0000 7f5138800640 1 -- 172.21.15.163:0/482409340 shutdown_connections 2024-04-01T17:05:30.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:30.760+0000 7f5138800640 1 -- 172.21.15.163:0/482409340 wait complete. 2024-04-01T17:05:30.781 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":968,"stamp":"2024-04-01T17:05:30.585272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23181253,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":535,"num_read_kb":554,"num_write":8981,"num_write_kb":279196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8111,"ondisk_log_size":8111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":334400,"kb_used_data":47552,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754640320,"statfs":{"total":773094113280,"available":772751687680,"internally_reserved":0,"allocated":48693248,"data_stored":47217626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":293654068},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2046,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004702"},"pg_stats":[{"pgid":"3.3f","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.153864+0000","last_change":"2024-04-01T16:34:34.033508+0000","last_active":"2024-04-01T17:05:23.153864+0000","last_peered":"2024-04-01T17:05:23.153864+0000","last_clean":"2024-04-01T17:05:23.153864+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T17:05:23.153864+0000","last_undegraded":"2024-04-01T17:05:23.153864+0000","last_fullsized":"2024-04-01T17:05:23.153864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'41","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.047351+0000","last_change":"2024-04-01T16:34:34.065375+0000","last_active":"2024-04-01T17:05:23.047351+0000","last_peered":"2024-04-01T17:05:23.047351+0000","last_clean":"2024-04-01T17:05:23.047351+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T17:05:23.047351+0000","last_undegraded":"2024-04-01T17:05:23.047351+0000","last_fullsized":"2024-04-01T17:05:23.047351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":1086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'48","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.306554+0000","last_change":"2024-04-01T16:34:34.084618+0000","last_active":"2024-04-01T17:05:23.306554+0000","last_peered":"2024-04-01T17:05:23.306554+0000","last_clean":"2024-04-01T17:05:23.306554+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T17:05:23.306554+0000","last_undegraded":"2024-04-01T17:05:23.306554+0000","last_fullsized":"2024-04-01T17:05:23.306554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:43.530081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.231935+0000","last_change":"2024-04-01T16:34:34.088694+0000","last_active":"2024-04-01T17:05:23.231935+0000","last_peered":"2024-04-01T17:05:23.231935+0000","last_clean":"2024-04-01T17:05:23.231935+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T17:05:23.231935+0000","last_undegraded":"2024-04-01T17:05:23.231935+0000","last_fullsized":"2024-04-01T17:05:23.231935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.154843+0000","last_change":"2024-04-01T16:34:34.085765+0000","last_active":"2024-04-01T17:05:23.154843+0000","last_peered":"2024-04-01T17:05:23.154843+0000","last_clean":"2024-04-01T17:05:23.154843+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T17:05:23.154843+0000","last_undegraded":"2024-04-01T17:05:23.154843+0000","last_fullsized":"2024-04-01T17:05:23.154843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'60","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.234713+0000","last_change":"2024-04-01T16:34:34.066150+0000","last_active":"2024-04-01T17:05:23.234713+0000","last_peered":"2024-04-01T17:05:23.234713+0000","last_clean":"2024-04-01T17:05:23.234713+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T17:05:23.234713+0000","last_undegraded":"2024-04-01T17:05:23.234713+0000","last_fullsized":"2024-04-01T17:05:23.234713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:08:56.651785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":2601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'34","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.147912+0000","last_change":"2024-04-01T16:34:34.072924+0000","last_active":"2024-04-01T17:05:23.147912+0000","last_peered":"2024-04-01T17:05:23.147912+0000","last_clean":"2024-04-01T17:05:23.147912+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T17:05:23.147912+0000","last_undegraded":"2024-04-01T17:05:23.147912+0000","last_fullsized":"2024-04-01T17:05:23.147912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'42","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.196568+0000","last_change":"2024-04-01T16:34:34.088361+0000","last_active":"2024-04-01T17:05:23.196568+0000","last_peered":"2024-04-01T17:05:23.196568+0000","last_clean":"2024-04-01T17:05:23.196568+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T17:05:23.196568+0000","last_undegraded":"2024-04-01T17:05:23.196568+0000","last_fullsized":"2024-04-01T17:05:23.196568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":1328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'48","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.155956+0000","last_change":"2024-04-01T16:34:34.038534+0000","last_active":"2024-04-01T17:05:23.155956+0000","last_peered":"2024-04-01T17:05:23.155956+0000","last_clean":"2024-04-01T17:05:23.155956+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T17:05:23.155956+0000","last_undegraded":"2024-04-01T17:05:23.155956+0000","last_fullsized":"2024-04-01T17:05:23.155956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:54.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.252389+0000","last_change":"2024-04-01T16:34:34.040513+0000","last_active":"2024-04-01T17:05:23.252389+0000","last_peered":"2024-04-01T17:05:23.252389+0000","last_clean":"2024-04-01T17:05:23.252389+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T17:05:23.252389+0000","last_undegraded":"2024-04-01T17:05:23.252389+0000","last_fullsized":"2024-04-01T17:05:23.252389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'36","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.244142+0000","last_change":"2024-04-01T16:34:34.038167+0000","last_active":"2024-04-01T17:05:23.244142+0000","last_peered":"2024-04-01T17:05:23.244142+0000","last_clean":"2024-04-01T17:05:23.244142+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T17:05:23.244142+0000","last_undegraded":"2024-04-01T17:05:23.244142+0000","last_fullsized":"2024-04-01T17:05:23.244142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'32","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.961219+0000","last_change":"2024-04-01T16:34:34.035177+0000","last_active":"2024-04-01T17:05:22.961219+0000","last_peered":"2024-04-01T17:05:22.961219+0000","last_clean":"2024-04-01T17:05:22.961219+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T17:05:22.961219+0000","last_undegraded":"2024-04-01T17:05:22.961219+0000","last_fullsized":"2024-04-01T17:05:22.961219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:37.711846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'66","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.197419+0000","last_change":"2024-04-01T16:34:34.086031+0000","last_active":"2024-04-01T17:05:23.197419+0000","last_peered":"2024-04-01T17:05:23.197419+0000","last_clean":"2024-04-01T17:05:23.197419+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T17:05:23.197419+0000","last_undegraded":"2024-04-01T17:05:23.197419+0000","last_fullsized":"2024-04-01T17:05:23.197419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'46","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.312882+0000","last_change":"2024-04-01T16:34:34.071535+0000","last_active":"2024-04-01T17:05:23.312882+0000","last_peered":"2024-04-01T17:05:23.312882+0000","last_clean":"2024-04-01T17:05:23.312882+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T17:05:23.312882+0000","last_undegraded":"2024-04-01T17:05:23.312882+0000","last_fullsized":"2024-04-01T17:05:23.312882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:45.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'45","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.053260+0000","last_change":"2024-04-01T16:34:33.904701+0000","last_active":"2024-04-01T17:05:23.053260+0000","last_peered":"2024-04-01T17:05:23.053260+0000","last_clean":"2024-04-01T17:05:23.053260+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T17:05:23.053260+0000","last_undegraded":"2024-04-01T17:05:23.053260+0000","last_fullsized":"2024-04-01T17:05:23.053260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":3152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'51","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.231758+0000","last_change":"2024-04-01T16:34:34.064695+0000","last_active":"2024-04-01T17:05:23.231758+0000","last_peered":"2024-04-01T17:05:23.231758+0000","last_clean":"2024-04-01T17:05:23.231758+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T17:05:23.231758+0000","last_undegraded":"2024-04-01T17:05:23.231758+0000","last_fullsized":"2024-04-01T17:05:23.231758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.798148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'54","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.234026+0000","last_change":"2024-04-01T16:34:34.032994+0000","last_active":"2024-04-01T17:05:23.234026+0000","last_peered":"2024-04-01T17:05:23.234026+0000","last_clean":"2024-04-01T17:05:23.234026+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T17:05:23.234026+0000","last_undegraded":"2024-04-01T17:05:23.234026+0000","last_fullsized":"2024-04-01T17:05:23.234026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":6831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'56","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.047424+0000","last_change":"2024-04-01T16:34:34.082238+0000","last_active":"2024-04-01T17:05:23.047424+0000","last_peered":"2024-04-01T17:05:23.047424+0000","last_clean":"2024-04-01T17:05:23.047424+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T17:05:23.047424+0000","last_undegraded":"2024-04-01T17:05:23.047424+0000","last_fullsized":"2024-04-01T17:05:23.047424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.147694+0000","last_change":"2024-04-01T16:34:34.083056+0000","last_active":"2024-04-01T17:05:23.147694+0000","last_peered":"2024-04-01T17:05:23.147694+0000","last_clean":"2024-04-01T17:05:23.147694+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T17:05:23.147694+0000","last_undegraded":"2024-04-01T17:05:23.147694+0000","last_fullsized":"2024-04-01T17:05:23.147694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"27'66","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.248285+0000","last_change":"2024-04-01T16:34:34.034017+0000","last_active":"2024-04-01T17:05:23.248285+0000","last_peered":"2024-04-01T17:05:23.248285+0000","last_clean":"2024-04-01T17:05:23.248285+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T17:05:23.248285+0000","last_undegraded":"2024-04-01T17:05:23.248285+0000","last_fullsized":"2024-04-01T17:05:23.248285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:33.976417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"27'53","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.303894+0000","last_change":"2024-04-01T16:34:34.068541+0000","last_active":"2024-04-01T17:05:23.303894+0000","last_peered":"2024-04-01T17:05:23.303894+0000","last_clean":"2024-04-01T17:05:23.303894+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T17:05:23.303894+0000","last_undegraded":"2024-04-01T17:05:23.303894+0000","last_fullsized":"2024-04-01T17:05:23.303894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:29.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"27'41","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.234841+0000","last_change":"2024-04-01T16:34:34.031774+0000","last_active":"2024-04-01T17:05:23.234841+0000","last_peered":"2024-04-01T17:05:23.234841+0000","last_clean":"2024-04-01T17:05:23.234841+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T17:05:23.234841+0000","last_undegraded":"2024-04-01T17:05:23.234841+0000","last_fullsized":"2024-04-01T17:05:23.234841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:39.294525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'56","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.193241+0000","last_change":"2024-04-01T16:34:34.090324+0000","last_active":"2024-04-01T17:05:23.193241+0000","last_peered":"2024-04-01T17:05:23.193241+0000","last_clean":"2024-04-01T17:05:23.193241+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T17:05:23.193241+0000","last_undegraded":"2024-04-01T17:05:23.193241+0000","last_fullsized":"2024-04-01T17:05:23.193241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:55:40.168021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":6379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'42","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.231684+0000","last_change":"2024-04-01T16:34:34.083544+0000","last_active":"2024-04-01T17:05:23.231684+0000","last_peered":"2024-04-01T17:05:23.231684+0000","last_clean":"2024-04-01T17:05:23.231684+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T17:05:23.231684+0000","last_undegraded":"2024-04-01T17:05:23.231684+0000","last_fullsized":"2024-04-01T17:05:23.231684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.185570+0000","last_change":"2024-04-01T16:34:34.090721+0000","last_active":"2024-04-01T17:05:23.185570+0000","last_peered":"2024-04-01T17:05:23.185570+0000","last_clean":"2024-04-01T17:05:23.185570+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T17:05:23.185570+0000","last_undegraded":"2024-04-01T17:05:23.185570+0000","last_fullsized":"2024-04-01T17:05:23.185570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"27'56","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.252181+0000","last_change":"2024-04-01T16:34:54.510600+0000","last_active":"2024-04-01T17:05:23.252181+0000","last_peered":"2024-04-01T17:05:23.252181+0000","last_clean":"2024-04-01T17:05:23.252181+0000","last_became_active":"2024-04-01T16:34:54.510173+0000","last_became_peered":"2024-04-01T16:34:54.510173+0000","last_unstale":"2024-04-01T17:05:23.252181+0000","last_undegraded":"2024-04-01T17:05:23.252181+0000","last_fullsized":"2024-04-01T17:05:23.252181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.100547+0000","last_change":"2024-04-01T16:34:34.091911+0000","last_active":"2024-04-01T17:05:23.100547+0000","last_peered":"2024-04-01T17:05:23.100547+0000","last_clean":"2024-04-01T17:05:23.100547+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T17:05:23.100547+0000","last_undegraded":"2024-04-01T17:05:23.100547+0000","last_fullsized":"2024-04-01T17:05:23.100547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"27'25","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.197490+0000","last_change":"2024-04-01T16:34:34.091540+0000","last_active":"2024-04-01T17:05:23.197490+0000","last_peered":"2024-04-01T17:05:23.197490+0000","last_clean":"2024-04-01T17:05:23.197490+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T17:05:23.197490+0000","last_undegraded":"2024-04-01T17:05:23.197490+0000","last_fullsized":"2024-04-01T17:05:23.197490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.242571+0000","last_change":"2024-04-01T16:34:34.087634+0000","last_active":"2024-04-01T17:05:23.242571+0000","last_peered":"2024-04-01T17:05:23.242571+0000","last_clean":"2024-04-01T17:05:23.242571+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T17:05:23.242571+0000","last_undegraded":"2024-04-01T17:05:23.242571+0000","last_fullsized":"2024-04-01T17:05:23.242571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:12.994756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"27'56","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.230780+0000","last_change":"2024-04-01T16:34:34.084026+0000","last_active":"2024-04-01T17:05:23.230780+0000","last_peered":"2024-04-01T17:05:23.230780+0000","last_clean":"2024-04-01T17:05:23.230780+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T17:05:23.230780+0000","last_undegraded":"2024-04-01T17:05:23.230780+0000","last_fullsized":"2024-04-01T17:05:23.230780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"27'46","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.039983+0000","last_change":"2024-04-01T16:34:34.088300+0000","last_active":"2024-04-01T17:05:23.039983+0000","last_peered":"2024-04-01T17:05:23.039983+0000","last_clean":"2024-04-01T17:05:23.039983+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T17:05:23.039983+0000","last_undegraded":"2024-04-01T17:05:23.039983+0000","last_fullsized":"2024-04-01T17:05:23.039983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"27'56","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.248072+0000","last_change":"2024-04-01T16:34:34.068348+0000","last_active":"2024-04-01T17:05:23.248072+0000","last_peered":"2024-04-01T17:05:23.248072+0000","last_clean":"2024-04-01T17:05:23.248072+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T17:05:23.248072+0000","last_undegraded":"2024-04-01T17:05:23.248072+0000","last_fullsized":"2024-04-01T17:05:23.248072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":5837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"27'29","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.953396+0000","last_change":"2024-04-01T16:34:33.901019+0000","last_active":"2024-04-01T17:05:22.953396+0000","last_peered":"2024-04-01T17:05:22.953396+0000","last_clean":"2024-04-01T17:05:22.953396+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T17:05:22.953396+0000","last_undegraded":"2024-04-01T17:05:22.953396+0000","last_fullsized":"2024-04-01T17:05:22.953396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:08:37.254438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'509","reported_seq":546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:50.054268+0000","last_change":"2024-04-01T16:34:31.489434+0000","last_active":"2024-04-01T17:04:50.054268+0000","last_peered":"2024-04-01T17:04:50.054268+0000","last_clean":"2024-04-01T17:04:50.054268+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T17:04:50.054268+0000","last_undegraded":"2024-04-01T17:04:50.054268+0000","last_fullsized":"2024-04-01T17:04:50.054268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'34","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.304501+0000","last_change":"2024-04-01T16:34:34.065342+0000","last_active":"2024-04-01T17:05:23.304501+0000","last_peered":"2024-04-01T17:05:23.304501+0000","last_clean":"2024-04-01T17:05:23.304501+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T17:05:23.304501+0000","last_undegraded":"2024-04-01T17:05:23.304501+0000","last_fullsized":"2024-04-01T17:05:23.304501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:56.911106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"27'432","reported_seq":469,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:50.048564+0000","last_change":"2024-04-01T16:34:31.530201+0000","last_active":"2024-04-01T17:04:50.048564+0000","last_peered":"2024-04-01T17:04:50.048564+0000","last_clean":"2024-04-01T17:04:50.048564+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T17:04:50.048564+0000","last_undegraded":"2024-04-01T17:04:50.048564+0000","last_fullsized":"2024-04-01T17:04:50.048564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.160707+0000","last_change":"2024-04-01T16:34:31.528238+0000","last_active":"2024-04-01T17:04:55.160707+0000","last_peered":"2024-04-01T17:04:55.160707+0000","last_clean":"2024-04-01T17:04:55.160707+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T17:04:55.160707+0000","last_undegraded":"2024-04-01T17:04:55.160707+0000","last_fullsized":"2024-04-01T17:04:55.160707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'57","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.193288+0000","last_change":"2024-04-01T16:34:34.091302+0000","last_active":"2024-04-01T17:05:23.193288+0000","last_peered":"2024-04-01T17:05:23.193288+0000","last_clean":"2024-04-01T17:05:23.193288+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T17:05:23.193288+0000","last_undegraded":"2024-04-01T17:05:23.193288+0000","last_fullsized":"2024-04-01T17:05:23.193288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":3573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:50.021371+0000","last_change":"2024-04-01T16:34:31.567946+0000","last_active":"2024-04-01T17:04:50.021371+0000","last_peered":"2024-04-01T17:04:50.021371+0000","last_clean":"2024-04-01T17:04:50.021371+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T17:04:50.021371+0000","last_undegraded":"2024-04-01T17:04:50.021371+0000","last_fullsized":"2024-04-01T17:04:50.021371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'43","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.108678+0000","last_change":"2024-04-01T16:34:34.088894+0000","last_active":"2024-04-01T17:05:23.108678+0000","last_peered":"2024-04-01T17:05:23.108678+0000","last_clean":"2024-04-01T17:05:23.108678+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T17:05:23.108678+0000","last_undegraded":"2024-04-01T17:05:23.108678+0000","last_fullsized":"2024-04-01T17:05:23.108678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:20.052132+0000","last_change":"2024-04-01T16:34:31.566997+0000","last_active":"2024-04-01T17:04:20.052132+0000","last_peered":"2024-04-01T17:04:20.052132+0000","last_clean":"2024-04-01T17:04:20.052132+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T17:04:20.052132+0000","last_undegraded":"2024-04-01T17:04:20.052132+0000","last_fullsized":"2024-04-01T17:04:20.052132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'70","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.229858+0000","last_change":"2024-04-01T16:34:34.030831+0000","last_active":"2024-04-01T17:05:23.229858+0000","last_peered":"2024-04-01T17:05:23.229858+0000","last_clean":"2024-04-01T17:05:23.229858+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T17:05:23.229858+0000","last_undegraded":"2024-04-01T17:05:23.229858+0000","last_fullsized":"2024-04-01T17:05:23.229858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:36.765896+0000","last_change":"2024-04-01T16:34:31.569927+0000","last_active":"2024-04-01T17:04:36.765896+0000","last_peered":"2024-04-01T17:04:36.765896+0000","last_clean":"2024-04-01T17:04:36.765896+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T17:04:36.765896+0000","last_undegraded":"2024-04-01T17:04:36.765896+0000","last_fullsized":"2024-04-01T17:04:36.765896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:41.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'48","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.240843+0000","last_change":"2024-04-01T16:34:34.068959+0000","last_active":"2024-04-01T17:05:23.240843+0000","last_peered":"2024-04-01T17:05:23.240843+0000","last_clean":"2024-04-01T17:05:23.240843+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T17:05:23.240843+0000","last_undegraded":"2024-04-01T17:05:23.240843+0000","last_fullsized":"2024-04-01T17:05:23.240843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:58:57.685708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"27'309","reported_seq":346,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:14.920828+0000","last_change":"2024-04-01T16:34:31.562792+0000","last_active":"2024-04-01T17:05:14.920828+0000","last_peered":"2024-04-01T17:05:14.920828+0000","last_clean":"2024-04-01T17:05:14.920828+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T17:05:14.920828+0000","last_undegraded":"2024-04-01T17:05:14.920828+0000","last_fullsized":"2024-04-01T17:05:14.920828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:55.684911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'53","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.962968+0000","last_change":"2024-04-01T16:34:33.916652+0000","last_active":"2024-04-01T17:05:22.962968+0000","last_peered":"2024-04-01T17:05:22.962968+0000","last_clean":"2024-04-01T17:05:22.962968+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T17:05:22.962968+0000","last_undegraded":"2024-04-01T17:05:22.962968+0000","last_fullsized":"2024-04-01T17:05:22.962968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":3009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"27'798","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.806557+0000","last_change":"2024-04-01T16:34:31.531366+0000","last_active":"2024-04-01T17:05:06.806557+0000","last_peered":"2024-04-01T17:05:06.806557+0000","last_clean":"2024-04-01T17:05:06.806557+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T17:05:06.806557+0000","last_undegraded":"2024-04-01T17:05:06.806557+0000","last_fullsized":"2024-04-01T17:05:06.806557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'42","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.147953+0000","last_change":"2024-04-01T16:34:34.085449+0000","last_active":"2024-04-01T17:05:23.147953+0000","last_peered":"2024-04-01T17:05:23.147953+0000","last_clean":"2024-04-01T17:05:23.147953+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T17:05:23.147953+0000","last_undegraded":"2024-04-01T17:05:23.147953+0000","last_fullsized":"2024-04-01T17:05:23.147953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.756876+0000","last_change":"2024-04-01T16:34:31.444458+0000","last_active":"2024-04-01T17:05:06.756876+0000","last_peered":"2024-04-01T17:05:06.756876+0000","last_clean":"2024-04-01T17:05:06.756876+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T17:05:06.756876+0000","last_undegraded":"2024-04-01T17:05:06.756876+0000","last_fullsized":"2024-04-01T17:05:06.756876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'50","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.304146+0000","last_change":"2024-04-01T16:34:34.071521+0000","last_active":"2024-04-01T17:05:23.304146+0000","last_peered":"2024-04-01T17:05:23.304146+0000","last_clean":"2024-04-01T17:05:23.304146+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T17:05:23.304146+0000","last_undegraded":"2024-04-01T17:05:23.304146+0000","last_fullsized":"2024-04-01T17:05:23.304146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:36:13.618956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:12.982073+0000","last_change":"2024-04-01T16:34:31.566202+0000","last_active":"2024-04-01T17:05:12.982073+0000","last_peered":"2024-04-01T17:05:12.982073+0000","last_clean":"2024-04-01T17:05:12.982073+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T17:05:12.982073+0000","last_undegraded":"2024-04-01T17:05:12.982073+0000","last_fullsized":"2024-04-01T17:05:12.982073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:54.543283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'72","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.182012+0000","last_change":"2024-04-01T16:34:33.930561+0000","last_active":"2024-04-01T17:05:23.182012+0000","last_peered":"2024-04-01T17:05:23.182012+0000","last_clean":"2024-04-01T17:05:23.182012+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T17:05:23.182012+0000","last_undegraded":"2024-04-01T17:05:23.182012+0000","last_fullsized":"2024-04-01T17:05:23.182012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":8452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:43.856695+0000","last_change":"2024-04-01T16:34:31.535895+0000","last_active":"2024-04-01T17:04:43.856695+0000","last_peered":"2024-04-01T17:04:43.856695+0000","last_clean":"2024-04-01T17:04:43.856695+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T17:04:43.856695+0000","last_undegraded":"2024-04-01T17:04:43.856695+0000","last_fullsized":"2024-04-01T17:04:43.856695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:36:43.780845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'37","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.245430+0000","last_change":"2024-04-01T16:34:34.068194+0000","last_active":"2024-04-01T17:05:23.245430+0000","last_peered":"2024-04-01T17:05:23.245430+0000","last_clean":"2024-04-01T17:05:23.245430+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T17:05:23.245430+0000","last_undegraded":"2024-04-01T17:05:23.245430+0000","last_fullsized":"2024-04-01T17:05:23.245430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:11.860033+0000","last_change":"2024-04-01T16:34:31.515495+0000","last_active":"2024-04-01T17:05:11.860033+0000","last_peered":"2024-04-01T17:05:11.860033+0000","last_clean":"2024-04-01T17:05:11.860033+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T17:05:11.860033+0000","last_undegraded":"2024-04-01T17:05:11.860033+0000","last_fullsized":"2024-04-01T17:05:11.860033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:26:56.217819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.149246+0000","last_change":"2024-04-01T16:34:33.926318+0000","last_active":"2024-04-01T17:05:23.149246+0000","last_peered":"2024-04-01T17:05:23.149246+0000","last_clean":"2024-04-01T17:05:23.149246+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T17:05:23.149246+0000","last_undegraded":"2024-04-01T17:05:23.149246+0000","last_fullsized":"2024-04-01T17:05:23.149246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:43.876931+0000","last_change":"2024-04-01T16:34:31.440349+0000","last_active":"2024-04-01T17:04:43.876931+0000","last_peered":"2024-04-01T17:04:43.876931+0000","last_clean":"2024-04-01T17:04:43.876931+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T17:04:43.876931+0000","last_undegraded":"2024-04-01T17:04:43.876931+0000","last_fullsized":"2024-04-01T17:04:43.876931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:29.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'29","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.146008+0000","last_change":"2024-04-01T16:34:33.931211+0000","last_active":"2024-04-01T17:05:23.146008+0000","last_peered":"2024-04-01T17:05:23.146008+0000","last_clean":"2024-04-01T17:05:23.146008+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T17:05:23.146008+0000","last_undegraded":"2024-04-01T17:05:23.146008+0000","last_fullsized":"2024-04-01T17:05:23.146008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:15:45.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:03:46.712894+0000","last_change":"2024-04-01T16:34:31.512433+0000","last_active":"2024-04-01T17:03:46.712894+0000","last_peered":"2024-04-01T17:03:46.712894+0000","last_clean":"2024-04-01T17:03:46.712894+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T17:03:46.712894+0000","last_undegraded":"2024-04-01T17:03:46.712894+0000","last_fullsized":"2024-04-01T17:03:46.712894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:16.032012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'39","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.155875+0000","last_change":"2024-04-01T16:34:33.930791+0000","last_active":"2024-04-01T17:05:23.155875+0000","last_peered":"2024-04-01T17:05:23.155875+0000","last_clean":"2024-04-01T17:05:23.155875+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T17:05:23.155875+0000","last_undegraded":"2024-04-01T17:05:23.155875+0000","last_fullsized":"2024-04-01T17:05:23.155875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:53.102054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.177195+0000","last_change":"2024-04-01T16:34:31.509375+0000","last_active":"2024-04-01T17:04:55.177195+0000","last_peered":"2024-04-01T17:04:55.177195+0000","last_clean":"2024-04-01T17:04:55.177195+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T17:04:55.177195+0000","last_undegraded":"2024-04-01T17:04:55.177195+0000","last_fullsized":"2024-04-01T17:04:55.177195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'50","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.230734+0000","last_change":"2024-04-01T16:34:34.085219+0000","last_active":"2024-04-01T17:05:23.230734+0000","last_peered":"2024-04-01T17:05:23.230734+0000","last_clean":"2024-04-01T17:05:23.230734+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T17:05:23.230734+0000","last_undegraded":"2024-04-01T17:05:23.230734+0000","last_fullsized":"2024-04-01T17:05:23.230734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"27'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:03:46.712863+0000","last_change":"2024-04-01T16:34:31.562761+0000","last_active":"2024-04-01T17:03:46.712863+0000","last_peered":"2024-04-01T17:03:46.712863+0000","last_clean":"2024-04-01T17:03:46.712863+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T17:03:46.712863+0000","last_undegraded":"2024-04-01T17:03:46.712863+0000","last_fullsized":"2024-04-01T17:03:46.712863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:23:33.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'41","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.148743+0000","last_change":"2024-04-01T16:34:34.039521+0000","last_active":"2024-04-01T17:05:23.148743+0000","last_peered":"2024-04-01T17:05:23.148743+0000","last_clean":"2024-04-01T17:05:23.148743+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T17:05:23.148743+0000","last_undegraded":"2024-04-01T17:05:23.148743+0000","last_fullsized":"2024-04-01T17:05:23.148743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":4631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:02:11.703709+0000","last_change":"2024-04-01T16:34:08.195697+0000","last_active":"2024-04-01T17:02:11.703709+0000","last_peered":"2024-04-01T17:02:11.703709+0000","last_clean":"2024-04-01T17:02:11.703709+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T17:02:11.703709+0000","last_undegraded":"2024-04-01T17:02:11.703709+0000","last_fullsized":"2024-04-01T17:02:11.703709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_clean_scrub_stamp":"2024-04-01T16:34:06.247737+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:05:51.067541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.810588+0000","last_change":"2024-04-01T16:34:31.569697+0000","last_active":"2024-04-01T17:05:06.810588+0000","last_peered":"2024-04-01T17:05:06.810588+0000","last_clean":"2024-04-01T17:05:06.810588+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T17:05:06.810588+0000","last_undegraded":"2024-04-01T17:05:06.810588+0000","last_fullsized":"2024-04-01T17:05:06.810588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.736852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.192829+0000","last_change":"2024-04-01T16:34:34.087298+0000","last_active":"2024-04-01T17:05:23.192829+0000","last_peered":"2024-04-01T17:05:23.192829+0000","last_clean":"2024-04-01T17:05:23.192829+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T17:05:23.192829+0000","last_undegraded":"2024-04-01T17:05:23.192829+0000","last_fullsized":"2024-04-01T17:05:23.192829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:36.417042+0000","last_change":"2024-04-01T16:34:31.509150+0000","last_active":"2024-04-01T17:04:36.417042+0000","last_peered":"2024-04-01T17:04:36.417042+0000","last_clean":"2024-04-01T17:04:36.417042+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T17:04:36.417042+0000","last_undegraded":"2024-04-01T17:04:36.417042+0000","last_fullsized":"2024-04-01T17:04:36.417042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'25","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.312341+0000","last_change":"2024-04-01T16:34:34.068444+0000","last_active":"2024-04-01T17:05:23.312341+0000","last_peered":"2024-04-01T17:05:23.312341+0000","last_clean":"2024-04-01T17:05:23.312341+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T17:05:23.312341+0000","last_undegraded":"2024-04-01T17:05:23.312341+0000","last_fullsized":"2024-04-01T17:05:23.312341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:04.104676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"27'432","reported_seq":890,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:15.893893+0000","last_change":"2024-04-01T16:34:31.512295+0000","last_active":"2024-04-01T17:05:15.893893+0000","last_peered":"2024-04-01T17:05:15.893893+0000","last_clean":"2024-04-01T17:05:15.893893+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T17:05:15.893893+0000","last_undegraded":"2024-04-01T17:05:15.893893+0000","last_fullsized":"2024-04-01T17:05:15.893893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:35.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110595,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":419,"num_read_kb":454,"num_write":427,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'53","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.051145+0000","last_change":"2024-04-01T16:34:34.083194+0000","last_active":"2024-04-01T17:05:23.051145+0000","last_peered":"2024-04-01T17:05:23.051145+0000","last_clean":"2024-04-01T17:05:23.051145+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T17:05:23.051145+0000","last_undegraded":"2024-04-01T17:05:23.051145+0000","last_fullsized":"2024-04-01T17:05:23.051145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:43.692930+0000","last_change":"2024-04-01T16:34:31.569571+0000","last_active":"2024-04-01T17:04:43.692930+0000","last_peered":"2024-04-01T17:04:43.692930+0000","last_clean":"2024-04-01T17:04:43.692930+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T17:04:43.692930+0000","last_undegraded":"2024-04-01T17:04:43.692930+0000","last_fullsized":"2024-04-01T17:04:43.692930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:10.626933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'26","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.958089+0000","last_change":"2024-04-01T16:34:34.063200+0000","last_active":"2024-04-01T17:05:22.958089+0000","last_peered":"2024-04-01T17:05:22.958089+0000","last_clean":"2024-04-01T17:05:22.958089+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T17:05:22.958089+0000","last_undegraded":"2024-04-01T17:05:22.958089+0000","last_fullsized":"2024-04-01T17:05:22.958089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:18.399835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":2569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.819009+0000","last_change":"2024-04-01T16:34:31.512508+0000","last_active":"2024-04-01T17:05:06.819009+0000","last_peered":"2024-04-01T17:05:06.819009+0000","last_clean":"2024-04-01T17:05:06.819009+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T17:05:06.819009+0000","last_undegraded":"2024-04-01T17:05:06.819009+0000","last_fullsized":"2024-04-01T17:05:06.819009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'34","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.042783+0000","last_change":"2024-04-01T16:34:54.510347+0000","last_active":"2024-04-01T17:05:23.042783+0000","last_peered":"2024-04-01T17:05:23.042783+0000","last_clean":"2024-04-01T17:05:23.042783+0000","last_became_active":"2024-04-01T16:34:54.509976+0000","last_became_peered":"2024-04-01T16:34:54.509976+0000","last_unstale":"2024-04-01T17:05:23.042783+0000","last_undegraded":"2024-04-01T17:05:23.042783+0000","last_fullsized":"2024-04-01T17:05:23.042783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:41:48.631612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:01.205221+0000","last_change":"2024-04-01T16:34:31.426647+0000","last_active":"2024-04-01T17:05:01.205221+0000","last_peered":"2024-04-01T17:05:01.205221+0000","last_clean":"2024-04-01T17:05:01.205221+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T17:05:01.205221+0000","last_undegraded":"2024-04-01T17:05:01.205221+0000","last_fullsized":"2024-04-01T17:05:01.205221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:36.926701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.053284+0000","last_change":"2024-04-01T16:34:34.087431+0000","last_active":"2024-04-01T17:05:23.053284+0000","last_peered":"2024-04-01T17:05:23.053284+0000","last_clean":"2024-04-01T17:05:23.053284+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T17:05:23.053284+0000","last_undegraded":"2024-04-01T17:05:23.053284+0000","last_fullsized":"2024-04-01T17:05:23.053284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"27'1149","reported_seq":1188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:13.942307+0000","last_change":"2024-04-01T16:34:31.528790+0000","last_active":"2024-04-01T17:05:13.942307+0000","last_peered":"2024-04-01T17:05:13.942307+0000","last_clean":"2024-04-01T17:05:13.942307+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T17:05:13.942307+0000","last_undegraded":"2024-04-01T17:05:13.942307+0000","last_fullsized":"2024-04-01T17:05:13.942307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1149,"log_dups_size":0,"ondisk_log_size":1149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2752,"num_write_kb":935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.196350+0000","last_change":"2024-04-01T16:34:34.085832+0000","last_active":"2024-04-01T17:05:23.196350+0000","last_peered":"2024-04-01T17:05:23.196350+0000","last_clean":"2024-04-01T17:05:23.196350+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T17:05:23.196350+0000","last_undegraded":"2024-04-01T17:05:23.196350+0000","last_fullsized":"2024-04-01T17:05:23.196350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:00.278120+0000","last_change":"2024-04-01T16:34:31.534057+0000","last_active":"2024-04-01T17:05:00.278120+0000","last_peered":"2024-04-01T17:05:00.278120+0000","last_clean":"2024-04-01T17:05:00.278120+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T17:05:00.278120+0000","last_undegraded":"2024-04-01T17:05:00.278120+0000","last_fullsized":"2024-04-01T17:05:00.278120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'56","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.243128+0000","last_change":"2024-04-01T16:34:34.073261+0000","last_active":"2024-04-01T17:05:23.243128+0000","last_peered":"2024-04-01T17:05:23.243128+0000","last_clean":"2024-04-01T17:05:23.243128+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T17:05:23.243128+0000","last_undegraded":"2024-04-01T17:05:23.243128+0000","last_fullsized":"2024-04-01T17:05:23.243128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:38.619969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":6288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:00.296785+0000","last_change":"2024-04-01T16:34:31.423531+0000","last_active":"2024-04-01T17:05:00.296785+0000","last_peered":"2024-04-01T17:05:00.296785+0000","last_clean":"2024-04-01T17:05:00.296785+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T17:05:00.296785+0000","last_undegraded":"2024-04-01T17:05:00.296785+0000","last_fullsized":"2024-04-01T17:05:00.296785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'38","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.472817+0000","last_change":"2024-04-01T16:34:34.086029+0000","last_active":"2024-04-01T17:04:55.472817+0000","last_peered":"2024-04-01T17:04:55.472817+0000","last_clean":"2024-04-01T17:04:55.472817+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T17:04:55.472817+0000","last_undegraded":"2024-04-01T17:04:55.472817+0000","last_fullsized":"2024-04-01T17:04:55.472817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:53.554803+0000","last_change":"2024-04-01T16:34:31.509351+0000","last_active":"2024-04-01T17:04:53.554803+0000","last_peered":"2024-04-01T17:04:53.554803+0000","last_clean":"2024-04-01T17:04:53.554803+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T17:04:53.554803+0000","last_undegraded":"2024-04-01T17:04:53.554803+0000","last_fullsized":"2024-04-01T17:04:53.554803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'43","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.192179+0000","last_change":"2024-04-01T16:34:34.091932+0000","last_active":"2024-04-01T17:05:23.192179+0000","last_peered":"2024-04-01T17:05:23.192179+0000","last_clean":"2024-04-01T17:05:23.192179+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T17:05:23.192179+0000","last_undegraded":"2024-04-01T17:05:23.192179+0000","last_fullsized":"2024-04-01T17:05:23.192179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:11:00.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.177952+0000","last_change":"2024-04-01T16:34:31.517513+0000","last_active":"2024-04-01T17:04:55.177952+0000","last_peered":"2024-04-01T17:04:55.177952+0000","last_clean":"2024-04-01T17:04:55.177952+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T17:04:55.177952+0000","last_undegraded":"2024-04-01T17:04:55.177952+0000","last_fullsized":"2024-04-01T17:04:55.177952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:31.608594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'58","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.051569+0000","last_change":"2024-04-01T16:34:55.004709+0000","last_active":"2024-04-01T17:05:23.051569+0000","last_peered":"2024-04-01T17:05:23.051569+0000","last_clean":"2024-04-01T17:05:23.051569+0000","last_became_active":"2024-04-01T16:34:55.003987+0000","last_became_peered":"2024-04-01T16:34:55.003987+0000","last_unstale":"2024-04-01T17:05:23.051569+0000","last_undegraded":"2024-04-01T17:05:23.051569+0000","last_fullsized":"2024-04-01T17:05:23.051569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"27'622","reported_seq":660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:20.069789+0000","last_change":"2024-04-01T16:34:31.444603+0000","last_active":"2024-04-01T17:04:20.069789+0000","last_peered":"2024-04-01T17:04:20.069789+0000","last_clean":"2024-04-01T17:04:20.069789+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T17:04:20.069789+0000","last_undegraded":"2024-04-01T17:04:20.069789+0000","last_fullsized":"2024-04-01T17:04:20.069789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.245866+0000","last_change":"2024-04-01T16:34:34.034061+0000","last_active":"2024-04-01T17:05:23.245866+0000","last_peered":"2024-04-01T17:05:23.245866+0000","last_clean":"2024-04-01T17:05:23.245866+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T17:05:23.245866+0000","last_undegraded":"2024-04-01T17:05:23.245866+0000","last_fullsized":"2024-04-01T17:05:23.245866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"27'54","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.047264+0000","last_change":"2024-04-01T16:34:55.011962+0000","last_active":"2024-04-01T17:05:23.047264+0000","last_peered":"2024-04-01T17:05:23.047264+0000","last_clean":"2024-04-01T17:05:23.047264+0000","last_became_active":"2024-04-01T16:34:55.011400+0000","last_became_peered":"2024-04-01T16:34:55.011400+0000","last_unstale":"2024-04-01T17:05:23.047264+0000","last_undegraded":"2024-04-01T17:05:23.047264+0000","last_fullsized":"2024-04-01T17:05:23.047264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:14:52.381836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":3157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:49.977812+0000","last_change":"2024-04-01T16:34:31.563882+0000","last_active":"2024-04-01T17:04:49.977812+0000","last_peered":"2024-04-01T17:04:49.977812+0000","last_clean":"2024-04-01T17:04:49.977812+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T17:04:49.977812+0000","last_undegraded":"2024-04-01T17:04:49.977812+0000","last_fullsized":"2024-04-01T17:04:49.977812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:27.209535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'35","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.233213+0000","last_change":"2024-04-01T16:34:34.034904+0000","last_active":"2024-04-01T17:05:23.233213+0000","last_peered":"2024-04-01T17:05:23.233213+0000","last_clean":"2024-04-01T17:05:23.233213+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T17:05:23.233213+0000","last_undegraded":"2024-04-01T17:05:23.233213+0000","last_fullsized":"2024-04-01T17:05:23.233213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:00.297118+0000","last_change":"2024-04-01T16:34:31.530246+0000","last_active":"2024-04-01T17:05:00.297118+0000","last_peered":"2024-04-01T17:05:00.297118+0000","last_clean":"2024-04-01T17:05:00.297118+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T17:05:00.297118+0000","last_undegraded":"2024-04-01T17:05:00.297118+0000","last_fullsized":"2024-04-01T17:05:00.297118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:48.430325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"27'50","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.312112+0000","last_change":"2024-04-01T16:34:34.066381+0000","last_active":"2024-04-01T17:05:23.312112+0000","last_peered":"2024-04-01T17:05:23.312112+0000","last_clean":"2024-04-01T17:05:23.312112+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T17:05:23.312112+0000","last_undegraded":"2024-04-01T17:05:23.312112+0000","last_fullsized":"2024-04-01T17:05:23.312112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:10.824493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":6181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"27'145","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.699552+0000","last_change":"2024-04-01T16:34:31.490535+0000","last_active":"2024-04-01T17:05:22.699552+0000","last_peered":"2024-04-01T17:05:22.699552+0000","last_clean":"2024-04-01T17:05:22.699552+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T17:05:22.699552+0000","last_undegraded":"2024-04-01T17:05:22.699552+0000","last_fullsized":"2024-04-01T17:05:22.699552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:24.709969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507300,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.184093+0000","last_change":"2024-04-01T16:34:34.087097+0000","last_active":"2024-04-01T17:05:23.184093+0000","last_peered":"2024-04-01T17:05:23.184093+0000","last_clean":"2024-04-01T17:05:23.184093+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T17:05:23.184093+0000","last_undegraded":"2024-04-01T17:05:23.184093+0000","last_fullsized":"2024-04-01T17:05:23.184093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:17:48.287828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'621","reported_seq":660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:03:41.727213+0000","last_change":"2024-04-01T16:34:31.420599+0000","last_active":"2024-04-01T17:03:41.727213+0000","last_peered":"2024-04-01T17:03:41.727213+0000","last_clean":"2024-04-01T17:03:41.727213+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T17:03:41.727213+0000","last_undegraded":"2024-04-01T17:03:41.727213+0000","last_fullsized":"2024-04-01T17:03:41.727213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2204,"num_write_kb":251439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2871,"ondisk_log_size":2871,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22590885,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":419,"num_read_kb":454,"num_write":6618,"num_write_kb":25341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45244416,"data_stored":45181770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5123,"ondisk_log_size":5123,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509820,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52644,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319196,"statfs":{"total":96636764160,"available":96582856704,"internally_reserved":0,"allocated":13463552,"data_stored":13280752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509822,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":217485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509818,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41772,"kb_used_data":6436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330068,"statfs":{"total":96636764160,"available":96593989632,"internally_reserved":0,"allocated":6590464,"data_stored":6399500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509820,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":106980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509821,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43816,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328024,"statfs":{"total":96636764160,"available":96591896576,"internally_reserved":0,"allocated":8683520,"data_stored":8495624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542525,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47972,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323868,"statfs":{"total":96636764160,"available":96587640832,"internally_reserved":0,"allocated":8679424,"data_stored":8496170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542523,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49556,"kb_used_data":10060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322284,"statfs":{"total":96636764160,"available":96586018816,"internally_reserved":0,"allocated":10301440,"data_stored":10114065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542526,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35620,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336220,"statfs":{"total":96636764160,"available":96600289280,"internally_reserved":0,"allocated":290816,"data_stored":107050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5713920,"data_stored":5702242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":110595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10018816,"data_stored":10007175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8389280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T17:05:30.785 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-01T17:05:30.785 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T17:05:31.026 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.025+0000 7fef24000640 1 Processor -- start 2024-04-01T17:05:31.026 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.025+0000 7fef24000640 1 -- start start 2024-04-01T17:05:31.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.027+0000 7fef24000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fef1c070070 0x7fef1c15ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:31.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.027+0000 7fef24000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c15dc50 con 0x7fef1c154b30 2024-04-01T17:05:31.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.027+0000 7fef24000640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c0c3480 con 0x7fef1c15b380 2024-04-01T17:05:31.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.027+0000 7fef24000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fef1c15a660 con 0x7fef1c070070 2024-04-01T17:05:31.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.074+0000 7fef20c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fef1c070070 0x7fef1c15ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:31.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.075+0000 7fef21600640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fef1c154b30 0x7fef1c06edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:59198/0 (socket says 172.21.15.163:59198) 2024-04-01T17:05:31.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.076+0000 7fef21600640 1 -- 172.21.15.163:0/3505350864 learned_addr learned my addr 172.21.15.163:0/3505350864 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:31.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.082+0000 7fef20c00640 1 -- 172.21.15.163:0/3505350864 >> v1:172.21.15.189:6789/0 conn(0x7fef1c15b380 legacy=0x7fef1c06b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:31.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.082+0000 7fef20c00640 1 -- 172.21.15.163:0/3505350864 >> v1:172.21.15.163:6789/0 conn(0x7fef1c154b30 legacy=0x7fef1c06edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:31.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.082+0000 7fef20c00640 1 -- 172.21.15.163:0/3505350864 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c0c3740 con 0x7fef1c070070 2024-04-01T17:05:31.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.095+0000 7fef20c00640 1 --2- 172.21.15.163:0/3505350864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c070070 0x7fef1c15ae40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fef080097a0 tx=0x7fef0802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ba1c4e784bb78d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:31.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.115+0000 7fef1be00640 1 -- 172.21.15.163:0/3505350864 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef08034070 con 0x7fef1c070070 2024-04-01T17:05:31.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.115+0000 7fef1be00640 1 -- 172.21.15.163:0/3505350864 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef08030610 con 0x7fef1c070070 2024-04-01T17:05:31.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.115+0000 7fef1be00640 1 -- 172.21.15.163:0/3505350864 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef080309e0 con 0x7fef1c070070 2024-04-01T17:05:31.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.116+0000 7fef24000640 1 -- 172.21.15.163:0/3505350864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c070070 msgr2=0x7fef1c15ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:31.117 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.116+0000 7fef24000640 1 --2- 172.21.15.163:0/3505350864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c070070 0x7fef1c15ae40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fef080097a0 tx=0x7fef0802b960 comp rx=0 tx=0).stop 2024-04-01T17:05:31.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.117+0000 7fef24000640 1 -- 172.21.15.163:0/3505350864 shutdown_connections 2024-04-01T17:05:31.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.117+0000 7fef24000640 1 --2- 172.21.15.163:0/3505350864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c070070 0x7fef1c15ae40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:31.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.117+0000 7fef24000640 1 -- 172.21.15.163:0/3505350864 >> 172.21.15.163:0/3505350864 conn(0x7fef1c0ccf80 msgr2=0x7fef1c0cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:31.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.117+0000 7fef24000640 1 -- 172.21.15.163:0/3505350864 shutdown_connections 2024-04-01T17:05:31.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.117+0000 7fef24000640 1 -- 172.21.15.163:0/3505350864 wait complete. 2024-04-01T17:05:31.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.121+0000 7fef24000640 1 Processor -- start 2024-04-01T17:05:31.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.121+0000 7fef24000640 1 -- start start 2024-04-01T17:05:31.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.123+0000 7fef24000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c070070 0x7fef1c0c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:31.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.123+0000 7fef24000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c154b30 0x7fef1c0c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:31.124 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.123+0000 7fef24000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef1c15b380 0x7fef1c0c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:31.124 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.123+0000 7fef24000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c0c3fe0 con 0x7fef1c070070 2024-04-01T17:05:31.124 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.123+0000 7fef24000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c0c3d00 con 0x7fef1c154b30 2024-04-01T17:05:31.124 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.123+0000 7fef24000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fef1c15a920 con 0x7fef1c15b380 2024-04-01T17:05:31.125 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.125+0000 7fef20c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c154b30 0x7fef1c0c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:31.125 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.125+0000 7fef22000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef1c15b380 0x7fef1c0c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:31.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.125+0000 7fef20c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c154b30 0x7fef1c0c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:43346/0 (socket says 172.21.15.163:43346) 2024-04-01T17:05:31.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.125+0000 7fef20c00640 1 -- 172.21.15.163:0/4100991422 learned_addr learned my addr 172.21.15.163:0/4100991422 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:31.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.129+0000 7fef21600640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c070070 0x7fef1c0c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:31.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.133+0000 7fef20c00640 1 -- 172.21.15.163:0/4100991422 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef1c15b380 msgr2=0x7fef1c0c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:31.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.133+0000 7fef20c00640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef1c15b380 0x7fef1c0c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:31.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.133+0000 7fef20c00640 1 -- 172.21.15.163:0/4100991422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c070070 msgr2=0x7fef1c0c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:31.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.133+0000 7fef20c00640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c070070 0x7fef1c0c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:31.134 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.133+0000 7fef20c00640 1 -- 172.21.15.163:0/4100991422 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c1e3b00 con 0x7fef1c154b30 2024-04-01T17:05:31.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.138+0000 7fef20c00640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c154b30 0x7fef1c0c5160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fef080098c0 tx=0x7fef080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:31.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.147+0000 7fef19600640 1 -- 172.21.15.163:0/4100991422 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef08034040 con 0x7fef1c154b30 2024-04-01T17:05:31.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.147+0000 7fef19600640 1 -- 172.21.15.163:0/4100991422 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef08039a10 con 0x7fef1c154b30 2024-04-01T17:05:31.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.147+0000 7fef19600640 1 -- 172.21.15.163:0/4100991422 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef08039de0 con 0x7fef1c154b30 2024-04-01T17:05:31.148 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.147+0000 7fef24000640 1 -- 172.21.15.163:0/4100991422 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1c1e54e0 con 0x7fef1c154b30 2024-04-01T17:05:31.148 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.147+0000 7fef24000640 1 -- 172.21.15.163:0/4100991422 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1c1e5aa0 con 0x7fef1c154b30 2024-04-01T17:05:31.149 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.149+0000 7fef24000640 1 -- 172.21.15.163:0/4100991422 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef1c0b2b30 con 0x7fef1c154b30 2024-04-01T17:05:31.491 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.490+0000 7fef19600640 1 -- 172.21.15.163:0/4100991422 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef08037070 con 0x7fef1c154b30 2024-04-01T17:05:31.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.493+0000 7fef19600640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7feefc06c8f0 0x7feefc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:31.494 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.494+0000 7fef21600640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7feefc06c8f0 0x7feefc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:31.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.495+0000 7fef21600640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7feefc06c8f0 0x7feefc06edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fef10007fd0 tx=0x7fef10007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:31.498 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.498+0000 7fef19600640 1 -- 172.21.15.163:0/4100991422 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fef080305a0 con 0x7fef1c154b30 2024-04-01T17:05:31.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.528+0000 7fef19600640 1 -- 172.21.15.163:0/4100991422 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fef1c0b2b30 con 0x7fef1c154b30 2024-04-01T17:05:31.751 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.750+0000 7fef24000640 1 -- 172.21.15.163:0/4100991422 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef1c0756d0 con 0x7feefc06c8f0 2024-04-01T17:05:31.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.760+0000 7fef19600640 1 -- 172.21.15.163:0/4100991422 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252685 (secure 0 0 0) 0x7fef1c0756d0 con 0x7feefc06c8f0 2024-04-01T17:05:31.764 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T17:05:31.765 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T17:05:31.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.766+0000 7fef24000640 1 -- 172.21.15.163:0/4100991422 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7feefc06c8f0 msgr2=0x7feefc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:31.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.766+0000 7fef24000640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7feefc06c8f0 0x7feefc06edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fef10007fd0 tx=0x7fef10007e80 comp rx=0 tx=0).stop 2024-04-01T17:05:31.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.766+0000 7fef24000640 1 -- 172.21.15.163:0/4100991422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c154b30 msgr2=0x7fef1c0c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:31.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.766+0000 7fef24000640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c154b30 0x7fef1c0c5160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fef080098c0 tx=0x7fef080046c0 comp rx=0 tx=0).stop 2024-04-01T17:05:31.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.766+0000 7fef24000640 1 -- 172.21.15.163:0/4100991422 shutdown_connections 2024-04-01T17:05:31.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.766+0000 7fef24000640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7feefc06c8f0 0x7feefc06edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:31.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.766+0000 7fef24000640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fef1c15b380 0x7fef1c0c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:31.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.766+0000 7fef24000640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c154b30 0x7fef1c0c5160 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:31.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.766+0000 7fef24000640 1 --2- 172.21.15.163:0/4100991422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1c070070 0x7fef1c0c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:31.768 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.766+0000 7fef24000640 1 -- 172.21.15.163:0/4100991422 >> 172.21.15.163:0/4100991422 conn(0x7fef1c0ccf80 msgr2=0x7fef1c0c97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:31.768 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.766+0000 7fef24000640 1 -- 172.21.15.163:0/4100991422 shutdown_connections 2024-04-01T17:05:31.768 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:31.766+0000 7fef24000640 1 -- 172.21.15.163:0/4100991422 wait complete. 2024-04-01T17:05:31.786 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":968,"stamp":"2024-04-01T17:05:30.585272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23181253,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":535,"num_read_kb":554,"num_write":8981,"num_write_kb":279196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8111,"ondisk_log_size":8111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":334400,"kb_used_data":47552,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754640320,"statfs":{"total":773094113280,"available":772751687680,"internally_reserved":0,"allocated":48693248,"data_stored":47217626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":293654068},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2046,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004702"},"pg_stats":[{"pgid":"3.3f","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.153864+0000","last_change":"2024-04-01T16:34:34.033508+0000","last_active":"2024-04-01T17:05:23.153864+0000","last_peered":"2024-04-01T17:05:23.153864+0000","last_clean":"2024-04-01T17:05:23.153864+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T17:05:23.153864+0000","last_undegraded":"2024-04-01T17:05:23.153864+0000","last_fullsized":"2024-04-01T17:05:23.153864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'41","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.047351+0000","last_change":"2024-04-01T16:34:34.065375+0000","last_active":"2024-04-01T17:05:23.047351+0000","last_peered":"2024-04-01T17:05:23.047351+0000","last_clean":"2024-04-01T17:05:23.047351+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T17:05:23.047351+0000","last_undegraded":"2024-04-01T17:05:23.047351+0000","last_fullsized":"2024-04-01T17:05:23.047351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":1086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'48","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.306554+0000","last_change":"2024-04-01T16:34:34.084618+0000","last_active":"2024-04-01T17:05:23.306554+0000","last_peered":"2024-04-01T17:05:23.306554+0000","last_clean":"2024-04-01T17:05:23.306554+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T17:05:23.306554+0000","last_undegraded":"2024-04-01T17:05:23.306554+0000","last_fullsized":"2024-04-01T17:05:23.306554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:43.530081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.231935+0000","last_change":"2024-04-01T16:34:34.088694+0000","last_active":"2024-04-01T17:05:23.231935+0000","last_peered":"2024-04-01T17:05:23.231935+0000","last_clean":"2024-04-01T17:05:23.231935+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T17:05:23.231935+0000","last_undegraded":"2024-04-01T17:05:23.231935+0000","last_fullsized":"2024-04-01T17:05:23.231935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.154843+0000","last_change":"2024-04-01T16:34:34.085765+0000","last_active":"2024-04-01T17:05:23.154843+0000","last_peered":"2024-04-01T17:05:23.154843+0000","last_clean":"2024-04-01T17:05:23.154843+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T17:05:23.154843+0000","last_undegraded":"2024-04-01T17:05:23.154843+0000","last_fullsized":"2024-04-01T17:05:23.154843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'60","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.234713+0000","last_change":"2024-04-01T16:34:34.066150+0000","last_active":"2024-04-01T17:05:23.234713+0000","last_peered":"2024-04-01T17:05:23.234713+0000","last_clean":"2024-04-01T17:05:23.234713+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T17:05:23.234713+0000","last_undegraded":"2024-04-01T17:05:23.234713+0000","last_fullsized":"2024-04-01T17:05:23.234713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:08:56.651785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":2601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'34","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.147912+0000","last_change":"2024-04-01T16:34:34.072924+0000","last_active":"2024-04-01T17:05:23.147912+0000","last_peered":"2024-04-01T17:05:23.147912+0000","last_clean":"2024-04-01T17:05:23.147912+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T17:05:23.147912+0000","last_undegraded":"2024-04-01T17:05:23.147912+0000","last_fullsized":"2024-04-01T17:05:23.147912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'42","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.196568+0000","last_change":"2024-04-01T16:34:34.088361+0000","last_active":"2024-04-01T17:05:23.196568+0000","last_peered":"2024-04-01T17:05:23.196568+0000","last_clean":"2024-04-01T17:05:23.196568+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T17:05:23.196568+0000","last_undegraded":"2024-04-01T17:05:23.196568+0000","last_fullsized":"2024-04-01T17:05:23.196568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":1328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'48","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.155956+0000","last_change":"2024-04-01T16:34:34.038534+0000","last_active":"2024-04-01T17:05:23.155956+0000","last_peered":"2024-04-01T17:05:23.155956+0000","last_clean":"2024-04-01T17:05:23.155956+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T17:05:23.155956+0000","last_undegraded":"2024-04-01T17:05:23.155956+0000","last_fullsized":"2024-04-01T17:05:23.155956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:54.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.252389+0000","last_change":"2024-04-01T16:34:34.040513+0000","last_active":"2024-04-01T17:05:23.252389+0000","last_peered":"2024-04-01T17:05:23.252389+0000","last_clean":"2024-04-01T17:05:23.252389+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T17:05:23.252389+0000","last_undegraded":"2024-04-01T17:05:23.252389+0000","last_fullsized":"2024-04-01T17:05:23.252389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'36","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.244142+0000","last_change":"2024-04-01T16:34:34.038167+0000","last_active":"2024-04-01T17:05:23.244142+0000","last_peered":"2024-04-01T17:05:23.244142+0000","last_clean":"2024-04-01T17:05:23.244142+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T17:05:23.244142+0000","last_undegraded":"2024-04-01T17:05:23.244142+0000","last_fullsized":"2024-04-01T17:05:23.244142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'32","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.961219+0000","last_change":"2024-04-01T16:34:34.035177+0000","last_active":"2024-04-01T17:05:22.961219+0000","last_peered":"2024-04-01T17:05:22.961219+0000","last_clean":"2024-04-01T17:05:22.961219+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T17:05:22.961219+0000","last_undegraded":"2024-04-01T17:05:22.961219+0000","last_fullsized":"2024-04-01T17:05:22.961219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:37.711846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'66","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.197419+0000","last_change":"2024-04-01T16:34:34.086031+0000","last_active":"2024-04-01T17:05:23.197419+0000","last_peered":"2024-04-01T17:05:23.197419+0000","last_clean":"2024-04-01T17:05:23.197419+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T17:05:23.197419+0000","last_undegraded":"2024-04-01T17:05:23.197419+0000","last_fullsized":"2024-04-01T17:05:23.197419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'46","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.312882+0000","last_change":"2024-04-01T16:34:34.071535+0000","last_active":"2024-04-01T17:05:23.312882+0000","last_peered":"2024-04-01T17:05:23.312882+0000","last_clean":"2024-04-01T17:05:23.312882+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T17:05:23.312882+0000","last_undegraded":"2024-04-01T17:05:23.312882+0000","last_fullsized":"2024-04-01T17:05:23.312882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:45.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'45","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.053260+0000","last_change":"2024-04-01T16:34:33.904701+0000","last_active":"2024-04-01T17:05:23.053260+0000","last_peered":"2024-04-01T17:05:23.053260+0000","last_clean":"2024-04-01T17:05:23.053260+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T17:05:23.053260+0000","last_undegraded":"2024-04-01T17:05:23.053260+0000","last_fullsized":"2024-04-01T17:05:23.053260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:26:50.510934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":3152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'51","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.231758+0000","last_change":"2024-04-01T16:34:34.064695+0000","last_active":"2024-04-01T17:05:23.231758+0000","last_peered":"2024-04-01T17:05:23.231758+0000","last_clean":"2024-04-01T17:05:23.231758+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T17:05:23.231758+0000","last_undegraded":"2024-04-01T17:05:23.231758+0000","last_fullsized":"2024-04-01T17:05:23.231758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.798148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'54","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.234026+0000","last_change":"2024-04-01T16:34:34.032994+0000","last_active":"2024-04-01T17:05:23.234026+0000","last_peered":"2024-04-01T17:05:23.234026+0000","last_clean":"2024-04-01T17:05:23.234026+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T17:05:23.234026+0000","last_undegraded":"2024-04-01T17:05:23.234026+0000","last_fullsized":"2024-04-01T17:05:23.234026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":6831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'56","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.047424+0000","last_change":"2024-04-01T16:34:34.082238+0000","last_active":"2024-04-01T17:05:23.047424+0000","last_peered":"2024-04-01T17:05:23.047424+0000","last_clean":"2024-04-01T17:05:23.047424+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T17:05:23.047424+0000","last_undegraded":"2024-04-01T17:05:23.047424+0000","last_fullsized":"2024-04-01T17:05:23.047424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.147694+0000","last_change":"2024-04-01T16:34:34.083056+0000","last_active":"2024-04-01T17:05:23.147694+0000","last_peered":"2024-04-01T17:05:23.147694+0000","last_clean":"2024-04-01T17:05:23.147694+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T17:05:23.147694+0000","last_undegraded":"2024-04-01T17:05:23.147694+0000","last_fullsized":"2024-04-01T17:05:23.147694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"27'66","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.248285+0000","last_change":"2024-04-01T16:34:34.034017+0000","last_active":"2024-04-01T17:05:23.248285+0000","last_peered":"2024-04-01T17:05:23.248285+0000","last_clean":"2024-04-01T17:05:23.248285+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T17:05:23.248285+0000","last_undegraded":"2024-04-01T17:05:23.248285+0000","last_fullsized":"2024-04-01T17:05:23.248285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:33.976417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"27'53","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.303894+0000","last_change":"2024-04-01T16:34:34.068541+0000","last_active":"2024-04-01T17:05:23.303894+0000","last_peered":"2024-04-01T17:05:23.303894+0000","last_clean":"2024-04-01T17:05:23.303894+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T17:05:23.303894+0000","last_undegraded":"2024-04-01T17:05:23.303894+0000","last_fullsized":"2024-04-01T17:05:23.303894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:29.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"27'41","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.234841+0000","last_change":"2024-04-01T16:34:34.031774+0000","last_active":"2024-04-01T17:05:23.234841+0000","last_peered":"2024-04-01T17:05:23.234841+0000","last_clean":"2024-04-01T17:05:23.234841+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T17:05:23.234841+0000","last_undegraded":"2024-04-01T17:05:23.234841+0000","last_fullsized":"2024-04-01T17:05:23.234841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:39.294525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'56","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.193241+0000","last_change":"2024-04-01T16:34:34.090324+0000","last_active":"2024-04-01T17:05:23.193241+0000","last_peered":"2024-04-01T17:05:23.193241+0000","last_clean":"2024-04-01T17:05:23.193241+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T17:05:23.193241+0000","last_undegraded":"2024-04-01T17:05:23.193241+0000","last_fullsized":"2024-04-01T17:05:23.193241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:55:40.168021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":6379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'42","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.231684+0000","last_change":"2024-04-01T16:34:34.083544+0000","last_active":"2024-04-01T17:05:23.231684+0000","last_peered":"2024-04-01T17:05:23.231684+0000","last_clean":"2024-04-01T17:05:23.231684+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T17:05:23.231684+0000","last_undegraded":"2024-04-01T17:05:23.231684+0000","last_fullsized":"2024-04-01T17:05:23.231684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.185570+0000","last_change":"2024-04-01T16:34:34.090721+0000","last_active":"2024-04-01T17:05:23.185570+0000","last_peered":"2024-04-01T17:05:23.185570+0000","last_clean":"2024-04-01T17:05:23.185570+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T17:05:23.185570+0000","last_undegraded":"2024-04-01T17:05:23.185570+0000","last_fullsized":"2024-04-01T17:05:23.185570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"27'56","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.252181+0000","last_change":"2024-04-01T16:34:54.510600+0000","last_active":"2024-04-01T17:05:23.252181+0000","last_peered":"2024-04-01T17:05:23.252181+0000","last_clean":"2024-04-01T17:05:23.252181+0000","last_became_active":"2024-04-01T16:34:54.510173+0000","last_became_peered":"2024-04-01T16:34:54.510173+0000","last_unstale":"2024-04-01T17:05:23.252181+0000","last_undegraded":"2024-04-01T17:05:23.252181+0000","last_fullsized":"2024-04-01T17:05:23.252181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:55:35.172752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.100547+0000","last_change":"2024-04-01T16:34:34.091911+0000","last_active":"2024-04-01T17:05:23.100547+0000","last_peered":"2024-04-01T17:05:23.100547+0000","last_clean":"2024-04-01T17:05:23.100547+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T17:05:23.100547+0000","last_undegraded":"2024-04-01T17:05:23.100547+0000","last_fullsized":"2024-04-01T17:05:23.100547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:11:54.329173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"27'25","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.197490+0000","last_change":"2024-04-01T16:34:34.091540+0000","last_active":"2024-04-01T17:05:23.197490+0000","last_peered":"2024-04-01T17:05:23.197490+0000","last_clean":"2024-04-01T17:05:23.197490+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T17:05:23.197490+0000","last_undegraded":"2024-04-01T17:05:23.197490+0000","last_fullsized":"2024-04-01T17:05:23.197490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.242571+0000","last_change":"2024-04-01T16:34:34.087634+0000","last_active":"2024-04-01T17:05:23.242571+0000","last_peered":"2024-04-01T17:05:23.242571+0000","last_clean":"2024-04-01T17:05:23.242571+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T17:05:23.242571+0000","last_undegraded":"2024-04-01T17:05:23.242571+0000","last_fullsized":"2024-04-01T17:05:23.242571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:12.994756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"27'56","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.230780+0000","last_change":"2024-04-01T16:34:34.084026+0000","last_active":"2024-04-01T17:05:23.230780+0000","last_peered":"2024-04-01T17:05:23.230780+0000","last_clean":"2024-04-01T17:05:23.230780+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T17:05:23.230780+0000","last_undegraded":"2024-04-01T17:05:23.230780+0000","last_fullsized":"2024-04-01T17:05:23.230780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"27'46","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.039983+0000","last_change":"2024-04-01T16:34:34.088300+0000","last_active":"2024-04-01T17:05:23.039983+0000","last_peered":"2024-04-01T17:05:23.039983+0000","last_clean":"2024-04-01T17:05:23.039983+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T17:05:23.039983+0000","last_undegraded":"2024-04-01T17:05:23.039983+0000","last_fullsized":"2024-04-01T17:05:23.039983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"27'56","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.248072+0000","last_change":"2024-04-01T16:34:34.068348+0000","last_active":"2024-04-01T17:05:23.248072+0000","last_peered":"2024-04-01T17:05:23.248072+0000","last_clean":"2024-04-01T17:05:23.248072+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T17:05:23.248072+0000","last_undegraded":"2024-04-01T17:05:23.248072+0000","last_fullsized":"2024-04-01T17:05:23.248072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:17:33.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":5837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"27'29","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.953396+0000","last_change":"2024-04-01T16:34:33.901019+0000","last_active":"2024-04-01T17:05:22.953396+0000","last_peered":"2024-04-01T17:05:22.953396+0000","last_clean":"2024-04-01T17:05:22.953396+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T17:05:22.953396+0000","last_undegraded":"2024-04-01T17:05:22.953396+0000","last_fullsized":"2024-04-01T17:05:22.953396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:08:37.254438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'509","reported_seq":546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:50.054268+0000","last_change":"2024-04-01T16:34:31.489434+0000","last_active":"2024-04-01T17:04:50.054268+0000","last_peered":"2024-04-01T17:04:50.054268+0000","last_clean":"2024-04-01T17:04:50.054268+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T17:04:50.054268+0000","last_undegraded":"2024-04-01T17:04:50.054268+0000","last_fullsized":"2024-04-01T17:04:50.054268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'34","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.304501+0000","last_change":"2024-04-01T16:34:34.065342+0000","last_active":"2024-04-01T17:05:23.304501+0000","last_peered":"2024-04-01T17:05:23.304501+0000","last_clean":"2024-04-01T17:05:23.304501+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T17:05:23.304501+0000","last_undegraded":"2024-04-01T17:05:23.304501+0000","last_fullsized":"2024-04-01T17:05:23.304501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:56.911106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"27'432","reported_seq":469,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:50.048564+0000","last_change":"2024-04-01T16:34:31.530201+0000","last_active":"2024-04-01T17:04:50.048564+0000","last_peered":"2024-04-01T17:04:50.048564+0000","last_clean":"2024-04-01T17:04:50.048564+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T17:04:50.048564+0000","last_undegraded":"2024-04-01T17:04:50.048564+0000","last_fullsized":"2024-04-01T17:04:50.048564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.160707+0000","last_change":"2024-04-01T16:34:31.528238+0000","last_active":"2024-04-01T17:04:55.160707+0000","last_peered":"2024-04-01T17:04:55.160707+0000","last_clean":"2024-04-01T17:04:55.160707+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T17:04:55.160707+0000","last_undegraded":"2024-04-01T17:04:55.160707+0000","last_fullsized":"2024-04-01T17:04:55.160707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'57","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.193288+0000","last_change":"2024-04-01T16:34:34.091302+0000","last_active":"2024-04-01T17:05:23.193288+0000","last_peered":"2024-04-01T17:05:23.193288+0000","last_clean":"2024-04-01T17:05:23.193288+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T17:05:23.193288+0000","last_undegraded":"2024-04-01T17:05:23.193288+0000","last_fullsized":"2024-04-01T17:05:23.193288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":3573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:50.021371+0000","last_change":"2024-04-01T16:34:31.567946+0000","last_active":"2024-04-01T17:04:50.021371+0000","last_peered":"2024-04-01T17:04:50.021371+0000","last_clean":"2024-04-01T17:04:50.021371+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T17:04:50.021371+0000","last_undegraded":"2024-04-01T17:04:50.021371+0000","last_fullsized":"2024-04-01T17:04:50.021371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'43","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.108678+0000","last_change":"2024-04-01T16:34:34.088894+0000","last_active":"2024-04-01T17:05:23.108678+0000","last_peered":"2024-04-01T17:05:23.108678+0000","last_clean":"2024-04-01T17:05:23.108678+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T17:05:23.108678+0000","last_undegraded":"2024-04-01T17:05:23.108678+0000","last_fullsized":"2024-04-01T17:05:23.108678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:20.052132+0000","last_change":"2024-04-01T16:34:31.566997+0000","last_active":"2024-04-01T17:04:20.052132+0000","last_peered":"2024-04-01T17:04:20.052132+0000","last_clean":"2024-04-01T17:04:20.052132+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T17:04:20.052132+0000","last_undegraded":"2024-04-01T17:04:20.052132+0000","last_fullsized":"2024-04-01T17:04:20.052132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'70","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.229858+0000","last_change":"2024-04-01T16:34:34.030831+0000","last_active":"2024-04-01T17:05:23.229858+0000","last_peered":"2024-04-01T17:05:23.229858+0000","last_clean":"2024-04-01T17:05:23.229858+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T17:05:23.229858+0000","last_undegraded":"2024-04-01T17:05:23.229858+0000","last_fullsized":"2024-04-01T17:05:23.229858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:36.765896+0000","last_change":"2024-04-01T16:34:31.569927+0000","last_active":"2024-04-01T17:04:36.765896+0000","last_peered":"2024-04-01T17:04:36.765896+0000","last_clean":"2024-04-01T17:04:36.765896+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T17:04:36.765896+0000","last_undegraded":"2024-04-01T17:04:36.765896+0000","last_fullsized":"2024-04-01T17:04:36.765896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:41.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'48","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.240843+0000","last_change":"2024-04-01T16:34:34.068959+0000","last_active":"2024-04-01T17:05:23.240843+0000","last_peered":"2024-04-01T17:05:23.240843+0000","last_clean":"2024-04-01T17:05:23.240843+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T17:05:23.240843+0000","last_undegraded":"2024-04-01T17:05:23.240843+0000","last_fullsized":"2024-04-01T17:05:23.240843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:58:57.685708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"27'309","reported_seq":346,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:14.920828+0000","last_change":"2024-04-01T16:34:31.562792+0000","last_active":"2024-04-01T17:05:14.920828+0000","last_peered":"2024-04-01T17:05:14.920828+0000","last_clean":"2024-04-01T17:05:14.920828+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T17:05:14.920828+0000","last_undegraded":"2024-04-01T17:05:14.920828+0000","last_fullsized":"2024-04-01T17:05:14.920828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:55.684911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'53","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.962968+0000","last_change":"2024-04-01T16:34:33.916652+0000","last_active":"2024-04-01T17:05:22.962968+0000","last_peered":"2024-04-01T17:05:22.962968+0000","last_clean":"2024-04-01T17:05:22.962968+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T17:05:22.962968+0000","last_undegraded":"2024-04-01T17:05:22.962968+0000","last_fullsized":"2024-04-01T17:05:22.962968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:44:23.154412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":3009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"27'798","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.806557+0000","last_change":"2024-04-01T16:34:31.531366+0000","last_active":"2024-04-01T17:05:06.806557+0000","last_peered":"2024-04-01T17:05:06.806557+0000","last_clean":"2024-04-01T17:05:06.806557+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T17:05:06.806557+0000","last_undegraded":"2024-04-01T17:05:06.806557+0000","last_fullsized":"2024-04-01T17:05:06.806557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'42","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.147953+0000","last_change":"2024-04-01T16:34:34.085449+0000","last_active":"2024-04-01T17:05:23.147953+0000","last_peered":"2024-04-01T17:05:23.147953+0000","last_clean":"2024-04-01T17:05:23.147953+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T17:05:23.147953+0000","last_undegraded":"2024-04-01T17:05:23.147953+0000","last_fullsized":"2024-04-01T17:05:23.147953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.756876+0000","last_change":"2024-04-01T16:34:31.444458+0000","last_active":"2024-04-01T17:05:06.756876+0000","last_peered":"2024-04-01T17:05:06.756876+0000","last_clean":"2024-04-01T17:05:06.756876+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T17:05:06.756876+0000","last_undegraded":"2024-04-01T17:05:06.756876+0000","last_fullsized":"2024-04-01T17:05:06.756876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'50","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.304146+0000","last_change":"2024-04-01T16:34:34.071521+0000","last_active":"2024-04-01T17:05:23.304146+0000","last_peered":"2024-04-01T17:05:23.304146+0000","last_clean":"2024-04-01T17:05:23.304146+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T17:05:23.304146+0000","last_undegraded":"2024-04-01T17:05:23.304146+0000","last_fullsized":"2024-04-01T17:05:23.304146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:36:13.618956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:12.982073+0000","last_change":"2024-04-01T16:34:31.566202+0000","last_active":"2024-04-01T17:05:12.982073+0000","last_peered":"2024-04-01T17:05:12.982073+0000","last_clean":"2024-04-01T17:05:12.982073+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T17:05:12.982073+0000","last_undegraded":"2024-04-01T17:05:12.982073+0000","last_fullsized":"2024-04-01T17:05:12.982073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:54.543283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'72","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.182012+0000","last_change":"2024-04-01T16:34:33.930561+0000","last_active":"2024-04-01T17:05:23.182012+0000","last_peered":"2024-04-01T17:05:23.182012+0000","last_clean":"2024-04-01T17:05:23.182012+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T17:05:23.182012+0000","last_undegraded":"2024-04-01T17:05:23.182012+0000","last_fullsized":"2024-04-01T17:05:23.182012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":8452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:43.856695+0000","last_change":"2024-04-01T16:34:31.535895+0000","last_active":"2024-04-01T17:04:43.856695+0000","last_peered":"2024-04-01T17:04:43.856695+0000","last_clean":"2024-04-01T17:04:43.856695+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T17:04:43.856695+0000","last_undegraded":"2024-04-01T17:04:43.856695+0000","last_fullsized":"2024-04-01T17:04:43.856695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:36:43.780845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'37","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.245430+0000","last_change":"2024-04-01T16:34:34.068194+0000","last_active":"2024-04-01T17:05:23.245430+0000","last_peered":"2024-04-01T17:05:23.245430+0000","last_clean":"2024-04-01T17:05:23.245430+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T17:05:23.245430+0000","last_undegraded":"2024-04-01T17:05:23.245430+0000","last_fullsized":"2024-04-01T17:05:23.245430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:27.077792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:11.860033+0000","last_change":"2024-04-01T16:34:31.515495+0000","last_active":"2024-04-01T17:05:11.860033+0000","last_peered":"2024-04-01T17:05:11.860033+0000","last_clean":"2024-04-01T17:05:11.860033+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T17:05:11.860033+0000","last_undegraded":"2024-04-01T17:05:11.860033+0000","last_fullsized":"2024-04-01T17:05:11.860033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:26:56.217819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.149246+0000","last_change":"2024-04-01T16:34:33.926318+0000","last_active":"2024-04-01T17:05:23.149246+0000","last_peered":"2024-04-01T17:05:23.149246+0000","last_clean":"2024-04-01T17:05:23.149246+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T17:05:23.149246+0000","last_undegraded":"2024-04-01T17:05:23.149246+0000","last_fullsized":"2024-04-01T17:05:23.149246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:43.876931+0000","last_change":"2024-04-01T16:34:31.440349+0000","last_active":"2024-04-01T17:04:43.876931+0000","last_peered":"2024-04-01T17:04:43.876931+0000","last_clean":"2024-04-01T17:04:43.876931+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T17:04:43.876931+0000","last_undegraded":"2024-04-01T17:04:43.876931+0000","last_fullsized":"2024-04-01T17:04:43.876931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:29.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'29","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.146008+0000","last_change":"2024-04-01T16:34:33.931211+0000","last_active":"2024-04-01T17:05:23.146008+0000","last_peered":"2024-04-01T17:05:23.146008+0000","last_clean":"2024-04-01T17:05:23.146008+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T17:05:23.146008+0000","last_undegraded":"2024-04-01T17:05:23.146008+0000","last_fullsized":"2024-04-01T17:05:23.146008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:15:45.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:03:46.712894+0000","last_change":"2024-04-01T16:34:31.512433+0000","last_active":"2024-04-01T17:03:46.712894+0000","last_peered":"2024-04-01T17:03:46.712894+0000","last_clean":"2024-04-01T17:03:46.712894+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T17:03:46.712894+0000","last_undegraded":"2024-04-01T17:03:46.712894+0000","last_fullsized":"2024-04-01T17:03:46.712894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:16.032012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'39","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.155875+0000","last_change":"2024-04-01T16:34:33.930791+0000","last_active":"2024-04-01T17:05:23.155875+0000","last_peered":"2024-04-01T17:05:23.155875+0000","last_clean":"2024-04-01T17:05:23.155875+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T17:05:23.155875+0000","last_undegraded":"2024-04-01T17:05:23.155875+0000","last_fullsized":"2024-04-01T17:05:23.155875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:53.102054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.177195+0000","last_change":"2024-04-01T16:34:31.509375+0000","last_active":"2024-04-01T17:04:55.177195+0000","last_peered":"2024-04-01T17:04:55.177195+0000","last_clean":"2024-04-01T17:04:55.177195+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T17:04:55.177195+0000","last_undegraded":"2024-04-01T17:04:55.177195+0000","last_fullsized":"2024-04-01T17:04:55.177195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:45.577183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'50","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.230734+0000","last_change":"2024-04-01T16:34:34.085219+0000","last_active":"2024-04-01T17:05:23.230734+0000","last_peered":"2024-04-01T17:05:23.230734+0000","last_clean":"2024-04-01T17:05:23.230734+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T17:05:23.230734+0000","last_undegraded":"2024-04-01T17:05:23.230734+0000","last_fullsized":"2024-04-01T17:05:23.230734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"27'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:03:46.712863+0000","last_change":"2024-04-01T16:34:31.562761+0000","last_active":"2024-04-01T17:03:46.712863+0000","last_peered":"2024-04-01T17:03:46.712863+0000","last_clean":"2024-04-01T17:03:46.712863+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T17:03:46.712863+0000","last_undegraded":"2024-04-01T17:03:46.712863+0000","last_fullsized":"2024-04-01T17:03:46.712863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:23:33.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'41","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.148743+0000","last_change":"2024-04-01T16:34:34.039521+0000","last_active":"2024-04-01T17:05:23.148743+0000","last_peered":"2024-04-01T17:05:23.148743+0000","last_clean":"2024-04-01T17:05:23.148743+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T17:05:23.148743+0000","last_undegraded":"2024-04-01T17:05:23.148743+0000","last_fullsized":"2024-04-01T17:05:23.148743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":4631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:02:11.703709+0000","last_change":"2024-04-01T16:34:08.195697+0000","last_active":"2024-04-01T17:02:11.703709+0000","last_peered":"2024-04-01T17:02:11.703709+0000","last_clean":"2024-04-01T17:02:11.703709+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T17:02:11.703709+0000","last_undegraded":"2024-04-01T17:02:11.703709+0000","last_fullsized":"2024-04-01T17:02:11.703709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_clean_scrub_stamp":"2024-04-01T16:34:06.247737+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:05:51.067541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.810588+0000","last_change":"2024-04-01T16:34:31.569697+0000","last_active":"2024-04-01T17:05:06.810588+0000","last_peered":"2024-04-01T17:05:06.810588+0000","last_clean":"2024-04-01T17:05:06.810588+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T17:05:06.810588+0000","last_undegraded":"2024-04-01T17:05:06.810588+0000","last_fullsized":"2024-04-01T17:05:06.810588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.736852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.192829+0000","last_change":"2024-04-01T16:34:34.087298+0000","last_active":"2024-04-01T17:05:23.192829+0000","last_peered":"2024-04-01T17:05:23.192829+0000","last_clean":"2024-04-01T17:05:23.192829+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T17:05:23.192829+0000","last_undegraded":"2024-04-01T17:05:23.192829+0000","last_fullsized":"2024-04-01T17:05:23.192829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:36.417042+0000","last_change":"2024-04-01T16:34:31.509150+0000","last_active":"2024-04-01T17:04:36.417042+0000","last_peered":"2024-04-01T17:04:36.417042+0000","last_clean":"2024-04-01T17:04:36.417042+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T17:04:36.417042+0000","last_undegraded":"2024-04-01T17:04:36.417042+0000","last_fullsized":"2024-04-01T17:04:36.417042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'25","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.312341+0000","last_change":"2024-04-01T16:34:34.068444+0000","last_active":"2024-04-01T17:05:23.312341+0000","last_peered":"2024-04-01T17:05:23.312341+0000","last_clean":"2024-04-01T17:05:23.312341+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T17:05:23.312341+0000","last_undegraded":"2024-04-01T17:05:23.312341+0000","last_fullsized":"2024-04-01T17:05:23.312341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:04.104676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"27'432","reported_seq":890,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:15.893893+0000","last_change":"2024-04-01T16:34:31.512295+0000","last_active":"2024-04-01T17:05:15.893893+0000","last_peered":"2024-04-01T17:05:15.893893+0000","last_clean":"2024-04-01T17:05:15.893893+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T17:05:15.893893+0000","last_undegraded":"2024-04-01T17:05:15.893893+0000","last_fullsized":"2024-04-01T17:05:15.893893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:41:35.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110595,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":419,"num_read_kb":454,"num_write":427,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'53","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.051145+0000","last_change":"2024-04-01T16:34:34.083194+0000","last_active":"2024-04-01T17:05:23.051145+0000","last_peered":"2024-04-01T17:05:23.051145+0000","last_clean":"2024-04-01T17:05:23.051145+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T17:05:23.051145+0000","last_undegraded":"2024-04-01T17:05:23.051145+0000","last_fullsized":"2024-04-01T17:05:23.051145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:43.692930+0000","last_change":"2024-04-01T16:34:31.569571+0000","last_active":"2024-04-01T17:04:43.692930+0000","last_peered":"2024-04-01T17:04:43.692930+0000","last_clean":"2024-04-01T17:04:43.692930+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T17:04:43.692930+0000","last_undegraded":"2024-04-01T17:04:43.692930+0000","last_fullsized":"2024-04-01T17:04:43.692930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:10.626933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'26","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.958089+0000","last_change":"2024-04-01T16:34:34.063200+0000","last_active":"2024-04-01T17:05:22.958089+0000","last_peered":"2024-04-01T17:05:22.958089+0000","last_clean":"2024-04-01T17:05:22.958089+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T17:05:22.958089+0000","last_undegraded":"2024-04-01T17:05:22.958089+0000","last_fullsized":"2024-04-01T17:05:22.958089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:18.399835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":2569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.819009+0000","last_change":"2024-04-01T16:34:31.512508+0000","last_active":"2024-04-01T17:05:06.819009+0000","last_peered":"2024-04-01T17:05:06.819009+0000","last_clean":"2024-04-01T17:05:06.819009+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T17:05:06.819009+0000","last_undegraded":"2024-04-01T17:05:06.819009+0000","last_fullsized":"2024-04-01T17:05:06.819009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'34","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.042783+0000","last_change":"2024-04-01T16:34:54.510347+0000","last_active":"2024-04-01T17:05:23.042783+0000","last_peered":"2024-04-01T17:05:23.042783+0000","last_clean":"2024-04-01T17:05:23.042783+0000","last_became_active":"2024-04-01T16:34:54.509976+0000","last_became_peered":"2024-04-01T16:34:54.509976+0000","last_unstale":"2024-04-01T17:05:23.042783+0000","last_undegraded":"2024-04-01T17:05:23.042783+0000","last_fullsized":"2024-04-01T17:05:23.042783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:41:48.631612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:01.205221+0000","last_change":"2024-04-01T16:34:31.426647+0000","last_active":"2024-04-01T17:05:01.205221+0000","last_peered":"2024-04-01T17:05:01.205221+0000","last_clean":"2024-04-01T17:05:01.205221+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T17:05:01.205221+0000","last_undegraded":"2024-04-01T17:05:01.205221+0000","last_fullsized":"2024-04-01T17:05:01.205221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:36.926701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.053284+0000","last_change":"2024-04-01T16:34:34.087431+0000","last_active":"2024-04-01T17:05:23.053284+0000","last_peered":"2024-04-01T17:05:23.053284+0000","last_clean":"2024-04-01T17:05:23.053284+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T17:05:23.053284+0000","last_undegraded":"2024-04-01T17:05:23.053284+0000","last_fullsized":"2024-04-01T17:05:23.053284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:30:36.766260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"27'1149","reported_seq":1188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:13.942307+0000","last_change":"2024-04-01T16:34:31.528790+0000","last_active":"2024-04-01T17:05:13.942307+0000","last_peered":"2024-04-01T17:05:13.942307+0000","last_clean":"2024-04-01T17:05:13.942307+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T17:05:13.942307+0000","last_undegraded":"2024-04-01T17:05:13.942307+0000","last_fullsized":"2024-04-01T17:05:13.942307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":1149,"log_dups_size":0,"ondisk_log_size":1149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:35:07.531345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2752,"num_write_kb":935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.196350+0000","last_change":"2024-04-01T16:34:34.085832+0000","last_active":"2024-04-01T17:05:23.196350+0000","last_peered":"2024-04-01T17:05:23.196350+0000","last_clean":"2024-04-01T17:05:23.196350+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T17:05:23.196350+0000","last_undegraded":"2024-04-01T17:05:23.196350+0000","last_fullsized":"2024-04-01T17:05:23.196350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:00.278120+0000","last_change":"2024-04-01T16:34:31.534057+0000","last_active":"2024-04-01T17:05:00.278120+0000","last_peered":"2024-04-01T17:05:00.278120+0000","last_clean":"2024-04-01T17:05:00.278120+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T17:05:00.278120+0000","last_undegraded":"2024-04-01T17:05:00.278120+0000","last_fullsized":"2024-04-01T17:05:00.278120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:53:06.158423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'56","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.243128+0000","last_change":"2024-04-01T16:34:34.073261+0000","last_active":"2024-04-01T17:05:23.243128+0000","last_peered":"2024-04-01T17:05:23.243128+0000","last_clean":"2024-04-01T17:05:23.243128+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T17:05:23.243128+0000","last_undegraded":"2024-04-01T17:05:23.243128+0000","last_fullsized":"2024-04-01T17:05:23.243128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:38.619969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":6288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:00.296785+0000","last_change":"2024-04-01T16:34:31.423531+0000","last_active":"2024-04-01T17:05:00.296785+0000","last_peered":"2024-04-01T17:05:00.296785+0000","last_clean":"2024-04-01T17:05:00.296785+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T17:05:00.296785+0000","last_undegraded":"2024-04-01T17:05:00.296785+0000","last_fullsized":"2024-04-01T17:05:00.296785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'38","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.472817+0000","last_change":"2024-04-01T16:34:34.086029+0000","last_active":"2024-04-01T17:04:55.472817+0000","last_peered":"2024-04-01T17:04:55.472817+0000","last_clean":"2024-04-01T17:04:55.472817+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T17:04:55.472817+0000","last_undegraded":"2024-04-01T17:04:55.472817+0000","last_fullsized":"2024-04-01T17:04:55.472817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:32:16.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:53.554803+0000","last_change":"2024-04-01T16:34:31.509351+0000","last_active":"2024-04-01T17:04:53.554803+0000","last_peered":"2024-04-01T17:04:53.554803+0000","last_clean":"2024-04-01T17:04:53.554803+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T17:04:53.554803+0000","last_undegraded":"2024-04-01T17:04:53.554803+0000","last_fullsized":"2024-04-01T17:04:53.554803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:13:41.636370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'43","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.192179+0000","last_change":"2024-04-01T16:34:34.091932+0000","last_active":"2024-04-01T17:05:23.192179+0000","last_peered":"2024-04-01T17:05:23.192179+0000","last_clean":"2024-04-01T17:05:23.192179+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T17:05:23.192179+0000","last_undegraded":"2024-04-01T17:05:23.192179+0000","last_fullsized":"2024-04-01T17:05:23.192179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:11:00.238138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.177952+0000","last_change":"2024-04-01T16:34:31.517513+0000","last_active":"2024-04-01T17:04:55.177952+0000","last_peered":"2024-04-01T17:04:55.177952+0000","last_clean":"2024-04-01T17:04:55.177952+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T17:04:55.177952+0000","last_undegraded":"2024-04-01T17:04:55.177952+0000","last_fullsized":"2024-04-01T17:04:55.177952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:17:31.608594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'58","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.051569+0000","last_change":"2024-04-01T16:34:55.004709+0000","last_active":"2024-04-01T17:05:23.051569+0000","last_peered":"2024-04-01T17:05:23.051569+0000","last_clean":"2024-04-01T17:05:23.051569+0000","last_became_active":"2024-04-01T16:34:55.003987+0000","last_became_peered":"2024-04-01T16:34:55.003987+0000","last_unstale":"2024-04-01T17:05:23.051569+0000","last_undegraded":"2024-04-01T17:05:23.051569+0000","last_fullsized":"2024-04-01T17:05:23.051569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:29:14.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"27'622","reported_seq":660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:20.069789+0000","last_change":"2024-04-01T16:34:31.444603+0000","last_active":"2024-04-01T17:04:20.069789+0000","last_peered":"2024-04-01T17:04:20.069789+0000","last_clean":"2024-04-01T17:04:20.069789+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T17:04:20.069789+0000","last_undegraded":"2024-04-01T17:04:20.069789+0000","last_fullsized":"2024-04-01T17:04:20.069789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.245866+0000","last_change":"2024-04-01T16:34:34.034061+0000","last_active":"2024-04-01T17:05:23.245866+0000","last_peered":"2024-04-01T17:05:23.245866+0000","last_clean":"2024-04-01T17:05:23.245866+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T17:05:23.245866+0000","last_undegraded":"2024-04-01T17:05:23.245866+0000","last_fullsized":"2024-04-01T17:05:23.245866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:45:14.411693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"27'54","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.047264+0000","last_change":"2024-04-01T16:34:55.011962+0000","last_active":"2024-04-01T17:05:23.047264+0000","last_peered":"2024-04-01T17:05:23.047264+0000","last_clean":"2024-04-01T17:05:23.047264+0000","last_became_active":"2024-04-01T16:34:55.011400+0000","last_became_peered":"2024-04-01T16:34:55.011400+0000","last_unstale":"2024-04-01T17:05:23.047264+0000","last_undegraded":"2024-04-01T17:05:23.047264+0000","last_fullsized":"2024-04-01T17:05:23.047264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:14:52.381836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":3157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:49.977812+0000","last_change":"2024-04-01T16:34:31.563882+0000","last_active":"2024-04-01T17:04:49.977812+0000","last_peered":"2024-04-01T17:04:49.977812+0000","last_clean":"2024-04-01T17:04:49.977812+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T17:04:49.977812+0000","last_undegraded":"2024-04-01T17:04:49.977812+0000","last_fullsized":"2024-04-01T17:04:49.977812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:27.209535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'35","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.233213+0000","last_change":"2024-04-01T16:34:34.034904+0000","last_active":"2024-04-01T17:05:23.233213+0000","last_peered":"2024-04-01T17:05:23.233213+0000","last_clean":"2024-04-01T17:05:23.233213+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T17:05:23.233213+0000","last_undegraded":"2024-04-01T17:05:23.233213+0000","last_fullsized":"2024-04-01T17:05:23.233213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:00.297118+0000","last_change":"2024-04-01T16:34:31.530246+0000","last_active":"2024-04-01T17:05:00.297118+0000","last_peered":"2024-04-01T17:05:00.297118+0000","last_clean":"2024-04-01T17:05:00.297118+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T17:05:00.297118+0000","last_undegraded":"2024-04-01T17:05:00.297118+0000","last_fullsized":"2024-04-01T17:05:00.297118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:48.430325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"27'50","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.312112+0000","last_change":"2024-04-01T16:34:34.066381+0000","last_active":"2024-04-01T17:05:23.312112+0000","last_peered":"2024-04-01T17:05:23.312112+0000","last_clean":"2024-04-01T17:05:23.312112+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T17:05:23.312112+0000","last_undegraded":"2024-04-01T17:05:23.312112+0000","last_fullsized":"2024-04-01T17:05:23.312112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:10.824493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":6181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"27'145","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.699552+0000","last_change":"2024-04-01T16:34:31.490535+0000","last_active":"2024-04-01T17:05:22.699552+0000","last_peered":"2024-04-01T17:05:22.699552+0000","last_clean":"2024-04-01T17:05:22.699552+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T17:05:22.699552+0000","last_undegraded":"2024-04-01T17:05:22.699552+0000","last_fullsized":"2024-04-01T17:05:22.699552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:01:24.709969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507300,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.184093+0000","last_change":"2024-04-01T16:34:34.087097+0000","last_active":"2024-04-01T17:05:23.184093+0000","last_peered":"2024-04-01T17:05:23.184093+0000","last_clean":"2024-04-01T17:05:23.184093+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T17:05:23.184093+0000","last_undegraded":"2024-04-01T17:05:23.184093+0000","last_fullsized":"2024-04-01T17:05:23.184093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:17:48.287828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'621","reported_seq":660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:03:41.727213+0000","last_change":"2024-04-01T16:34:31.420599+0000","last_active":"2024-04-01T17:03:41.727213+0000","last_peered":"2024-04-01T17:03:41.727213+0000","last_clean":"2024-04-01T17:03:41.727213+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T17:03:41.727213+0000","last_undegraded":"2024-04-01T17:03:41.727213+0000","last_fullsized":"2024-04-01T17:03:41.727213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2204,"num_write_kb":251439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2871,"ondisk_log_size":2871,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22590885,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":419,"num_read_kb":454,"num_write":6618,"num_write_kb":25341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45244416,"data_stored":45181770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5123,"ondisk_log_size":5123,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509820,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52644,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319196,"statfs":{"total":96636764160,"available":96582856704,"internally_reserved":0,"allocated":13463552,"data_stored":13280752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509822,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":217485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509818,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41772,"kb_used_data":6436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330068,"statfs":{"total":96636764160,"available":96593989632,"internally_reserved":0,"allocated":6590464,"data_stored":6399500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509820,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":106980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509821,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43816,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328024,"statfs":{"total":96636764160,"available":96591896576,"internally_reserved":0,"allocated":8683520,"data_stored":8495624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542525,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47972,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323868,"statfs":{"total":96636764160,"available":96587640832,"internally_reserved":0,"allocated":8679424,"data_stored":8496170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542523,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49556,"kb_used_data":10060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322284,"statfs":{"total":96636764160,"available":96586018816,"internally_reserved":0,"allocated":10301440,"data_stored":10114065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542526,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35620,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336220,"statfs":{"total":96636764160,"available":96600289280,"internally_reserved":0,"allocated":290816,"data_stored":107050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5713920,"data_stored":5702242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":110595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10018816,"data_stored":10007175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8389280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T17:05:31.791 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T17:05:32.043 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.043+0000 7f214ce00640 1 Processor -- start 2024-04-01T17:05:32.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.043+0000 7f214ce00640 1 -- start start 2024-04-01T17:05:32.045 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.044+0000 7f214ce00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f21481528f0 0x7f214806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:32.045 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.044+0000 7f214ce00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2148070040 0x7f2148070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:32.045 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.045+0000 7f214ce00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2148158720 con 0x7f2148070fb0 2024-04-01T17:05:32.045 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.045+0000 7f214ce00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f2148152cd0 con 0x7f2148070040 2024-04-01T17:05:32.045 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.045+0000 7f214ce00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f21481589c0 con 0x7f21481528f0 2024-04-01T17:05:32.057 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.056+0000 7f2146800640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f2148070fb0 0x7f214815bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:48292/0 (socket says 172.21.15.163:48292) 2024-04-01T17:05:32.057 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.057+0000 7f2146800640 1 -- 172.21.15.163:0/2916771124 learned_addr learned my addr 172.21.15.163:0/2916771124 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:32.057 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.057+0000 7f2145e00640 1 --2- 172.21.15.163:0/2916771124 >> v2:172.21.15.189:3300/0 conn(0x7f21481528f0 0x7f214806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:32.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.095+0000 7f2145400640 1 --2- 172.21.15.163:0/2916771124 >> v2:172.21.15.163:3300/0 conn(0x7f2148070040 0x7f2148070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:32.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.102+0000 7f2145400640 1 -- 172.21.15.163:0/2916771124 >> v2:172.21.15.189:3300/0 conn(0x7f21481528f0 msgr2=0x7f214806edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:32.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.102+0000 7f2145400640 1 --2- 172.21.15.163:0/2916771124 >> v2:172.21.15.189:3300/0 conn(0x7f21481528f0 0x7f214806edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:32.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.102+0000 7f2145400640 1 -- 172.21.15.163:0/2916771124 >> v1:172.21.15.189:6789/0 conn(0x7f2148070fb0 legacy=0x7f214815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:32.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.102+0000 7f2145400640 1 -- 172.21.15.163:0/2916771124 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2148158ca0 con 0x7f2148070040 2024-04-01T17:05:32.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.110+0000 7f2145400640 1 --2- 172.21.15.163:0/2916771124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2148070040 0x7f2148070a70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f214806c5a0 tx=0x7f213402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba38ac8554acfb4c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:32.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.121+0000 7f2144a00640 1 -- 172.21.15.163:0/2916771124 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134034070 con 0x7f2148070040 2024-04-01T17:05:32.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.121+0000 7f2144a00640 1 -- 172.21.15.163:0/2916771124 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2134030610 con 0x7f2148070040 2024-04-01T17:05:32.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.121+0000 7f2144a00640 1 -- 172.21.15.163:0/2916771124 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21340309e0 con 0x7f2148070040 2024-04-01T17:05:32.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.122+0000 7f214ce00640 1 -- 172.21.15.163:0/2916771124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2148070040 msgr2=0x7f2148070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:32.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.122+0000 7f214ce00640 1 --2- 172.21.15.163:0/2916771124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2148070040 0x7f2148070a70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f214806c5a0 tx=0x7f213402b960 comp rx=0 tx=0).stop 2024-04-01T17:05:32.123 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.123+0000 7f214ce00640 1 -- 172.21.15.163:0/2916771124 shutdown_connections 2024-04-01T17:05:32.124 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.123+0000 7f214ce00640 1 --2- 172.21.15.163:0/2916771124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2148070040 0x7f2148070a70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:32.124 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.123+0000 7f214ce00640 1 --2- 172.21.15.163:0/2916771124 >> v2:172.21.15.189:3300/0 conn(0x7f21481528f0 0x7f214806edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:32.124 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.123+0000 7f214ce00640 1 -- 172.21.15.163:0/2916771124 >> 172.21.15.163:0/2916771124 conn(0x7f21480735e0 msgr2=0x7f214806c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:32.124 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.123+0000 7f214ce00640 1 -- 172.21.15.163:0/2916771124 shutdown_connections 2024-04-01T17:05:32.124 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.123+0000 7f214ce00640 1 -- 172.21.15.163:0/2916771124 wait complete. 2024-04-01T17:05:32.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.127+0000 7f214ce00640 1 Processor -- start 2024-04-01T17:05:32.128 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.128+0000 7f214ce00640 1 -- start start 2024-04-01T17:05:32.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.129+0000 7f214ce00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2148070040 0x7f2148147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:32.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.129+0000 7f214ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2148070fb0 0x7f2148155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:32.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.129+0000 7f214ce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21481528f0 0x7f2148146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:32.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.129+0000 7f214ce00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f21480ca5b0 con 0x7f21481528f0 2024-04-01T17:05:32.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.129+0000 7f214ce00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2148159260 con 0x7f2148070fb0 2024-04-01T17:05:32.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.129+0000 7f214ce00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f214806f2f0 con 0x7f2148070040 2024-04-01T17:05:32.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.130+0000 7f2146800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21481528f0 0x7f2148146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:32.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.131+0000 7f2145e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2148070040 0x7f2148147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:32.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.131+0000 7f2146800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21481528f0 0x7f2148146770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50738/0 (socket says 172.21.15.163:50738) 2024-04-01T17:05:32.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.131+0000 7f2146800640 1 -- 172.21.15.163:0/3548444530 learned_addr learned my addr 172.21.15.163:0/3548444530 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:32.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.136+0000 7f2146800640 1 -- 172.21.15.163:0/3548444530 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2148070040 msgr2=0x7f2148147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:32.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.136+0000 7f2146800640 1 --2- 172.21.15.163:0/3548444530 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2148070040 0x7f2148147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:32.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.136+0000 7f2146800640 1 -- 172.21.15.163:0/3548444530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2148070fb0 msgr2=0x7f2148155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:32.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.136+0000 7f2146800640 1 --2- 172.21.15.163:0/3548444530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2148070fb0 0x7f2148155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:32.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.136+0000 7f2146800640 1 -- 172.21.15.163:0/3548444530 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21481ee670 con 0x7f21481528f0 2024-04-01T17:05:32.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.139+0000 7f2146800640 1 --2- 172.21.15.163:0/3548444530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21481528f0 0x7f2148146770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f214000cae0 tx=0x7f214000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:32.146 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.145+0000 7f213e000640 1 -- 172.21.15.163:0/3548444530 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140017070 con 0x7f21481528f0 2024-04-01T17:05:32.146 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.145+0000 7f213e000640 1 -- 172.21.15.163:0/3548444530 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f214000ac40 con 0x7f21481528f0 2024-04-01T17:05:32.146 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.145+0000 7f213e000640 1 -- 172.21.15.163:0/3548444530 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140012400 con 0x7f21481528f0 2024-04-01T17:05:32.146 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.145+0000 7f214ce00640 1 -- 172.21.15.163:0/3548444530 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21480c71e0 con 0x7f21481528f0 2024-04-01T17:05:32.146 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.146+0000 7f214ce00640 1 -- 172.21.15.163:0/3548444530 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21481eebf0 con 0x7f21481528f0 2024-04-01T17:05:32.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.147+0000 7f214ce00640 1 -- 172.21.15.163:0/3548444530 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21480756d0 con 0x7f21481528f0 2024-04-01T17:05:32.180 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.180+0000 7f213e000640 1 -- 172.21.15.163:0/3548444530 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f214001a070 con 0x7f21481528f0 2024-04-01T17:05:32.182 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.181+0000 7f213e000640 1 --2- 172.21.15.163:0/3548444530 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f212806c940 0x7f212806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:32.182 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.182+0000 7f213e000640 1 -- 172.21.15.163:0/3548444530 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f2140057af0 con 0x7f21481528f0 2024-04-01T17:05:32.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.182+0000 7f2145e00640 1 --2- 172.21.15.163:0/3548444530 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f212806c940 0x7f212806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:32.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.184+0000 7f2145e00640 1 --2- 172.21.15.163:0/3548444530 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f212806c940 0x7f212806ee00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2138009aa0 tx=0x7f2138009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:32.502 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.501+0000 7f213e000640 1 -- 172.21.15.163:0/3548444530 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2140059a50 con 0x7f21481528f0 2024-04-01T17:05:32.730 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.729+0000 7f214ce00640 1 -- 172.21.15.163:0/3548444530 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f214806fc10 con 0x7f21481528f0 2024-04-01T17:05:32.819 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.818+0000 7f213e000640 1 -- 172.21.15.163:0/3548444530 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+16901 (secure 0 0 0) 0x7f214005dd50 con 0x7f21481528f0 2024-04-01T17:05:32.819 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T17:05:32.819 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":27,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:53.160271+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T16:34:29.028272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T16:34:31.534879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T17:05:32.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.821+0000 7f214ce00640 1 -- 172.21.15.163:0/3548444530 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f212806c940 msgr2=0x7f212806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:32.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.821+0000 7f214ce00640 1 --2- 172.21.15.163:0/3548444530 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f212806c940 0x7f212806ee00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2138009aa0 tx=0x7f2138009190 comp rx=0 tx=0).stop 2024-04-01T17:05:32.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.821+0000 7f214ce00640 1 -- 172.21.15.163:0/3548444530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21481528f0 msgr2=0x7f2148146770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:32.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.821+0000 7f214ce00640 1 --2- 172.21.15.163:0/3548444530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21481528f0 0x7f2148146770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f214000cae0 tx=0x7f214000a060 comp rx=0 tx=0).stop 2024-04-01T17:05:32.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.822+0000 7f214ce00640 1 -- 172.21.15.163:0/3548444530 shutdown_connections 2024-04-01T17:05:32.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.822+0000 7f214ce00640 1 --2- 172.21.15.163:0/3548444530 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f212806c940 0x7f212806ee00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:32.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.822+0000 7f214ce00640 1 --2- 172.21.15.163:0/3548444530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21481528f0 0x7f2148146770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:32.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.822+0000 7f214ce00640 1 --2- 172.21.15.163:0/3548444530 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2148070fb0 0x7f2148155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:32.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.822+0000 7f214ce00640 1 --2- 172.21.15.163:0/3548444530 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2148070040 0x7f2148147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:32.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.822+0000 7f214ce00640 1 -- 172.21.15.163:0/3548444530 >> 172.21.15.163:0/3548444530 conn(0x7f21480735e0 msgr2=0x7f21480c8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:32.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.822+0000 7f214ce00640 1 -- 172.21.15.163:0/3548444530 shutdown_connections 2024-04-01T17:05:32.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:32.822+0000 7f214ce00640 1 -- 172.21.15.163:0/3548444530 wait complete. 2024-04-01T17:05:33.845 INFO:tasks.ceph:Scrubbing osd.0 2024-04-01T17:05:33.846 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-01T17:05:34.067 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.067+0000 7f335f200640 1 Processor -- start 2024-04-01T17:05:34.067 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.067+0000 7f335f200640 1 -- start start 2024-04-01T17:05:34.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.068+0000 7f335f200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f33600ce3e0 0x7f33600cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:34.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.068+0000 7f335f200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f33600cedb0 0x7f33600cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:34.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.068+0000 7f335f200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33600b1ef0 con 0x7f3360154c70 2024-04-01T17:05:34.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.068+0000 7f335f200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f33600ca790 con 0x7f33600cedb0 2024-04-01T17:05:34.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.068+0000 7f335f200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f3360155050 con 0x7f33600ce3e0 2024-04-01T17:05:34.070 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.070+0000 7f335d400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f33600ce3e0 0x7f33600cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:34.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.071+0000 7f335d400640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f33600ce3e0 0x7f33600cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:43392/0 (socket says 172.21.15.163:43392) 2024-04-01T17:05:34.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.071+0000 7f335d400640 1 -- 172.21.15.163:0/1808686704 learned_addr learned my addr 172.21.15.163:0/1808686704 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:34.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.077+0000 7f335d400640 1 -- 172.21.15.163:0/1808686704 >> v2:172.21.15.163:3300/0 conn(0x7f33600cedb0 msgr2=0x7f33600cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:34.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.077+0000 7f335d400640 1 --2- 172.21.15.163:0/1808686704 >> v2:172.21.15.163:3300/0 conn(0x7f33600cedb0 0x7f33600cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.077+0000 7f335d400640 1 -- 172.21.15.163:0/1808686704 >> v1:172.21.15.163:6789/0 conn(0x7f3360154c70 legacy=0x7f33600cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:34.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.077+0000 7f335d400640 1 -- 172.21.15.163:0/1808686704 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33600b1c10 con 0x7f33600ce3e0 2024-04-01T17:05:34.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.083+0000 7f335d400640 1 --2- 172.21.15.163:0/1808686704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33600ce3e0 0x7f33600cac20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f33600c3520 tx=0x7f334c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39ec6411358aa046 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:34.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.093+0000 7f335ca00640 1 -- 172.21.15.163:0/1808686704 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c034070 con 0x7f33600ce3e0 2024-04-01T17:05:34.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.093+0000 7f335ca00640 1 -- 172.21.15.163:0/1808686704 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334c030860 con 0x7f33600ce3e0 2024-04-01T17:05:34.093 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.093+0000 7f335ca00640 1 -- 172.21.15.163:0/1808686704 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c030c30 con 0x7f33600ce3e0 2024-04-01T17:05:34.094 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.094+0000 7f335f200640 1 -- 172.21.15.163:0/1808686704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33600ce3e0 msgr2=0x7f33600cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.094+0000 7f335f200640 1 --2- 172.21.15.163:0/1808686704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33600ce3e0 0x7f33600cac20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f33600c3520 tx=0x7f334c02b9a0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.094+0000 7f335f200640 1 -- 172.21.15.163:0/1808686704 shutdown_connections 2024-04-01T17:05:34.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.094+0000 7f335f200640 1 --2- 172.21.15.163:0/1808686704 >> v2:172.21.15.163:3300/0 conn(0x7f33600cedb0 0x7f33600cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.094+0000 7f335f200640 1 --2- 172.21.15.163:0/1808686704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33600ce3e0 0x7f33600cac20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.094+0000 7f335f200640 1 -- 172.21.15.163:0/1808686704 >> 172.21.15.163:0/1808686704 conn(0x7f3360067280 msgr2=0x7f3360067690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:34.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.094+0000 7f335f200640 1 -- 172.21.15.163:0/1808686704 shutdown_connections 2024-04-01T17:05:34.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.094+0000 7f335f200640 1 -- 172.21.15.163:0/1808686704 wait complete. 2024-04-01T17:05:34.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.096+0000 7f335f200640 1 Processor -- start 2024-04-01T17:05:34.096 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.096+0000 7f335f200640 1 -- start start 2024-04-01T17:05:34.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.097+0000 7f335f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33600ce3e0 0x7f33601f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:34.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.097+0000 7f335f200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33600cedb0 0x7f33600c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:34.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.097+0000 7f335f200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3360154c70 0x7f336015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:34.098 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.097+0000 7f335f200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f33600b2190 con 0x7f3360154c70 2024-04-01T17:05:34.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.097+0000 7f335f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f336015eb90 con 0x7f33600ce3e0 2024-04-01T17:05:34.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.097+0000 7f335f200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f3360156c90 con 0x7f33600cedb0 2024-04-01T17:05:34.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.098+0000 7f335e800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3360154c70 0x7f336015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:34.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.098+0000 7f335e800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3360154c70 0x7f336015cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50764/0 (socket says 172.21.15.163:50764) 2024-04-01T17:05:34.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.098+0000 7f335e800640 1 -- 172.21.15.163:0/2805750667 learned_addr learned my addr 172.21.15.163:0/2805750667 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:34.099 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.099+0000 7f335d400640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33600cedb0 0x7f33600c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:34.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.102+0000 7f335e800640 1 -- 172.21.15.163:0/2805750667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33600cedb0 msgr2=0x7f33600c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.102+0000 7f335e800640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f33600cedb0 0x7f33600c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.102+0000 7f335e800640 1 -- 172.21.15.163:0/2805750667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33600ce3e0 msgr2=0x7f33601f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.102+0000 7f335e800640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33600ce3e0 0x7f33601f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.102+0000 7f335e800640 1 -- 172.21.15.163:0/2805750667 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336015da30 con 0x7f3360154c70 2024-04-01T17:05:34.106 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.105+0000 7f335e800640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3360154c70 0x7f336015cff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f335800b970 tx=0x7f335800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:34.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.111+0000 7f3356000640 1 -- 172.21.15.163:0/2805750667 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358019070 con 0x7f3360154c70 2024-04-01T17:05:34.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.111+0000 7f3356000640 1 -- 172.21.15.163:0/2805750667 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f335800cb60 con 0x7f3360154c70 2024-04-01T17:05:34.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.111+0000 7f3356000640 1 -- 172.21.15.163:0/2805750667 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358014440 con 0x7f3360154c70 2024-04-01T17:05:34.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.111+0000 7f335f200640 1 -- 172.21.15.163:0/2805750667 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3360157110 con 0x7f3360154c70 2024-04-01T17:05:34.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.111+0000 7f335f200640 1 -- 172.21.15.163:0/2805750667 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3360155410 con 0x7f3360154c70 2024-04-01T17:05:34.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.112+0000 7f335f200640 1 -- 172.21.15.163:0/2805750667 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33600756d0 con 0x7f3360154c70 2024-04-01T17:05:34.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.138+0000 7f3356000640 1 -- 172.21.15.163:0/2805750667 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f335801c070 con 0x7f3360154c70 2024-04-01T17:05:34.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.140+0000 7f3356000640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f334006c970 0x7f334006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:34.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.140+0000 7f335de00640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f334006c970 0x7f334006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:34.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.142+0000 7f335de00640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f334006c970 0x7f334006ee30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3350009650 tx=0x7f3350006ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:34.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.143+0000 7f3356000640 1 -- 172.21.15.163:0/2805750667 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f3358057d90 con 0x7f3360154c70 2024-04-01T17:05:34.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.144+0000 7f3356000640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] conn(0x7f3340074cf0 0x7f3340077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:34.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.144+0000 7f3356000640 1 -- 172.21.15.163:0/2805750667 --> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3358018ec0 con 0x7f3340074cf0 2024-04-01T17:05:34.144 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.144+0000 7f335d400640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] conn(0x7f3340074cf0 0x7f3340077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:34.145 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.145+0000 7f335d400640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] conn(0x7f3340074cf0 0x7f3340077170 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:34.146 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.146+0000 7f3356000640 1 -- 172.21.15.163:0/2805750667 <== osd.0 v2:172.21.15.163:6810/3625964404 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3358018ec0 con 0x7f3340074cf0 2024-04-01T17:05:34.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.147+0000 7f3356000640 1 -- 172.21.15.163:0/2805750667 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3358055f90 con 0x7f3360154c70 2024-04-01T17:05:34.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.164+0000 7f335f200640 1 -- 172.21.15.163:0/2805750667 --> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f33600b5d90 con 0x7f3340074cf0 2024-04-01T17:05:34.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.164+0000 7f3356000640 1 -- 172.21.15.163:0/2805750667 <== osd.0 v2:172.21.15.163:6810/3625964404 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f33600b5d90 con 0x7f3340074cf0 2024-04-01T17:05:34.165 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-01T17:05:34.165 INFO:teuthology.orchestra.run.smithi163.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T17:05:34.165 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-01T17:05:34.166 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.165+0000 7f335f200640 1 -- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] conn(0x7f3340074cf0 msgr2=0x7f3340077170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.165+0000 7f335f200640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:6810/3625964404,v1:172.21.15.163:6811/3625964404] conn(0x7f3340074cf0 0x7f3340077170 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.165+0000 7f335f200640 1 -- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f334006c970 msgr2=0x7f334006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.165+0000 7f335f200640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f334006c970 0x7f334006ee30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3350009650 tx=0x7f3350006ba0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.166+0000 7f335f200640 1 -- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3360154c70 msgr2=0x7f336015cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.166+0000 7f335f200640 1 --2- 172.21.15.163:0/2805750667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3360154c70 0x7f336015cff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f335800b970 tx=0x7f335800be30 comp rx=0 tx=0).stop 2024-04-01T17:05:34.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.166+0000 7f335e800640 1 -- 172.21.15.163:0/2805750667 reap_dead start 2024-04-01T17:05:34.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.166+0000 7f335f200640 1 -- 172.21.15.163:0/2805750667 shutdown_connections 2024-04-01T17:05:34.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.166+0000 7f335f200640 1 -- 172.21.15.163:0/2805750667 >> 172.21.15.163:0/2805750667 conn(0x7f3360067280 msgr2=0x7f33600cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:34.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.166+0000 7f335f200640 1 -- 172.21.15.163:0/2805750667 shutdown_connections 2024-04-01T17:05:34.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.166+0000 7f335f200640 1 -- 172.21.15.163:0/2805750667 wait complete. 2024-04-01T17:05:34.187 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-01T17:05:34.396 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.395+0000 7fc581c00640 1 Processor -- start 2024-04-01T17:05:34.396 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.396+0000 7fc581c00640 1 -- start start 2024-04-01T17:05:34.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.397+0000 7fc581c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc57c152440 0x7fc57c0c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:34.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.397+0000 7fc581c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc57c159310 con 0x7fc57c067650 2024-04-01T17:05:34.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.397+0000 7fc581c00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc57c06b540 con 0x7fc57c0c7cc0 2024-04-01T17:05:34.397 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.397+0000 7fc581c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fc57c0c7120 con 0x7fc57c152440 2024-04-01T17:05:34.398 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.398+0000 7fc57aa00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc57c152440 0x7fc57c0c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:34.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.398+0000 7fc57aa00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc57c152440 0x7fc57c0c5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50774/0 (socket says 172.21.15.163:50774) 2024-04-01T17:05:34.399 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.398+0000 7fc57aa00640 1 -- 172.21.15.163:0/389224899 learned_addr learned my addr 172.21.15.163:0/389224899 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:34.402 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.402+0000 7fc57aa00640 1 -- 172.21.15.163:0/389224899 >> v1:172.21.15.189:6789/0 conn(0x7fc57c0c7cc0 legacy=0x7fc57c162eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.402 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.402+0000 7fc57aa00640 1 -- 172.21.15.163:0/389224899 >> v1:172.21.15.163:6789/0 conn(0x7fc57c067650 legacy=0x7fc57c0c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.402 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.402+0000 7fc57aa00640 1 -- 172.21.15.163:0/389224899 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c06b820 con 0x7fc57c152440 2024-04-01T17:05:34.408 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.408+0000 7fc57aa00640 1 --2- 172.21.15.163:0/389224899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc57c152440 0x7fc57c0c5b90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc56c009870 tx=0x7fc56c02bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa72c4b31fd8896c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:34.416 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.415+0000 7fc579600640 1 -- 172.21.15.163:0/389224899 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c02d870 con 0x7fc57c152440 2024-04-01T17:05:34.416 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.415+0000 7fc579600640 1 -- 172.21.15.163:0/389224899 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c02da10 con 0x7fc57c152440 2024-04-01T17:05:34.416 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.415+0000 7fc579600640 1 -- 172.21.15.163:0/389224899 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c02dde0 con 0x7fc57c152440 2024-04-01T17:05:34.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.416+0000 7fc581c00640 1 -- 172.21.15.163:0/389224899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc57c152440 msgr2=0x7fc57c0c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.416+0000 7fc581c00640 1 --2- 172.21.15.163:0/389224899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc57c152440 0x7fc57c0c5b90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc56c009870 tx=0x7fc56c02bab0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.416+0000 7fc581c00640 1 -- 172.21.15.163:0/389224899 shutdown_connections 2024-04-01T17:05:34.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.416+0000 7fc581c00640 1 --2- 172.21.15.163:0/389224899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc57c152440 0x7fc57c0c5b90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.416+0000 7fc581c00640 1 -- 172.21.15.163:0/389224899 >> 172.21.15.163:0/389224899 conn(0x7fc57c0c8f80 msgr2=0x7fc57c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:34.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.416+0000 7fc581c00640 1 -- 172.21.15.163:0/389224899 shutdown_connections 2024-04-01T17:05:34.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.416+0000 7fc581c00640 1 -- 172.21.15.163:0/389224899 wait complete. 2024-04-01T17:05:34.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.418+0000 7fc581c00640 1 Processor -- start 2024-04-01T17:05:34.419 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.418+0000 7fc581c00640 1 -- start start 2024-04-01T17:05:34.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.419+0000 7fc581c00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc57c067650 0x7fc57c153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:34.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.419+0000 7fc581c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc57c0c7cc0 0x7fc57c14f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:34.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.419+0000 7fc581c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc57c152440 0x7fc57c157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:34.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.419+0000 7fc581c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c152820 con 0x7fc57c152440 2024-04-01T17:05:34.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.419+0000 7fc581c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c158fb0 con 0x7fc57c0c7cc0 2024-04-01T17:05:34.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.419+0000 7fc581c00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fc57c1529a0 con 0x7fc57c067650 2024-04-01T17:05:34.421 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.421+0000 7fc57b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc57c152440 0x7fc57c157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:34.421 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.421+0000 7fc57aa00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc57c067650 0x7fc57c153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:34.421 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.421+0000 7fc57b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc57c152440 0x7fc57c157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50780/0 (socket says 172.21.15.163:50780) 2024-04-01T17:05:34.421 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.421+0000 7fc57b400640 1 -- 172.21.15.163:0/3611192044 learned_addr learned my addr 172.21.15.163:0/3611192044 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:34.422 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.421+0000 7fc57a000640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc57c0c7cc0 0x7fc57c14f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:34.426 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.425+0000 7fc57b400640 1 -- 172.21.15.163:0/3611192044 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc57c067650 msgr2=0x7fc57c153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.426 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.425+0000 7fc57b400640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc57c067650 0x7fc57c153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.426 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.425+0000 7fc57b400640 1 -- 172.21.15.163:0/3611192044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc57c0c7cc0 msgr2=0x7fc57c14f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.426 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.425+0000 7fc57b400640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc57c0c7cc0 0x7fc57c14f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.426 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.425+0000 7fc57b400640 1 -- 172.21.15.163:0/3611192044 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c1ecf90 con 0x7fc57c152440 2024-04-01T17:05:34.428 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.428+0000 7fc57b400640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc57c152440 0x7fc57c157a70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc57400c7a0 tx=0x7fc57400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:34.431 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.430+0000 7fc572a00640 1 -- 172.21.15.163:0/3611192044 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574003b70 con 0x7fc57c152440 2024-04-01T17:05:34.431 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.431+0000 7fc581c00640 1 -- 172.21.15.163:0/3611192044 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57c150180 con 0x7fc57c152440 2024-04-01T17:05:34.431 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.431+0000 7fc581c00640 1 -- 172.21.15.163:0/3611192044 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc57c14e840 con 0x7fc57c152440 2024-04-01T17:05:34.432 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.432+0000 7fc581c00640 1 -- 172.21.15.163:0/3611192044 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc57c0756d0 con 0x7fc57c152440 2024-04-01T17:05:34.433 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.433+0000 7fc572a00640 1 -- 172.21.15.163:0/3611192044 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc574003d10 con 0x7fc57c152440 2024-04-01T17:05:34.433 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.433+0000 7fc572a00640 1 -- 172.21.15.163:0/3611192044 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57400aa70 con 0x7fc57c152440 2024-04-01T17:05:34.740 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.739+0000 7fc572a00640 1 -- 172.21.15.163:0/3611192044 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc57400ac10 con 0x7fc57c152440 2024-04-01T17:05:34.742 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.741+0000 7fc572a00640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc55c06c8f0 0x7fc55c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:34.742 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.742+0000 7fc57aa00640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc55c06c8f0 0x7fc55c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:34.744 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.743+0000 7fc57aa00640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc55c06c8f0 0x7fc55c06edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc56c036000 tx=0x7fc56c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:34.755 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.755+0000 7fc572a00640 1 -- 172.21.15.163:0/3611192044 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7fc574058240 con 0x7fc57c152440 2024-04-01T17:05:34.756 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.755+0000 7fc572a00640 1 -- 172.21.15.163:0/3611192044 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc57405a1a0 con 0x7fc57c152440 2024-04-01T17:05:34.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.965+0000 7fc581c00640 1 -- 172.21.15.163:0/3611192044 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fc57c0c5870 con 0x7fc55c06c8f0 2024-04-01T17:05:34.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.966+0000 7fc572a00640 1 -- 172.21.15.163:0/3611192044 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc57c0c5870 con 0x7fc55c06c8f0 2024-04-01T17:05:34.967 INFO:teuthology.orchestra.run.smithi163.stderr:instructed osd(s) 0 to deep-scrub 2024-04-01T17:05:34.969 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.968+0000 7fc581c00640 1 -- 172.21.15.163:0/3611192044 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc55c06c8f0 msgr2=0x7fc55c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.968+0000 7fc581c00640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc55c06c8f0 0x7fc55c06edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc56c036000 tx=0x7fc56c008030 comp rx=0 tx=0).stop 2024-04-01T17:05:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.969+0000 7fc581c00640 1 -- 172.21.15.163:0/3611192044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc57c152440 msgr2=0x7fc57c157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.969+0000 7fc581c00640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc57c152440 0x7fc57c157a70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc57400c7a0 tx=0x7fc57400cc60 comp rx=0 tx=0).stop 2024-04-01T17:05:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.969+0000 7fc581c00640 1 -- 172.21.15.163:0/3611192044 shutdown_connections 2024-04-01T17:05:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.969+0000 7fc581c00640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fc55c06c8f0 0x7fc55c06edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.969+0000 7fc581c00640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc57c152440 0x7fc57c157a70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.969+0000 7fc581c00640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc57c0c7cc0 0x7fc57c14f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.969+0000 7fc581c00640 1 --2- 172.21.15.163:0/3611192044 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fc57c067650 0x7fc57c153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.969+0000 7fc581c00640 1 -- 172.21.15.163:0/3611192044 >> 172.21.15.163:0/3611192044 conn(0x7fc57c0c8f80 msgr2=0x7fc57c06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.969+0000 7fc581c00640 1 -- 172.21.15.163:0/3611192044 shutdown_connections 2024-04-01T17:05:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:34.969+0000 7fc581c00640 1 -- 172.21.15.163:0/3611192044 wait complete. 2024-04-01T17:05:34.987 INFO:tasks.ceph:Scrubbing osd.1 2024-04-01T17:05:34.987 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-01T17:05:35.202 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.201+0000 7f7ea9400640 1 Processor -- start 2024-04-01T17:05:35.203 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.201+0000 7f7ea9400640 1 -- start start 2024-04-01T17:05:35.204 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.203+0000 7f7ea9400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ea40c5df0 0x7f7ea40cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:35.204 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.203+0000 7f7ea9400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea415aa50 con 0x7f7ea41513a0 2024-04-01T17:05:35.204 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.203+0000 7f7ea9400640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea415ad30 con 0x7f7ea408ccc0 2024-04-01T17:05:35.204 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.203+0000 7f7ea9400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea4151780 con 0x7f7ea40c5df0 2024-04-01T17:05:35.205 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.204+0000 7f7ea2800640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f7ea41513a0 0x7f7ea40d0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:59230/0 (socket says 172.21.15.163:59230) 2024-04-01T17:05:35.205 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.204+0000 7f7ea2800640 1 -- 172.21.15.163:0/664293293 learned_addr learned my addr 172.21.15.163:0/664293293 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:35.206 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.204+0000 7f7ea3200640 1 --2- 172.21.15.163:0/664293293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ea40c5df0 0x7f7ea40cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:35.207 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.207+0000 7f7ea1400640 1 -- 172.21.15.163:0/664293293 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694997997 0 0) 0x7f7ea415aa50 con 0x7f7ea41513a0 2024-04-01T17:05:35.207 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.207+0000 7f7ea1400640 1 -- 172.21.15.163:0/664293293 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e88003520 con 0x7f7ea41513a0 2024-04-01T17:05:35.209 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.209+0000 7f7ea3200640 1 -- 172.21.15.163:0/664293293 >> v1:172.21.15.189:6789/0 conn(0x7f7ea408ccc0 legacy=0x7f7ea40c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:35.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.209+0000 7f7ea3200640 1 -- 172.21.15.163:0/664293293 >> v1:172.21.15.163:6789/0 conn(0x7f7ea41513a0 legacy=0x7f7ea40d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:35.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.209+0000 7f7ea3200640 1 -- 172.21.15.163:0/664293293 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea415b010 con 0x7f7ea40c5df0 2024-04-01T17:05:35.213 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.212+0000 7f7ea3200640 1 --2- 172.21.15.163:0/664293293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ea40c5df0 0x7f7ea40cbd50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009dc0 tx=0x7f7e9c02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7650b49affc14769 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:35.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.221+0000 7f7ea1400640 1 -- 172.21.15.163:0/664293293 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c039070 con 0x7f7ea40c5df0 2024-04-01T17:05:35.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.221+0000 7f7ea1400640 1 -- 172.21.15.163:0/664293293 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9c02ccd0 con 0x7f7ea40c5df0 2024-04-01T17:05:35.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.221+0000 7f7ea1400640 1 -- 172.21.15.163:0/664293293 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c034660 con 0x7f7ea40c5df0 2024-04-01T17:05:35.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.222+0000 7f7ea9400640 1 -- 172.21.15.163:0/664293293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ea40c5df0 msgr2=0x7f7ea40cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:35.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.222+0000 7f7ea9400640 1 --2- 172.21.15.163:0/664293293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ea40c5df0 0x7f7ea40cbd50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009dc0 tx=0x7f7e9c02bf20 comp rx=0 tx=0).stop 2024-04-01T17:05:35.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.222+0000 7f7ea9400640 1 -- 172.21.15.163:0/664293293 shutdown_connections 2024-04-01T17:05:35.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.222+0000 7f7ea9400640 1 --2- 172.21.15.163:0/664293293 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ea40c5df0 0x7f7ea40cbd50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:35.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.222+0000 7f7ea9400640 1 -- 172.21.15.163:0/664293293 >> 172.21.15.163:0/664293293 conn(0x7f7ea406db20 msgr2=0x7f7ea406df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:35.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.222+0000 7f7ea9400640 1 -- 172.21.15.163:0/664293293 shutdown_connections 2024-04-01T17:05:35.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.222+0000 7f7ea9400640 1 -- 172.21.15.163:0/664293293 wait complete. 2024-04-01T17:05:35.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.224+0000 7f7ea9400640 1 Processor -- start 2024-04-01T17:05:35.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.224+0000 7f7ea9400640 1 -- start start 2024-04-01T17:05:35.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.225+0000 7f7ea9400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ea408ccc0 0x7f7ea414a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:35.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.225+0000 7f7ea9400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ea40c5df0 0x7f7ea40b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:35.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.225+0000 7f7ea9400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ea41513a0 0x7f7ea40b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:35.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.225+0000 7f7ea9400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea40b3000 con 0x7f7ea41513a0 2024-04-01T17:05:35.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.225+0000 7f7ea9400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea415b5d0 con 0x7f7ea40c5df0 2024-04-01T17:05:35.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.225+0000 7f7ea9400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea40b3180 con 0x7f7ea408ccc0 2024-04-01T17:05:35.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.226+0000 7f7ea3200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ea41513a0 0x7f7ea40b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:35.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.226+0000 7f7ea3200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ea41513a0 0x7f7ea40b4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50782/0 (socket says 172.21.15.163:50782) 2024-04-01T17:05:35.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.226+0000 7f7ea3200640 1 -- 172.21.15.163:0/334218635 learned_addr learned my addr 172.21.15.163:0/334218635 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:35.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.226+0000 7f7ea2800640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ea408ccc0 0x7f7ea414a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:35.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.227+0000 7f7ea1e00640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ea40c5df0 0x7f7ea40b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:35.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.230+0000 7f7ea3200640 1 -- 172.21.15.163:0/334218635 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ea408ccc0 msgr2=0x7f7ea414a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:35.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.230+0000 7f7ea3200640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7ea408ccc0 0x7f7ea414a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:35.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.230+0000 7f7ea3200640 1 -- 172.21.15.163:0/334218635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ea40c5df0 msgr2=0x7f7ea40b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:35.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.231+0000 7f7ea3200640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ea40c5df0 0x7f7ea40b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:35.232 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.231+0000 7f7ea3200640 1 -- 172.21.15.163:0/334218635 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea41e6b70 con 0x7f7ea41513a0 2024-04-01T17:05:35.234 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.234+0000 7f7ea3200640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ea41513a0 0x7f7ea40b4320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c02c530 tx=0x7f7e9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:35.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.238+0000 7f7e9aa00640 1 -- 172.21.15.163:0/334218635 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c044020 con 0x7f7ea41513a0 2024-04-01T17:05:35.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.238+0000 7f7e9aa00640 1 -- 172.21.15.163:0/334218635 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9c03f470 con 0x7f7ea41513a0 2024-04-01T17:05:35.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.238+0000 7f7e9aa00640 1 -- 172.21.15.163:0/334218635 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c039040 con 0x7f7ea41513a0 2024-04-01T17:05:35.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.238+0000 7f7ea9400640 1 -- 172.21.15.163:0/334218635 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea40ce930 con 0x7f7ea41513a0 2024-04-01T17:05:35.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.238+0000 7f7ea9400640 1 -- 172.21.15.163:0/334218635 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea40cfa30 con 0x7f7ea41513a0 2024-04-01T17:05:35.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.239+0000 7f7ea9400640 1 -- 172.21.15.163:0/334218635 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ea40756d0 con 0x7f7ea41513a0 2024-04-01T17:05:35.281 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.280+0000 7f7e9aa00640 1 -- 172.21.15.163:0/334218635 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e9c047020 con 0x7f7ea41513a0 2024-04-01T17:05:35.282 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.282+0000 7f7e9aa00640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f7e8406c970 0x7f7e8406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:35.283 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.283+0000 7f7ea2800640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f7e8406c970 0x7f7e8406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:35.284 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.284+0000 7f7ea2800640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f7e8406c970 0x7f7e8406ee30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e94005880 tx=0x7f7e94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:35.286 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.286+0000 7f7e9aa00640 1 -- 172.21.15.163:0/334218635 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f7e9c07aa30 con 0x7f7ea41513a0 2024-04-01T17:05:35.287 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.286+0000 7f7e9aa00640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] conn(0x7f7e84074c90 0x7f7e84077110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:35.287 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.286+0000 7f7e9aa00640 1 -- 172.21.15.163:0/334218635 --> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e9c02ccd0 con 0x7f7e84074c90 2024-04-01T17:05:35.287 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.287+0000 7f7ea1e00640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] conn(0x7f7e84074c90 0x7f7e84077110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:35.288 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.288+0000 7f7ea1e00640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] conn(0x7f7e84074c90 0x7f7e84077110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:35.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.290+0000 7f7e9aa00640 1 -- 172.21.15.163:0/334218635 <== osd.1 v2:172.21.15.163:6817/1379211103 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e9c02ccd0 con 0x7f7e84074c90 2024-04-01T17:05:35.301 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.300+0000 7f7e9aa00640 1 -- 172.21.15.163:0/334218635 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7e9c078c30 con 0x7f7ea41513a0 2024-04-01T17:05:35.309 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.308+0000 7f7ea9400640 1 -- 172.21.15.163:0/334218635 --> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7ea40b3720 con 0x7f7e84074c90 2024-04-01T17:05:35.309 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.309+0000 7f7e9aa00640 1 -- 172.21.15.163:0/334218635 <== osd.1 v2:172.21.15.163:6817/1379211103 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7ea40b3720 con 0x7f7e84074c90 2024-04-01T17:05:35.310 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-01T17:05:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T17:05:35.310 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-01T17:05:35.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.310+0000 7f7ea9400640 1 -- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] conn(0x7f7e84074c90 msgr2=0x7f7e84077110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:35.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.310+0000 7f7ea9400640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:6817/1379211103,v1:172.21.15.163:6820/1379211103] conn(0x7f7e84074c90 0x7f7e84077110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:35.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.310+0000 7f7ea9400640 1 -- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f7e8406c970 msgr2=0x7f7e8406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:35.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.310+0000 7f7ea9400640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f7e8406c970 0x7f7e8406ee30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e94005880 tx=0x7f7e94009040 comp rx=0 tx=0).stop 2024-04-01T17:05:35.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.310+0000 7f7ea9400640 1 -- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ea41513a0 msgr2=0x7f7ea40b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:35.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.310+0000 7f7ea9400640 1 --2- 172.21.15.163:0/334218635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ea41513a0 0x7f7ea40b4320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c02c530 tx=0x7f7e9c004a40 comp rx=0 tx=0).stop 2024-04-01T17:05:35.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.310+0000 7f7ea3200640 1 -- 172.21.15.163:0/334218635 reap_dead start 2024-04-01T17:05:35.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.310+0000 7f7ea9400640 1 -- 172.21.15.163:0/334218635 shutdown_connections 2024-04-01T17:05:35.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.310+0000 7f7ea9400640 1 -- 172.21.15.163:0/334218635 >> 172.21.15.163:0/334218635 conn(0x7f7ea406db20 msgr2=0x7f7ea4159350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:35.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.310+0000 7f7ea9400640 1 -- 172.21.15.163:0/334218635 shutdown_connections 2024-04-01T17:05:35.312 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.310+0000 7f7ea9400640 1 -- 172.21.15.163:0/334218635 wait complete. 2024-04-01T17:05:35.336 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-01T17:05:35.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.532+0000 7f7a23000640 1 Processor -- start 2024-04-01T17:05:35.533 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.532+0000 7f7a23000640 1 -- start start 2024-04-01T17:05:35.535 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.534+0000 7f7a23000640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7a1c0678d0 0x7f7a1c0ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:35.535 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.534+0000 7f7a23000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7a1c15e170 0x7f7a1c15e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:35.535 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.534+0000 7f7a23000640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a1c15dc90 con 0x7f7a1c0674f0 2024-04-01T17:05:35.535 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.534+0000 7f7a23000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f7a1c0cb630 con 0x7f7a1c15e170 2024-04-01T17:05:35.535 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.534+0000 7f7a23000640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f7a1c15eb60 con 0x7f7a1c0678d0 2024-04-01T17:05:35.536 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.535+0000 7f7a22600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7a1c15e170 0x7f7a1c15e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:35.536 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.535+0000 7f7a21c00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f7a1c0674f0 0x7f7a1c0c87b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:59236/0 (socket says 172.21.15.163:59236) 2024-04-01T17:05:35.536 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.535+0000 7f7a21c00640 1 -- 172.21.15.163:0/2699614304 learned_addr learned my addr 172.21.15.163:0/2699614304 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:35.536 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.536+0000 7f7a21200640 1 --2- 172.21.15.163:0/2699614304 >> v2:172.21.15.189:3300/0 conn(0x7f7a1c0678d0 0x7f7a1c0ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:35.542 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.542+0000 7f7a22600640 1 -- 172.21.15.163:0/2699614304 >> v2:172.21.15.189:3300/0 conn(0x7f7a1c0678d0 msgr2=0x7f7a1c0ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:35.542 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.542+0000 7f7a22600640 1 --2- 172.21.15.163:0/2699614304 >> v2:172.21.15.189:3300/0 conn(0x7f7a1c0678d0 0x7f7a1c0ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:35.542 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.542+0000 7f7a22600640 1 -- 172.21.15.163:0/2699614304 >> v1:172.21.15.163:6789/0 conn(0x7f7a1c0674f0 legacy=0x7f7a1c0c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:35.543 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.542+0000 7f7a22600640 1 -- 172.21.15.163:0/2699614304 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c15a720 con 0x7f7a1c15e170 2024-04-01T17:05:35.553 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.553+0000 7f7a22600640 1 --2- 172.21.15.163:0/2699614304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a1c15e170 0x7f7a1c15e620 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c15ece0 tx=0x7f7a1402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ddd5741e5dd18e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:35.636 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.635+0000 7f7a1be00640 1 -- 172.21.15.163:0/2699614304 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a14039070 con 0x7f7a1c15e170 2024-04-01T17:05:35.636 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.635+0000 7f7a1be00640 1 -- 172.21.15.163:0/2699614304 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a1402cc60 con 0x7f7a1c15e170 2024-04-01T17:05:35.636 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.635+0000 7f7a1be00640 1 -- 172.21.15.163:0/2699614304 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a14034660 con 0x7f7a1c15e170 2024-04-01T17:05:35.637 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.636+0000 7f7a23000640 1 -- 172.21.15.163:0/2699614304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a1c15e170 msgr2=0x7f7a1c15e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:35.637 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.636+0000 7f7a23000640 1 --2- 172.21.15.163:0/2699614304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a1c15e170 0x7f7a1c15e620 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c15ece0 tx=0x7f7a1402beb0 comp rx=0 tx=0).stop 2024-04-01T17:05:35.637 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.637+0000 7f7a23000640 1 -- 172.21.15.163:0/2699614304 shutdown_connections 2024-04-01T17:05:35.638 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.637+0000 7f7a23000640 1 --2- 172.21.15.163:0/2699614304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a1c15e170 0x7f7a1c15e620 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:35.638 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.637+0000 7f7a23000640 1 --2- 172.21.15.163:0/2699614304 >> v2:172.21.15.189:3300/0 conn(0x7f7a1c0678d0 0x7f7a1c0ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:35.638 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.637+0000 7f7a23000640 1 -- 172.21.15.163:0/2699614304 >> 172.21.15.163:0/2699614304 conn(0x7f7a1c0719e0 msgr2=0x7f7a1c071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:35.638 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.637+0000 7f7a23000640 1 -- 172.21.15.163:0/2699614304 shutdown_connections 2024-04-01T17:05:35.638 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.637+0000 7f7a23000640 1 -- 172.21.15.163:0/2699614304 wait complete. 2024-04-01T17:05:35.640 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.640+0000 7f7a23000640 1 Processor -- start 2024-04-01T17:05:35.641 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.640+0000 7f7a23000640 1 -- start start 2024-04-01T17:05:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.641+0000 7f7a23000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a1c0674f0 0x7f7a1c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.641+0000 7f7a23000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a1c0678d0 0x7f7a1c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.641+0000 7f7a23000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a1c15e170 0x7f7a1c1f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.641+0000 7f7a23000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c15afa0 con 0x7f7a1c15e170 2024-04-01T17:05:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.641+0000 7f7a23000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c15acc0 con 0x7f7a1c0674f0 2024-04-01T17:05:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.641+0000 7f7a23000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1c15b280 con 0x7f7a1c0678d0 2024-04-01T17:05:35.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.642+0000 7f7a22600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a1c15e170 0x7f7a1c1f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:35.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.643+0000 7f7a22600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a1c15e170 0x7f7a1c1f3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50794/0 (socket says 172.21.15.163:50794) 2024-04-01T17:05:35.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.643+0000 7f7a22600640 1 -- 172.21.15.163:0/4195794554 learned_addr learned my addr 172.21.15.163:0/4195794554 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:35.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.644+0000 7f7a21200640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a1c0678d0 0x7f7a1c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:35.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.647+0000 7f7a22600640 1 -- 172.21.15.163:0/4195794554 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a1c0678d0 msgr2=0x7f7a1c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:35.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.647+0000 7f7a22600640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a1c0678d0 0x7f7a1c06cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:35.647 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.647+0000 7f7a22600640 1 -- 172.21.15.163:0/4195794554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a1c0674f0 msgr2=0x7f7a1c06c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:35.648 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.647+0000 7f7a22600640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a1c0674f0 0x7f7a1c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:35.648 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.647+0000 7f7a22600640 1 -- 172.21.15.163:0/4195794554 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c14ddf0 con 0x7f7a1c15e170 2024-04-01T17:05:35.650 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.650+0000 7f7a22600640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a1c15e170 0x7f7a1c1f3af0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a1402c4c0 tx=0x7f7a14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:35.656 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.655+0000 7f7a19600640 1 -- 172.21.15.163:0/4195794554 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a14039050 con 0x7f7a1c15e170 2024-04-01T17:05:35.656 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.655+0000 7f7a19600640 1 -- 172.21.15.163:0/4195794554 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a14045070 con 0x7f7a1c15e170 2024-04-01T17:05:35.656 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.655+0000 7f7a19600640 1 -- 172.21.15.163:0/4195794554 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a14009450 con 0x7f7a1c15e170 2024-04-01T17:05:35.656 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.655+0000 7f7a23000640 1 -- 172.21.15.163:0/4195794554 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1c14a060 con 0x7f7a1c15e170 2024-04-01T17:05:35.656 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.655+0000 7f7a23000640 1 -- 172.21.15.163:0/4195794554 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1c14e350 con 0x7f7a1c15e170 2024-04-01T17:05:35.657 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.657+0000 7f7a23000640 1 -- 172.21.15.163:0/4195794554 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a1c15b4c0 con 0x7f7a1c15e170 2024-04-01T17:05:35.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.970+0000 7f7a19600640 1 -- 172.21.15.163:0/4195794554 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a1403e850 con 0x7f7a1c15e170 2024-04-01T17:05:35.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.971+0000 7f7a19600640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f79fc06c940 0x7f79fc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:35.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.972+0000 7f7a21c00640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f79fc06c940 0x7f79fc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:35.974 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:35.974+0000 7f7a21c00640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f79fc06c940 0x7f79fc06ee00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c000f60 tx=0x7f7a0c007a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:36.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.014+0000 7f7a19600640 1 -- 172.21.15.163:0/4195794554 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f7a1407afb0 con 0x7f7a1c15e170 2024-04-01T17:05:36.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.015+0000 7f7a19600640 1 -- 172.21.15.163:0/4195794554 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7a1c14ddf0 con 0x7f7a1c15e170 2024-04-01T17:05:36.230 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.229+0000 7f7a23000640 1 -- 172.21.15.163:0/4195794554 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f7a1c1541f0 con 0x7f79fc06c940 2024-04-01T17:05:36.231 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.230+0000 7f7a19600640 1 -- 172.21.15.163:0/4195794554 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7a1c1541f0 con 0x7f79fc06c940 2024-04-01T17:05:36.231 INFO:teuthology.orchestra.run.smithi163.stderr:instructed osd(s) 1 to deep-scrub 2024-04-01T17:05:36.234 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.233+0000 7f7a23000640 1 -- 172.21.15.163:0/4195794554 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f79fc06c940 msgr2=0x7f79fc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.233+0000 7f7a23000640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f79fc06c940 0x7f79fc06ee00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c000f60 tx=0x7f7a0c007a80 comp rx=0 tx=0).stop 2024-04-01T17:05:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.233+0000 7f7a23000640 1 -- 172.21.15.163:0/4195794554 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a1c15e170 msgr2=0x7f7a1c1f3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.233+0000 7f7a23000640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a1c15e170 0x7f7a1c1f3af0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a1402c4c0 tx=0x7f7a14004a40 comp rx=0 tx=0).stop 2024-04-01T17:05:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.234+0000 7f7a23000640 1 -- 172.21.15.163:0/4195794554 shutdown_connections 2024-04-01T17:05:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.234+0000 7f7a23000640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f79fc06c940 0x7f79fc06ee00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.234+0000 7f7a23000640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a1c15e170 0x7f7a1c1f3af0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.234+0000 7f7a23000640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7a1c0678d0 0x7f7a1c06cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.234+0000 7f7a23000640 1 --2- 172.21.15.163:0/4195794554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a1c0674f0 0x7f7a1c06c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.234+0000 7f7a23000640 1 -- 172.21.15.163:0/4195794554 >> 172.21.15.163:0/4195794554 conn(0x7f7a1c0719e0 msgr2=0x7f7a1c159cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.234+0000 7f7a23000640 1 -- 172.21.15.163:0/4195794554 shutdown_connections 2024-04-01T17:05:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.234+0000 7f7a23000640 1 -- 172.21.15.163:0/4195794554 wait complete. 2024-04-01T17:05:36.254 INFO:tasks.ceph:Scrubbing osd.2 2024-04-01T17:05:36.255 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-01T17:05:36.463 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.463+0000 7f5ed2200640 1 Processor -- start 2024-04-01T17:05:36.464 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.463+0000 7f5ed2200640 1 -- start start 2024-04-01T17:05:36.465 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.464+0000 7f5ed2200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5ecc06edd0 0x7f5ecc15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:36.465 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.464+0000 7f5ed2200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ecc0c35d0 con 0x7f5ecc070d00 2024-04-01T17:05:36.465 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.464+0000 7f5ed2200640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ecc0c38b0 con 0x7f5ecc154bd0 2024-04-01T17:05:36.465 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.464+0000 7f5ed2200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5ecc0c3b90 con 0x7f5ecc06edd0 2024-04-01T17:05:36.467 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.467+0000 7f5ecb400640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f5ecc154bd0 0x7f5ecc06b540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:48306/0 (socket says 172.21.15.163:48306) 2024-04-01T17:05:36.467 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.467+0000 7f5ecb400640 1 -- 172.21.15.163:0/544331588 learned_addr learned my addr 172.21.15.163:0/544331588 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:36.467 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.467+0000 7f5ec3e00640 1 --2- 172.21.15.163:0/544331588 >> v2:172.21.15.189:3300/0 conn(0x7f5ecc06edd0 0x7f5ecc15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:36.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.472+0000 7f5ecaa00640 1 -- 172.21.15.163:0/544331588 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1809719593 0 0) 0x7f5ecc0c35d0 con 0x7f5ecc070d00 2024-04-01T17:05:36.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.472+0000 7f5ecaa00640 1 -- 172.21.15.163:0/544331588 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eb0003520 con 0x7f5ecc070d00 2024-04-01T17:05:36.476 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.476+0000 7f5ec3e00640 1 -- 172.21.15.163:0/544331588 >> v1:172.21.15.189:6789/0 conn(0x7f5ecc154bd0 legacy=0x7f5ecc06b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.476 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.476+0000 7f5ec3e00640 1 -- 172.21.15.163:0/544331588 >> v1:172.21.15.163:6789/0 conn(0x7f5ecc070d00 legacy=0x7f5ecc071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.477 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.476+0000 7f5ec3e00640 1 -- 172.21.15.163:0/544331588 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc0c3e70 con 0x7f5ecc06edd0 2024-04-01T17:05:36.493 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.494+0000 7f5ec3e00640 1 --2- 172.21.15.163:0/544331588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ecc06edd0 0x7f5ecc15b1c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40097a0 tx=0x7f5eb402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8173dc03b515b3d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:36.502 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.502+0000 7f5ecaa00640 1 -- 172.21.15.163:0/544331588 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb402f810 con 0x7f5ecc06edd0 2024-04-01T17:05:36.503 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.502+0000 7f5ecaa00640 1 -- 172.21.15.163:0/544331588 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb402f9b0 con 0x7f5ecc06edd0 2024-04-01T17:05:36.503 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.502+0000 7f5ecaa00640 1 -- 172.21.15.163:0/544331588 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb402fd80 con 0x7f5ecc06edd0 2024-04-01T17:05:36.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.503+0000 7f5ed2200640 1 -- 172.21.15.163:0/544331588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ecc06edd0 msgr2=0x7f5ecc15b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.503+0000 7f5ed2200640 1 --2- 172.21.15.163:0/544331588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ecc06edd0 0x7f5ecc15b1c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40097a0 tx=0x7f5eb402b9f0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.503+0000 7f5ed2200640 1 -- 172.21.15.163:0/544331588 shutdown_connections 2024-04-01T17:05:36.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.503+0000 7f5ed2200640 1 --2- 172.21.15.163:0/544331588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ecc06edd0 0x7f5ecc15b1c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.503+0000 7f5ed2200640 1 -- 172.21.15.163:0/544331588 >> 172.21.15.163:0/544331588 conn(0x7f5ecc0ccf10 msgr2=0x7f5ecc0cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:36.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.504+0000 7f5ed2200640 1 -- 172.21.15.163:0/544331588 shutdown_connections 2024-04-01T17:05:36.505 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.504+0000 7f5ed2200640 1 -- 172.21.15.163:0/544331588 wait complete. 2024-04-01T17:05:36.507 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.507+0000 7f5ed2200640 1 Processor -- start 2024-04-01T17:05:36.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.508+0000 7f5ed2200640 1 -- start start 2024-04-01T17:05:36.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.509+0000 7f5ed2200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ecc06edd0 0x7f5ecc0ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:36.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.509+0000 7f5ed2200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ecc070d00 0x7f5ecc14bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:36.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.509+0000 7f5ed2200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ecc154bd0 0x7f5ecc1f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:36.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.509+0000 7f5ed2200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc06bc50 con 0x7f5ecc154bd0 2024-04-01T17:05:36.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.509+0000 7f5ed2200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc06f350 con 0x7f5ecc070d00 2024-04-01T17:05:36.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.509+0000 7f5ed2200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5ecc06bdd0 con 0x7f5ecc06edd0 2024-04-01T17:05:36.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.510+0000 7f5ecbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ecc154bd0 0x7f5ecc1f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:36.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.510+0000 7f5ecb400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ecc06edd0 0x7f5ecc0ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:36.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.511+0000 7f5ecbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ecc154bd0 0x7f5ecc1f06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50800/0 (socket says 172.21.15.163:50800) 2024-04-01T17:05:36.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.511+0000 7f5ecbe00640 1 -- 172.21.15.163:0/758490311 learned_addr learned my addr 172.21.15.163:0/758490311 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:36.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.511+0000 7f5ec3e00640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ecc070d00 0x7f5ecc14bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:36.517 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.517+0000 7f5ecbe00640 1 -- 172.21.15.163:0/758490311 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ecc06edd0 msgr2=0x7f5ecc0ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.517 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.517+0000 7f5ecbe00640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5ecc06edd0 0x7f5ecc0ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.517 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.517+0000 7f5ecbe00640 1 -- 172.21.15.163:0/758490311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ecc070d00 msgr2=0x7f5ecc14bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.517 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.517+0000 7f5ecbe00640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5ecc070d00 0x7f5ecc14bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.517 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.517+0000 7f5ecbe00640 1 -- 172.21.15.163:0/758490311 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc0adf10 con 0x7f5ecc154bd0 2024-04-01T17:05:36.521 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.521+0000 7f5ecbe00640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ecc154bd0 0x7f5ecc1f06e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400c6c0 tx=0x7f5ec400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:36.527 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.527+0000 7f5ec3400640 1 -- 172.21.15.163:0/758490311 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4003b70 con 0x7f5ecc154bd0 2024-04-01T17:05:36.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.527+0000 7f5ec3400640 1 -- 172.21.15.163:0/758490311 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec4003d10 con 0x7f5ecc154bd0 2024-04-01T17:05:36.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.527+0000 7f5ec3400640 1 -- 172.21.15.163:0/758490311 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4005310 con 0x7f5ecc154bd0 2024-04-01T17:05:36.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.527+0000 7f5ed2200640 1 -- 172.21.15.163:0/758490311 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ecc0ae1b0 con 0x7f5ecc154bd0 2024-04-01T17:05:36.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.527+0000 7f5ed2200640 1 -- 172.21.15.163:0/758490311 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ecc1f3fb0 con 0x7f5ecc154bd0 2024-04-01T17:05:36.529 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.529+0000 7f5ed2200640 1 -- 172.21.15.163:0/758490311 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ecc0756d0 con 0x7f5ecc154bd0 2024-04-01T17:05:36.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.560+0000 7f5ec3400640 1 -- 172.21.15.163:0/758490311 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ec40054b0 con 0x7f5ecc154bd0 2024-04-01T17:05:36.562 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.562+0000 7f5ec3400640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5ea806c970 0x7f5ea806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:36.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.562+0000 7f5ec3400640 1 -- 172.21.15.163:0/758490311 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f5ec40057a0 con 0x7f5ecc154bd0 2024-04-01T17:05:36.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.563+0000 7f5ecb400640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5ea806c970 0x7f5ea806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:36.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.563+0000 7f5ec3400640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] conn(0x7f5ea8074cf0 0x7f5ea8077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:36.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.563+0000 7f5ec3400640 1 -- 172.21.15.163:0/758490311 --> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ea8077840 con 0x7f5ea8074cf0 2024-04-01T17:05:36.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.564+0000 7f5ec3e00640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] conn(0x7f5ea8074cf0 0x7f5ea8077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:36.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.564+0000 7f5ecb400640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5ea806c970 0x7f5ea806ee30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc007fd0 tx=0x7f5ebc007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:36.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.565+0000 7f5ec3e00640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] conn(0x7f5ea8074cf0 0x7f5ea8077170 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:36.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.567+0000 7f5ec3400640 1 -- 172.21.15.163:0/758490311 <== osd.2 v2:172.21.15.163:6802/239774303 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ea8077840 con 0x7f5ea8074cf0 2024-04-01T17:05:36.588 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.587+0000 7f5ec3400640 1 -- 172.21.15.163:0/758490311 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5ec4056310 con 0x7f5ecc154bd0 2024-04-01T17:05:36.588 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.588+0000 7f5ed2200640 1 -- 172.21.15.163:0/758490311 --> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5ecc15afa0 con 0x7f5ea8074cf0 2024-04-01T17:05:36.589 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.588+0000 7f5ec3400640 1 -- 172.21.15.163:0/758490311 <== osd.2 v2:172.21.15.163:6802/239774303 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5ecc15afa0 con 0x7f5ea8074cf0 2024-04-01T17:05:36.589 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-01T17:05:36.589 INFO:teuthology.orchestra.run.smithi163.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T17:05:36.589 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-01T17:05:36.590 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.589+0000 7f5ed2200640 1 -- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] conn(0x7f5ea8074cf0 msgr2=0x7f5ea8077170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.590 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.589+0000 7f5ed2200640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:6802/239774303,v1:172.21.15.163:6803/239774303] conn(0x7f5ea8074cf0 0x7f5ea8077170 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.589+0000 7f5ed2200640 1 -- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5ea806c970 msgr2=0x7f5ea806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.589+0000 7f5ed2200640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5ea806c970 0x7f5ea806ee30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc007fd0 tx=0x7f5ebc007e80 comp rx=0 tx=0).stop 2024-04-01T17:05:36.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.589+0000 7f5ed2200640 1 -- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ecc154bd0 msgr2=0x7f5ecc1f06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.589+0000 7f5ed2200640 1 --2- 172.21.15.163:0/758490311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ecc154bd0 0x7f5ecc1f06e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400c6c0 tx=0x7f5ec400cb80 comp rx=0 tx=0).stop 2024-04-01T17:05:36.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.589+0000 7f5ecbe00640 1 -- 172.21.15.163:0/758490311 reap_dead start 2024-04-01T17:05:36.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.590+0000 7f5ed2200640 1 -- 172.21.15.163:0/758490311 shutdown_connections 2024-04-01T17:05:36.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.590+0000 7f5ed2200640 1 -- 172.21.15.163:0/758490311 >> 172.21.15.163:0/758490311 conn(0x7f5ecc0ccf10 msgr2=0x7f5ecc1522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:36.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.590+0000 7f5ed2200640 1 -- 172.21.15.163:0/758490311 shutdown_connections 2024-04-01T17:05:36.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.590+0000 7f5ed2200640 1 -- 172.21.15.163:0/758490311 wait complete. 2024-04-01T17:05:36.619 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-01T17:05:36.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.826+0000 7f6fb8c00640 1 Processor -- start 2024-04-01T17:05:36.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.826+0000 7f6fb8c00640 1 -- start start 2024-04-01T17:05:36.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.827+0000 7f6fb8c00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f6fb40cc7f0 0x7f6fb40ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:36.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.827+0000 7f6fb8c00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 0x7f6fb415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:36.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.827+0000 7f6fb8c00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb40cad10 con 0x7f6fb40ca760 2024-04-01T17:05:36.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.827+0000 7f6fb8c00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb415d9c0 con 0x7f6fb40cc7f0 2024-04-01T17:05:36.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.827+0000 7f6fb8c00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb415b610 con 0x7f6fb415bac0 2024-04-01T17:05:36.829 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.829+0000 7f6fb2a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 0x7f6fb415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:36.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.830+0000 7f6fb2a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 0x7f6fb415b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:34916/0 (socket says 172.21.15.163:34916) 2024-04-01T17:05:36.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.830+0000 7f6fb2a00640 1 -- 172.21.15.163:0/3756683581 learned_addr learned my addr 172.21.15.163:0/3756683581 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:36.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.830+0000 7f6fb3400640 1 --2- 172.21.15.163:0/3756683581 >> v2:172.21.15.189:3300/0 conn(0x7f6fb40cc7f0 0x7f6fb40ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:36.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.834+0000 7f6fb2a00640 1 -- 172.21.15.163:0/3756683581 >> v2:172.21.15.189:3300/0 conn(0x7f6fb40cc7f0 msgr2=0x7f6fb40ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:36.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.834+0000 7f6fb2a00640 1 --2- 172.21.15.163:0/3756683581 >> v2:172.21.15.189:3300/0 conn(0x7f6fb40cc7f0 0x7f6fb40ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.834+0000 7f6fb2a00640 1 -- 172.21.15.163:0/3756683581 >> v1:172.21.15.189:6789/0 conn(0x7f6fb40ca760 legacy=0x7f6fb406d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.834 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.834+0000 7f6fb2a00640 1 -- 172.21.15.163:0/3756683581 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb406ca80 con 0x7f6fb415bac0 2024-04-01T17:05:36.838 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.838+0000 7f6fb2a00640 1 --2- 172.21.15.163:0/3756683581 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 0x7f6fb415b0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009870 tx=0x7f6fa002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97e1b5bae73fa064 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:36.848 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.847+0000 7f6fb2000640 1 -- 172.21.15.163:0/3756683581 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0034070 con 0x7f6fb415bac0 2024-04-01T17:05:36.848 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.847+0000 7f6fb2000640 1 -- 172.21.15.163:0/3756683581 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa0030840 con 0x7f6fb415bac0 2024-04-01T17:05:36.848 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.847+0000 7f6fb2000640 1 -- 172.21.15.163:0/3756683581 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0030c10 con 0x7f6fb415bac0 2024-04-01T17:05:36.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.848+0000 7f6fb8c00640 1 -- 172.21.15.163:0/3756683581 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 msgr2=0x7f6fb415b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.848+0000 7f6fb8c00640 1 --2- 172.21.15.163:0/3756683581 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 0x7f6fb415b0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009870 tx=0x7f6fa002b980 comp rx=0 tx=0).stop 2024-04-01T17:05:36.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.848+0000 7f6fb8c00640 1 -- 172.21.15.163:0/3756683581 shutdown_connections 2024-04-01T17:05:36.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.848+0000 7f6fb8c00640 1 --2- 172.21.15.163:0/3756683581 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 0x7f6fb415b0d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.848+0000 7f6fb8c00640 1 --2- 172.21.15.163:0/3756683581 >> v2:172.21.15.189:3300/0 conn(0x7f6fb40cc7f0 0x7f6fb40ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.848+0000 7f6fb8c00640 1 -- 172.21.15.163:0/3756683581 >> 172.21.15.163:0/3756683581 conn(0x7f6fb40b1910 msgr2=0x7f6fb40b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:36.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.848+0000 7f6fb8c00640 1 -- 172.21.15.163:0/3756683581 shutdown_connections 2024-04-01T17:05:36.850 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.848+0000 7f6fb8c00640 1 -- 172.21.15.163:0/3756683581 wait complete. 2024-04-01T17:05:36.851 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.851+0000 7f6fb8c00640 1 Processor -- start 2024-04-01T17:05:36.852 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.851+0000 7f6fb8c00640 1 -- start start 2024-04-01T17:05:36.853 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.852+0000 7f6fb8c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fb40ca760 0x7f6fb40c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:36.853 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.852+0000 7f6fb8c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb40cc7f0 0x7f6fb40c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:36.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.853+0000 7f6fb8c00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 0x7f6fb4152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:36.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.853+0000 7f6fb8c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb406d040 con 0x7f6fb40ca760 2024-04-01T17:05:36.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.853+0000 7f6fb8c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb40caff0 con 0x7f6fb40cc7f0 2024-04-01T17:05:36.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.853+0000 7f6fb8c00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb406d320 con 0x7f6fb415bac0 2024-04-01T17:05:36.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.854+0000 7f6fb3e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 0x7f6fb4152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:36.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.854+0000 7f6fb2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb40cc7f0 0x7f6fb40c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:36.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.854+0000 7f6fb3e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 0x7f6fb4152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:34928/0 (socket says 172.21.15.163:34928) 2024-04-01T17:05:36.856 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.854+0000 7f6fb3e00640 1 -- 172.21.15.163:0/2207230294 learned_addr learned my addr 172.21.15.163:0/2207230294 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:36.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.860+0000 7f6fb3e00640 1 -- 172.21.15.163:0/2207230294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb40cc7f0 msgr2=0x7f6fb40c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.860+0000 7f6fb3e00640 1 --2- 172.21.15.163:0/2207230294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb40cc7f0 0x7f6fb40c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.860+0000 7f6fb3e00640 1 -- 172.21.15.163:0/2207230294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fb40ca760 msgr2=0x7f6fb40c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:36.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.860+0000 7f6fb3e00640 1 --2- 172.21.15.163:0/2207230294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fb40ca760 0x7f6fb40c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:36.861 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.860+0000 7f6fb3e00640 1 -- 172.21.15.163:0/2207230294 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb4152f10 con 0x7f6fb415bac0 2024-04-01T17:05:36.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.863+0000 7f6fb3e00640 1 --2- 172.21.15.163:0/2207230294 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 0x7f6fb4152110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00c6e0 tx=0x7f6fac00cba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:36.876 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.875+0000 7f6fab400640 1 -- 172.21.15.163:0/2207230294 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac003b70 con 0x7f6fb415bac0 2024-04-01T17:05:36.876 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.875+0000 7f6fab400640 1 -- 172.21.15.163:0/2207230294 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fac003d30 con 0x7f6fb415bac0 2024-04-01T17:05:36.876 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.875+0000 7f6fab400640 1 -- 172.21.15.163:0/2207230294 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac005310 con 0x7f6fb415bac0 2024-04-01T17:05:36.876 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.875+0000 7f6fb8c00640 1 -- 172.21.15.163:0/2207230294 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb41531f0 con 0x7f6fb415bac0 2024-04-01T17:05:36.877 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.876+0000 7f6fb8c00640 1 -- 172.21.15.163:0/2207230294 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb41537b0 con 0x7f6fb415bac0 2024-04-01T17:05:36.878 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:36.877+0000 7f6fb8c00640 1 -- 172.21.15.163:0/2207230294 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb40756d0 con 0x7f6fb415bac0 2024-04-01T17:05:37.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.224+0000 7f6fab400640 1 -- 172.21.15.163:0/2207230294 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6fac0054b0 con 0x7f6fb415bac0 2024-04-01T17:05:37.227 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.226+0000 7f6fab400640 1 --2- 172.21.15.163:0/2207230294 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6f9406c970 0x7f6f9406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:37.228 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.227+0000 7f6fb3400640 1 --2- 172.21.15.163:0/2207230294 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6f9406c970 0x7f6f9406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:37.229 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.229+0000 7f6fb3400640 1 --2- 172.21.15.163:0/2207230294 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6f9406c970 0x7f6f9406ee30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4006a90 tx=0x7f6fa4006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:37.235 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.235+0000 7f6fab400640 1 -- 172.21.15.163:0/2207230294 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f6fac0057a0 con 0x7f6fb415bac0 2024-04-01T17:05:37.269 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.268+0000 7f6fab400640 1 -- 172.21.15.163:0/2207230294 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6fac05a870 con 0x7f6fb415bac0 2024-04-01T17:05:37.479 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.478+0000 7f6fb8c00640 1 -- 172.21.15.163:0/2207230294 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f6fb406e3e0 con 0x7f6f9406c970 2024-04-01T17:05:37.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.479+0000 7f6fab400640 1 -- 172.21.15.163:0/2207230294 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6fb406e3e0 con 0x7f6f9406c970 2024-04-01T17:05:37.480 INFO:teuthology.orchestra.run.smithi163.stderr:instructed osd(s) 2 to deep-scrub 2024-04-01T17:05:37.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.482+0000 7f6fb8c00640 1 -- 172.21.15.163:0/2207230294 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6f9406c970 msgr2=0x7f6f9406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:37.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.482+0000 7f6fb8c00640 1 --2- 172.21.15.163:0/2207230294 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6f9406c970 0x7f6f9406ee30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4006a90 tx=0x7f6fa4006a20 comp rx=0 tx=0).stop 2024-04-01T17:05:37.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.482+0000 7f6fb8c00640 1 -- 172.21.15.163:0/2207230294 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 msgr2=0x7f6fb4152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:37.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.482+0000 7f6fb8c00640 1 --2- 172.21.15.163:0/2207230294 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 0x7f6fb4152110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00c6e0 tx=0x7f6fac00cba0 comp rx=0 tx=0).stop 2024-04-01T17:05:37.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.482+0000 7f6fb8c00640 1 -- 172.21.15.163:0/2207230294 shutdown_connections 2024-04-01T17:05:37.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.482+0000 7f6fb8c00640 1 --2- 172.21.15.163:0/2207230294 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f6f9406c970 0x7f6f9406ee30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:37.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.482+0000 7f6fb8c00640 1 --2- 172.21.15.163:0/2207230294 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f6fb415bac0 0x7f6fb4152110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:37.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.482+0000 7f6fb8c00640 1 --2- 172.21.15.163:0/2207230294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb40cc7f0 0x7f6fb40c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:37.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.482+0000 7f6fb8c00640 1 --2- 172.21.15.163:0/2207230294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fb40ca760 0x7f6fb40c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:37.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.482+0000 7f6fb8c00640 1 -- 172.21.15.163:0/2207230294 >> 172.21.15.163:0/2207230294 conn(0x7f6fb40b1910 msgr2=0x7f6fb40b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:37.484 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.482+0000 7f6fb8c00640 1 -- 172.21.15.163:0/2207230294 shutdown_connections 2024-04-01T17:05:37.484 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.483+0000 7f6fb8c00640 1 -- 172.21.15.163:0/2207230294 wait complete. 2024-04-01T17:05:37.501 INFO:tasks.ceph:Scrubbing osd.3 2024-04-01T17:05:37.502 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-01T17:05:37.713 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.713+0000 7f5f8bc00640 1 Processor -- start 2024-04-01T17:05:37.714 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.713+0000 7f5f8bc00640 1 -- start start 2024-04-01T17:05:37.715 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.714+0000 7f5f8bc00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f84152a10 0x7f5f8406eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:37.717 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.714+0000 7f5f8bc00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f5f840c4800 0x7f5f84158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:37.717 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.714+0000 7f5f8bc00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f840c7620 con 0x7f5f84158bb0 2024-04-01T17:05:37.717 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.715+0000 7f5f8bc00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f5f84152df0 con 0x7f5f840c4800 2024-04-01T17:05:37.717 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.715+0000 7f5f8bc00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5f8406ead0 con 0x7f5f84152a10 2024-04-01T17:05:37.718 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.716+0000 7f5f89200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f84152a10 0x7f5f8406eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:37.718 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.717+0000 7f5f89200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f84152a10 0x7f5f8406eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:34940/0 (socket says 172.21.15.163:34940) 2024-04-01T17:05:37.718 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.717+0000 7f5f89200640 1 -- 172.21.15.163:0/1857584359 learned_addr learned my addr 172.21.15.163:0/1857584359 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:37.718 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.717+0000 7f5f83e00640 1 --2- 172.21.15.163:0/1857584359 >> v2:172.21.15.189:3300/0 conn(0x7f5f840c4800 0x7f5f84158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:37.724 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.724+0000 7f5f89200640 1 -- 172.21.15.163:0/1857584359 >> v2:172.21.15.189:3300/0 conn(0x7f5f840c4800 msgr2=0x7f5f84158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:37.724 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.724+0000 7f5f89200640 1 --2- 172.21.15.163:0/1857584359 >> v2:172.21.15.189:3300/0 conn(0x7f5f840c4800 0x7f5f84158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:37.724 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.724+0000 7f5f89200640 1 -- 172.21.15.163:0/1857584359 >> v1:172.21.15.189:6789/0 conn(0x7f5f84158bb0 legacy=0x7f5f8415bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:37.724 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.724+0000 7f5f89200640 1 -- 172.21.15.163:0/1857584359 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f840c7890 con 0x7f5f84152a10 2024-04-01T17:05:37.729 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.730+0000 7f5f89200640 1 --2- 172.21.15.163:0/1857584359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f84152a10 0x7f5f8406eec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009870 tx=0x7f5f7802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c4536fb972744af server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:37.740 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.741+0000 7f5f83400640 1 -- 172.21.15.163:0/1857584359 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78034070 con 0x7f5f84152a10 2024-04-01T17:05:37.740 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.741+0000 7f5f83400640 1 -- 172.21.15.163:0/1857584359 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f78030840 con 0x7f5f84152a10 2024-04-01T17:05:37.740 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.741+0000 7f5f83400640 1 -- 172.21.15.163:0/1857584359 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78030c10 con 0x7f5f84152a10 2024-04-01T17:05:37.741 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.741+0000 7f5f8bc00640 1 -- 172.21.15.163:0/1857584359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f84152a10 msgr2=0x7f5f8406eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:37.741 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.741+0000 7f5f8bc00640 1 --2- 172.21.15.163:0/1857584359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f84152a10 0x7f5f8406eec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009870 tx=0x7f5f7802b980 comp rx=0 tx=0).stop 2024-04-01T17:05:37.741 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.741+0000 7f5f8bc00640 1 -- 172.21.15.163:0/1857584359 shutdown_connections 2024-04-01T17:05:37.741 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.741+0000 7f5f8bc00640 1 --2- 172.21.15.163:0/1857584359 >> v2:172.21.15.189:3300/0 conn(0x7f5f840c4800 0x7f5f84158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:37.741 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.741+0000 7f5f8bc00640 1 --2- 172.21.15.163:0/1857584359 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f84152a10 0x7f5f8406eec0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:37.742 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.741+0000 7f5f8bc00640 1 -- 172.21.15.163:0/1857584359 >> 172.21.15.163:0/1857584359 conn(0x7f5f840c8a00 msgr2=0x7f5f840c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:37.742 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.741+0000 7f5f8bc00640 1 -- 172.21.15.163:0/1857584359 shutdown_connections 2024-04-01T17:05:37.742 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.741+0000 7f5f8bc00640 1 -- 172.21.15.163:0/1857584359 wait complete. 2024-04-01T17:05:37.744 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.743+0000 7f5f8bc00640 1 Processor -- start 2024-04-01T17:05:37.744 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.744+0000 7f5f8bc00640 1 -- start start 2024-04-01T17:05:37.745 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.745+0000 7f5f8bc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f840c4800 0x7f5f841ebea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:37.746 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.745+0000 7f5f8bc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f84152a10 0x7f5f84153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:37.746 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.745+0000 7f5f8bc00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f84158bb0 0x7f5f84154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:37.746 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.745+0000 7f5f8bc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5f840c8130 con 0x7f5f84152a10 2024-04-01T17:05:37.746 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.745+0000 7f5f8bc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5f840c7e50 con 0x7f5f840c4800 2024-04-01T17:05:37.746 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.745+0000 7f5f8bc00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f5f8406e6b0 con 0x7f5f84158bb0 2024-04-01T17:05:37.746 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.746+0000 7f5f83e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f84152a10 0x7f5f84153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:37.747 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.746+0000 7f5f83e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f84152a10 0x7f5f84153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50826/0 (socket says 172.21.15.163:50826) 2024-04-01T17:05:37.747 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.746+0000 7f5f83e00640 1 -- 172.21.15.163:0/3327564516 learned_addr learned my addr 172.21.15.163:0/3327564516 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:37.747 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.747+0000 7f5f89200640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f840c4800 0x7f5f841ebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:37.747 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.747+0000 7f5f89c00640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f84158bb0 0x7f5f84154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:37.752 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.752+0000 7f5f83e00640 1 -- 172.21.15.163:0/3327564516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f84158bb0 msgr2=0x7f5f84154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:37.752 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.752+0000 7f5f83e00640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5f84158bb0 0x7f5f84154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:37.752 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.752+0000 7f5f83e00640 1 -- 172.21.15.163:0/3327564516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f840c4800 msgr2=0x7f5f841ebea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:37.753 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.752+0000 7f5f83e00640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f840c4800 0x7f5f841ebea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:37.753 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.752+0000 7f5f83e00640 1 -- 172.21.15.163:0/3327564516 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8414c7b0 con 0x7f5f84152a10 2024-04-01T17:05:37.756 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.755+0000 7f5f83e00640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f84152a10 0x7f5f84153780 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000e9e0 tx=0x7f5f7000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:37.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.762+0000 7f5f80c00640 1 -- 172.21.15.163:0/3327564516 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70017070 con 0x7f5f84152a10 2024-04-01T17:05:37.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.764+0000 7f5f80c00640 1 -- 172.21.15.163:0/3327564516 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f7000c9d0 con 0x7f5f84152a10 2024-04-01T17:05:37.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.764+0000 7f5f80c00640 1 -- 172.21.15.163:0/3327564516 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000cdc0 con 0x7f5f84152a10 2024-04-01T17:05:37.764 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.764+0000 7f5f8bc00640 1 -- 172.21.15.163:0/3327564516 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f841577c0 con 0x7f5f84152a10 2024-04-01T17:05:37.764 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.764+0000 7f5f8bc00640 1 -- 172.21.15.163:0/3327564516 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f84157d80 con 0x7f5f84152a10 2024-04-01T17:05:37.765 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.764+0000 7f5f8bc00640 1 -- 172.21.15.163:0/3327564516 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5f840c63d0 con 0x7f5f84152a10 2024-04-01T17:05:37.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.796+0000 7f5f80c00640 1 -- 172.21.15.163:0/3327564516 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f7001a070 con 0x7f5f84152a10 2024-04-01T17:05:37.797 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.796+0000 7f5f80c00640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5f6406c970 0x7f5f6406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:37.797 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.797+0000 7f5f89200640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5f6406c970 0x7f5f6406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:37.798 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.798+0000 7f5f89200640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5f6406c970 0x7f5f6406ee30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5f78036000 tx=0x7f5f78008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:37.802 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.803+0000 7f5f80c00640 1 -- 172.21.15.163:0/3327564516 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f5f700580d0 con 0x7f5f84152a10 2024-04-01T17:05:37.803 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.803+0000 7f5f80c00640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] conn(0x7f5f64074cf0 0x7f5f64077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:37.803 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.803+0000 7f5f80c00640 1 -- 172.21.15.163:0/3327564516 --> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f7001bec0 con 0x7f5f64074cf0 2024-04-01T17:05:37.803 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.803+0000 7f5f80c00640 1 -- 172.21.15.163:0/3327564516 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5f700562d0 con 0x7f5f84152a10 2024-04-01T17:05:37.803 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.803+0000 7f5f89c00640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] conn(0x7f5f64074cf0 0x7f5f64077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:37.804 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.804+0000 7f5f89c00640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] conn(0x7f5f64074cf0 0x7f5f64077170 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:37.807 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.807+0000 7f5f80c00640 1 -- 172.21.15.163:0/3327564516 <== osd.3 v2:172.21.15.163:6816/3700943422 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5f7001bec0 con 0x7f5f64074cf0 2024-04-01T17:05:37.825 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.824+0000 7f5f8bc00640 1 -- 172.21.15.163:0/3327564516 --> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5f840752a0 con 0x7f5f64074cf0 2024-04-01T17:05:37.826 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.825+0000 7f5f80c00640 1 -- 172.21.15.163:0/3327564516 <== osd.3 v2:172.21.15.163:6816/3700943422 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5f840752a0 con 0x7f5f64074cf0 2024-04-01T17:05:37.826 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-01T17:05:37.826 INFO:teuthology.orchestra.run.smithi163.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T17:05:37.826 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-01T17:05:37.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.826+0000 7f5f8bc00640 1 -- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] conn(0x7f5f64074cf0 msgr2=0x7f5f64077170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:37.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.826+0000 7f5f8bc00640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:6816/3700943422,v1:172.21.15.163:6819/3700943422] conn(0x7f5f64074cf0 0x7f5f64077170 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:37.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.826+0000 7f5f8bc00640 1 -- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5f6406c970 msgr2=0x7f5f6406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:37.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.826+0000 7f5f8bc00640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f5f6406c970 0x7f5f6406ee30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5f78036000 tx=0x7f5f78008030 comp rx=0 tx=0).stop 2024-04-01T17:05:37.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.826+0000 7f5f8bc00640 1 -- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f84152a10 msgr2=0x7f5f84153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:37.827 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.826+0000 7f5f8bc00640 1 --2- 172.21.15.163:0/3327564516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f84152a10 0x7f5f84153780 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000e9e0 tx=0x7f5f7000eea0 comp rx=0 tx=0).stop 2024-04-01T17:05:37.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.826+0000 7f5f89c00640 1 -- 172.21.15.163:0/3327564516 reap_dead start 2024-04-01T17:05:37.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.826+0000 7f5f8bc00640 1 -- 172.21.15.163:0/3327564516 shutdown_connections 2024-04-01T17:05:37.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.826+0000 7f5f8bc00640 1 -- 172.21.15.163:0/3327564516 >> 172.21.15.163:0/3327564516 conn(0x7f5f840c8a00 msgr2=0x7f5f840c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:37.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.826+0000 7f5f8bc00640 1 -- 172.21.15.163:0/3327564516 shutdown_connections 2024-04-01T17:05:37.828 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:37.826+0000 7f5f8bc00640 1 -- 172.21.15.163:0/3327564516 wait complete. 2024-04-01T17:05:37.851 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-01T17:05:38.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.047+0000 7ff330e00640 1 Processor -- start 2024-04-01T17:05:38.047 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.047+0000 7ff330e00640 1 -- start start 2024-04-01T17:05:38.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.048+0000 7ff330e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff32c152830 0x7ff32c072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:38.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.048+0000 7ff330e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff32c0c6b30 0x7ff32c072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:38.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.048+0000 7ff330e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff32c071ee0 0x7ff32c15ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:38.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.048+0000 7ff330e00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7ff32c152c10 con 0x7ff32c152830 2024-04-01T17:05:38.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.049+0000 7ff330e00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff32c0737f0 con 0x7ff32c0c6b30 2024-04-01T17:05:38.049 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.049+0000 7ff330e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff32c0c72d0 con 0x7ff32c071ee0 2024-04-01T17:05:38.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.050+0000 7ff32a800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff32c071ee0 0x7ff32c15ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:38.050 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.051+0000 7ff323e00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff32c0c6b30 0x7ff32c072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:38.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.052+0000 7ff32a800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff32c071ee0 0x7ff32c15ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:34960/0 (socket says 172.21.15.163:34960) 2024-04-01T17:05:38.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.052+0000 7ff32a800640 1 -- 172.21.15.163:0/3299106445 learned_addr learned my addr 172.21.15.163:0/3299106445 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.058+0000 7ff323e00640 1 -- 172.21.15.163:0/3299106445 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff32c071ee0 msgr2=0x7ff32c15ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.058+0000 7ff323e00640 1 --2- 172.21.15.163:0/3299106445 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff32c071ee0 0x7ff32c15ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.058+0000 7ff323e00640 1 -- 172.21.15.163:0/3299106445 >> v2:172.21.15.163:3300/0 conn(0x7ff32c152830 msgr2=0x7ff32c072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.058+0000 7ff323e00640 1 --2- 172.21.15.163:0/3299106445 >> v2:172.21.15.163:3300/0 conn(0x7ff32c152830 0x7ff32c072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.058+0000 7ff323e00640 1 -- 172.21.15.163:0/3299106445 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c0c75b0 con 0x7ff32c0c6b30 2024-04-01T17:05:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.058+0000 7ff32a800640 1 --2- 172.21.15.163:0/3299106445 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff32c071ee0 0x7ff32c15ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T17:05:38.063 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.063+0000 7ff323e00640 1 --2- 172.21.15.163:0/3299106445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c0c6b30 0x7ff32c072e40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff32c156070 tx=0x7ff31402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a57396a5f98c704 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:38.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.075+0000 7ff329400640 1 -- 172.21.15.163:0/3299106445 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3140315a0 con 0x7ff32c0c6b30 2024-04-01T17:05:38.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.075+0000 7ff329400640 1 -- 172.21.15.163:0/3299106445 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff314037070 con 0x7ff32c0c6b30 2024-04-01T17:05:38.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.075+0000 7ff329400640 1 -- 172.21.15.163:0/3299106445 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff314031960 con 0x7ff32c0c6b30 2024-04-01T17:05:38.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.076+0000 7ff330e00640 1 -- 172.21.15.163:0/3299106445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c0c6b30 msgr2=0x7ff32c072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:38.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.076+0000 7ff330e00640 1 --2- 172.21.15.163:0/3299106445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c0c6b30 0x7ff32c072e40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff32c156070 tx=0x7ff31402b840 comp rx=0 tx=0).stop 2024-04-01T17:05:38.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.076+0000 7ff330e00640 1 -- 172.21.15.163:0/3299106445 shutdown_connections 2024-04-01T17:05:38.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.076+0000 7ff330e00640 1 --2- 172.21.15.163:0/3299106445 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff32c071ee0 0x7ff32c15ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.076+0000 7ff330e00640 1 --2- 172.21.15.163:0/3299106445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c0c6b30 0x7ff32c072e40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.076+0000 7ff330e00640 1 --2- 172.21.15.163:0/3299106445 >> v2:172.21.15.163:3300/0 conn(0x7ff32c152830 0x7ff32c072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.076+0000 7ff330e00640 1 -- 172.21.15.163:0/3299106445 >> 172.21.15.163:0/3299106445 conn(0x7ff32c0cbe20 msgr2=0x7ff32c0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:38.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.076+0000 7ff330e00640 1 -- 172.21.15.163:0/3299106445 shutdown_connections 2024-04-01T17:05:38.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.076+0000 7ff330e00640 1 -- 172.21.15.163:0/3299106445 wait complete. 2024-04-01T17:05:38.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.078+0000 7ff330e00640 1 Processor -- start 2024-04-01T17:05:38.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.078+0000 7ff330e00640 1 -- start start 2024-04-01T17:05:38.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.079+0000 7ff330e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff32c071ee0 0x7ff32c1f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:38.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.079+0000 7ff330e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff32c0c6b30 0x7ff32c0c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:38.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.079+0000 7ff330e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c152830 0x7ff32c156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:38.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.079+0000 7ff330e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c073a90 con 0x7ff32c071ee0 2024-04-01T17:05:38.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.079+0000 7ff330e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c0c7b70 con 0x7ff32c152830 2024-04-01T17:05:38.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.079+0000 7ff330e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff32c0707f0 con 0x7ff32c0c6b30 2024-04-01T17:05:38.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.080+0000 7ff329e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff32c071ee0 0x7ff32c1f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:38.080 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.080+0000 7ff329e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff32c071ee0 0x7ff32c1f06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50836/0 (socket says 172.21.15.163:50836) 2024-04-01T17:05:38.080 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.080+0000 7ff329e00640 1 -- 172.21.15.163:0/1655480087 learned_addr learned my addr 172.21.15.163:0/1655480087 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:38.080 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.081+0000 7ff32a800640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c152830 0x7ff32c156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:38.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.084+0000 7ff329e00640 1 -- 172.21.15.163:0/1655480087 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff32c0c6b30 msgr2=0x7ff32c0c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:38.083 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.084+0000 7ff329e00640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff32c0c6b30 0x7ff32c0c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.084+0000 7ff329e00640 1 -- 172.21.15.163:0/1655480087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c152830 msgr2=0x7ff32c156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:38.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.084+0000 7ff329e00640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c152830 0x7ff32c156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.084+0000 7ff329e00640 1 -- 172.21.15.163:0/1655480087 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c1f3e60 con 0x7ff32c071ee0 2024-04-01T17:05:38.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.087+0000 7ff329e00640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff32c071ee0 0x7ff32c1f06d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00b4a0 tx=0x7ff31c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:38.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.091+0000 7ff322000640 1 -- 172.21.15.163:0/1655480087 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c014070 con 0x7ff32c071ee0 2024-04-01T17:05:38.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.091+0000 7ff322000640 1 -- 172.21.15.163:0/1655480087 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff31c010610 con 0x7ff32c071ee0 2024-04-01T17:05:38.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.091+0000 7ff322000640 1 -- 172.21.15.163:0/1655480087 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c010a00 con 0x7ff32c071ee0 2024-04-01T17:05:38.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.091+0000 7ff330e00640 1 -- 172.21.15.163:0/1655480087 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32c1f4140 con 0x7ff32c071ee0 2024-04-01T17:05:38.091 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.091+0000 7ff330e00640 1 -- 172.21.15.163:0/1655480087 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32c1f4700 con 0x7ff32c071ee0 2024-04-01T17:05:38.091 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.092+0000 7ff330e00640 1 -- 172.21.15.163:0/1655480087 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff32c0756d0 con 0x7ff32c071ee0 2024-04-01T17:05:38.113 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.114+0000 7ff322000640 1 -- 172.21.15.163:0/1655480087 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff31c017070 con 0x7ff32c071ee0 2024-04-01T17:05:38.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.115+0000 7ff322000640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff30806c940 0x7ff30806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:38.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.116+0000 7ff323e00640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff30806c940 0x7ff30806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:38.116 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.117+0000 7ff323e00640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff30806c940 0x7ff30806ee00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff314036000 tx=0x7ff314030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:38.288 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.288+0000 7ff322000640 1 -- 172.21.15.163:0/1655480087 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7ff31c057790 con 0x7ff32c071ee0 2024-04-01T17:05:38.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.418+0000 7ff322000640 1 -- 172.21.15.163:0/1655480087 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff31c0596f0 con 0x7ff32c071ee0 2024-04-01T17:05:38.644 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.645+0000 7ff330e00640 1 -- 172.21.15.163:0/1655480087 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7ff32c0726e0 con 0x7ff30806c940 2024-04-01T17:05:38.645 INFO:teuthology.orchestra.run.smithi163.stderr:instructed osd(s) 3 to deep-scrub 2024-04-01T17:05:38.646 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.646+0000 7ff322000640 1 -- 172.21.15.163:0/1655480087 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff32c0726e0 con 0x7ff30806c940 2024-04-01T17:05:38.648 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.649+0000 7ff330e00640 1 -- 172.21.15.163:0/1655480087 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff30806c940 msgr2=0x7ff30806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:38.648 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.649+0000 7ff330e00640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff30806c940 0x7ff30806ee00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff314036000 tx=0x7ff314030000 comp rx=0 tx=0).stop 2024-04-01T17:05:38.648 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.649+0000 7ff330e00640 1 -- 172.21.15.163:0/1655480087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff32c071ee0 msgr2=0x7ff32c1f06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:38.649 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.649+0000 7ff330e00640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff32c071ee0 0x7ff32c1f06d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00b4a0 tx=0x7ff31c00b960 comp rx=0 tx=0).stop 2024-04-01T17:05:38.649 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.649+0000 7ff330e00640 1 -- 172.21.15.163:0/1655480087 shutdown_connections 2024-04-01T17:05:38.649 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.649+0000 7ff330e00640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff30806c940 0x7ff30806ee00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.649 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.649+0000 7ff330e00640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c152830 0x7ff32c156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.649 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.649+0000 7ff330e00640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff32c0c6b30 0x7ff32c0c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.649 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.649+0000 7ff330e00640 1 --2- 172.21.15.163:0/1655480087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff32c071ee0 0x7ff32c1f06d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.649 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.649+0000 7ff330e00640 1 -- 172.21.15.163:0/1655480087 >> 172.21.15.163:0/1655480087 conn(0x7ff32c0cbe20 msgr2=0x7ff32c14fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:38.649 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.649+0000 7ff330e00640 1 -- 172.21.15.163:0/1655480087 shutdown_connections 2024-04-01T17:05:38.650 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.649+0000 7ff330e00640 1 -- 172.21.15.163:0/1655480087 wait complete. 2024-04-01T17:05:38.668 INFO:tasks.ceph:Scrubbing osd.4 2024-04-01T17:05:38.669 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-01T17:05:38.862 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.863+0000 7f3801a00640 1 Processor -- start 2024-04-01T17:05:38.863 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.863+0000 7f3801a00640 1 -- start start 2024-04-01T17:05:38.864 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.865+0000 7f3801a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f37fc0c56e0 0x7f37fc0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:38.865 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.865+0000 7f3801a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 0x7f37fc150f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:38.865 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.865+0000 7f3801a00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37fc0c70f0 con 0x7f37fc151460 2024-04-01T17:05:38.865 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.865+0000 7f3801a00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f37fc0c2fe0 con 0x7f37fc0c56e0 2024-04-01T17:05:38.865 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.865+0000 7f3801a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f37fc0c32c0 con 0x7f37fc0c5ac0 2024-04-01T17:05:38.866 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.866+0000 7f37fb400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 0x7f37fc150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:38.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.868+0000 7f37fb400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 0x7f37fc150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:34986/0 (socket says 172.21.15.163:34986) 2024-04-01T17:05:38.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.868+0000 7f37fb400640 1 -- 172.21.15.163:0/2907312275 learned_addr learned my addr 172.21.15.163:0/2907312275 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:38.867 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.868+0000 7f37fbe00640 1 --2- 172.21.15.163:0/2907312275 >> v2:172.21.15.189:3300/0 conn(0x7f37fc0c56e0 0x7f37fc0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:38.873 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.874+0000 7f37fb400640 1 -- 172.21.15.163:0/2907312275 >> v2:172.21.15.189:3300/0 conn(0x7f37fc0c56e0 msgr2=0x7f37fc0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:38.874 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.874+0000 7f37fb400640 1 --2- 172.21.15.163:0/2907312275 >> v2:172.21.15.189:3300/0 conn(0x7f37fc0c56e0 0x7f37fc0c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.874 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.874+0000 7f37fb400640 1 -- 172.21.15.163:0/2907312275 >> v1:172.21.15.189:6789/0 conn(0x7f37fc151460 legacy=0x7f37fc0c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:38.874 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.874+0000 7f37fb400640 1 -- 172.21.15.163:0/2907312275 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc0c35a0 con 0x7f37fc0c5ac0 2024-04-01T17:05:38.882 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.883+0000 7f37fb400640 1 --2- 172.21.15.163:0/2907312275 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 0x7f37fc150f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009870 tx=0x7f37e802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf41d28577c3fc76 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:38.989 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.989+0000 7f37faa00640 1 -- 172.21.15.163:0/2907312275 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e802f840 con 0x7f37fc0c5ac0 2024-04-01T17:05:38.989 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.989+0000 7f37faa00640 1 -- 172.21.15.163:0/2907312275 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e802f9e0 con 0x7f37fc0c5ac0 2024-04-01T17:05:38.989 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.989+0000 7f37faa00640 1 -- 172.21.15.163:0/2907312275 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e802fdb0 con 0x7f37fc0c5ac0 2024-04-01T17:05:38.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.991+0000 7f3801a00640 1 -- 172.21.15.163:0/2907312275 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 msgr2=0x7f37fc150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:38.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.991+0000 7f3801a00640 1 --2- 172.21.15.163:0/2907312275 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 0x7f37fc150f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009870 tx=0x7f37e802ba20 comp rx=0 tx=0).stop 2024-04-01T17:05:38.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.991+0000 7f3801a00640 1 -- 172.21.15.163:0/2907312275 shutdown_connections 2024-04-01T17:05:38.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.991+0000 7f3801a00640 1 --2- 172.21.15.163:0/2907312275 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 0x7f37fc150f20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.991+0000 7f3801a00640 1 --2- 172.21.15.163:0/2907312275 >> v2:172.21.15.189:3300/0 conn(0x7f37fc0c56e0 0x7f37fc0c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:38.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.991+0000 7f3801a00640 1 -- 172.21.15.163:0/2907312275 >> 172.21.15.163:0/2907312275 conn(0x7f37fc06f750 msgr2=0x7f37fc06fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:38.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.991+0000 7f3801a00640 1 -- 172.21.15.163:0/2907312275 shutdown_connections 2024-04-01T17:05:38.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.991+0000 7f3801a00640 1 -- 172.21.15.163:0/2907312275 wait complete. 2024-04-01T17:05:38.995 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.996+0000 7f3801a00640 1 Processor -- start 2024-04-01T17:05:38.995 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.996+0000 7f3801a00640 1 -- start start 2024-04-01T17:05:38.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.998+0000 7f3801a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37fc0c56e0 0x7f37fc1402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:38.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.998+0000 7f3801a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 0x7f37fc073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:38.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.998+0000 7f3801a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37fc151460 0x7f37fc14c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:38.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.998+0000 7f3801a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc151a50 con 0x7f37fc151460 2024-04-01T17:05:38.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.998+0000 7f3801a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc1518d0 con 0x7f37fc0c56e0 2024-04-01T17:05:38.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.998+0000 7f3801a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f37fc1574d0 con 0x7f37fc0c5ac0 2024-04-01T17:05:38.999 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:38.999+0000 7f37fb400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 0x7f37fc073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:38.999 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.000+0000 7f37fb400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 0x7f37fc073380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:34998/0 (socket says 172.21.15.163:34998) 2024-04-01T17:05:38.999 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.000+0000 7f37fb400640 1 -- 172.21.15.163:0/680469172 learned_addr learned my addr 172.21.15.163:0/680469172 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:39.001 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.002+0000 7f3801000640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37fc151460 0x7f37fc14c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:39.004 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.004+0000 7f37fb400640 1 -- 172.21.15.163:0/680469172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37fc0c56e0 msgr2=0x7f37fc1402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:39.004 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.004+0000 7f37fb400640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37fc0c56e0 0x7f37fc1402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.004 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.004+0000 7f37fb400640 1 -- 172.21.15.163:0/680469172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37fc151460 msgr2=0x7f37fc14c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:39.004 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.004+0000 7f37fb400640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37fc151460 0x7f37fc14c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.004 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.004+0000 7f37fb400640 1 -- 172.21.15.163:0/680469172 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc144300 con 0x7f37fc0c5ac0 2024-04-01T17:05:39.009 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.009+0000 7f37fb400640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 0x7f37fc073380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37e802ba60 tx=0x7f37e8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:39.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.021+0000 7f37f3e00640 1 -- 172.21.15.163:0/680469172 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e8047070 con 0x7f37fc0c5ac0 2024-04-01T17:05:39.021 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.021+0000 7f37f3e00640 1 -- 172.21.15.163:0/680469172 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e8037bc0 con 0x7f37fc0c5ac0 2024-04-01T17:05:39.021 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.021+0000 7f37f3e00640 1 -- 172.21.15.163:0/680469172 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e8042480 con 0x7f37fc0c5ac0 2024-04-01T17:05:39.021 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.021+0000 7f3801a00640 1 -- 172.21.15.163:0/680469172 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37fc1445a0 con 0x7f37fc0c5ac0 2024-04-01T17:05:39.021 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.021+0000 7f3801a00640 1 -- 172.21.15.163:0/680469172 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f37fc144880 con 0x7f37fc0c5ac0 2024-04-01T17:05:39.022 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.022+0000 7f3801a00640 1 -- 172.21.15.163:0/680469172 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37fc0756d0 con 0x7f37fc0c5ac0 2024-04-01T17:05:39.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.079+0000 7f37f3e00640 1 -- 172.21.15.163:0/680469172 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f37e804a070 con 0x7f37fc0c5ac0 2024-04-01T17:05:39.080 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.081+0000 7f37f3e00640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f37dc06c940 0x7f37dc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:39.081 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.082+0000 7f37fbe00640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f37dc06c940 0x7f37dc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:39.082 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.083+0000 7f37fbe00640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f37dc06c940 0x7f37dc06ee00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f37ec006a90 tx=0x7f37ec006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:39.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.085+0000 7f37f3e00640 1 -- 172.21.15.163:0/680469172 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f37e8079f30 con 0x7f37fc0c5ac0 2024-04-01T17:05:39.085 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.085+0000 7f37f3e00640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] conn(0x7f37dc074c60 0x7f37dc0770e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:39.085 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.085+0000 7f37f3e00640 1 -- 172.21.15.163:0/680469172 --> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37e803ee50 con 0x7f37dc074c60 2024-04-01T17:05:39.085 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.086+0000 7f3801000640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] conn(0x7f37dc074c60 0x7f37dc0770e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:39.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.087+0000 7f3801000640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] conn(0x7f37dc074c60 0x7f37dc0770e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:39.088 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.089+0000 7f37f3e00640 1 -- 172.21.15.163:0/680469172 <== osd.4 v2:172.21.15.189:6814/4109894803 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f37e803ee50 con 0x7f37dc074c60 2024-04-01T17:05:39.112 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.113+0000 7f3801a00640 1 -- 172.21.15.163:0/680469172 --> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f37fc0c28c0 con 0x7f37dc074c60 2024-04-01T17:05:39.113 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.113+0000 7f37f3e00640 1 -- 172.21.15.163:0/680469172 <== osd.4 v2:172.21.15.189:6814/4109894803 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f37fc0c28c0 con 0x7f37dc074c60 2024-04-01T17:05:39.113 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-01T17:05:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T17:05:39.113 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-01T17:05:39.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.114+0000 7f3801a00640 1 -- 172.21.15.163:0/680469172 >> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] conn(0x7f37dc074c60 msgr2=0x7f37dc0770e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:39.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.114+0000 7f3801a00640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.189:6814/4109894803,v1:172.21.15.189:6817/4109894803] conn(0x7f37dc074c60 0x7f37dc0770e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.114+0000 7f3801a00640 1 -- 172.21.15.163:0/680469172 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f37dc06c940 msgr2=0x7f37dc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:39.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.114+0000 7f3801a00640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f37dc06c940 0x7f37dc06ee00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f37ec006a90 tx=0x7f37ec006a20 comp rx=0 tx=0).stop 2024-04-01T17:05:39.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.114+0000 7f3801a00640 1 -- 172.21.15.163:0/680469172 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 msgr2=0x7f37fc073380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:39.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.114+0000 7f3801a00640 1 --2- 172.21.15.163:0/680469172 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f37fc0c5ac0 0x7f37fc073380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37e802ba60 tx=0x7f37e8004730 comp rx=0 tx=0).stop 2024-04-01T17:05:39.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.114+0000 7f3801000640 1 -- 172.21.15.163:0/680469172 reap_dead start 2024-04-01T17:05:39.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.115+0000 7f3801a00640 1 -- 172.21.15.163:0/680469172 shutdown_connections 2024-04-01T17:05:39.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.115+0000 7f3801a00640 1 -- 172.21.15.163:0/680469172 >> 172.21.15.163:0/680469172 conn(0x7f37fc06f750 msgr2=0x7f37fc155700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:39.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.115+0000 7f3801a00640 1 -- 172.21.15.163:0/680469172 shutdown_connections 2024-04-01T17:05:39.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.115+0000 7f3801a00640 1 -- 172.21.15.163:0/680469172 wait complete. 2024-04-01T17:05:39.136 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-01T17:05:39.335 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.335+0000 7f1010600640 1 Processor -- start 2024-04-01T17:05:39.335 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.335+0000 7f1010600640 1 -- start start 2024-04-01T17:05:39.336 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.336+0000 7f1010600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1008151700 0x7f100815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:39.336 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.336+0000 7f1010600640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f10080c8160 0x7f10080c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:39.336 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.336+0000 7f1010600640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f100815b040 con 0x7f1008070100 2024-04-01T17:05:39.336 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.336+0000 7f1010600640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f10080c3060 con 0x7f10080c8160 2024-04-01T17:05:39.336 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.336+0000 7f1010600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f100815b8e0 con 0x7f1008151700 2024-04-01T17:05:39.338 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.338+0000 7f100dc00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1008151700 0x7f100815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:39.338 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.339+0000 7f100d200640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f1008070100 0x7f10080c7820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:48334/0 (socket says 172.21.15.163:48334) 2024-04-01T17:05:39.338 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.339+0000 7f100d200640 1 -- 172.21.15.163:0/471019878 learned_addr learned my addr 172.21.15.163:0/471019878 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:39.339 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.340+0000 7f100e600640 1 --2- 172.21.15.163:0/471019878 >> v2:172.21.15.189:3300/0 conn(0x7f10080c8160 0x7f10080c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:39.343 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.343+0000 7f1007e00640 1 -- 172.21.15.163:0/471019878 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528015408 0 0) 0x7f100815b040 con 0x7f1008070100 2024-04-01T17:05:39.343 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.343+0000 7f1007e00640 1 -- 172.21.15.163:0/471019878 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fec003520 con 0x7f1008070100 2024-04-01T17:05:39.347 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.348+0000 7f100dc00640 1 -- 172.21.15.163:0/471019878 >> v2:172.21.15.189:3300/0 conn(0x7f10080c8160 msgr2=0x7f10080c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:39.347 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.348+0000 7f100dc00640 1 --2- 172.21.15.163:0/471019878 >> v2:172.21.15.189:3300/0 conn(0x7f10080c8160 0x7f10080c0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.347 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.348+0000 7f100dc00640 1 -- 172.21.15.163:0/471019878 >> v1:172.21.15.189:6789/0 conn(0x7f1008070100 legacy=0x7f10080c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:39.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.348+0000 7f100dc00640 1 -- 172.21.15.163:0/471019878 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100815b320 con 0x7f1008151700 2024-04-01T17:05:39.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.354+0000 7f100dc00640 1 --2- 172.21.15.163:0/471019878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1008151700 0x7f100815aa00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1000009d90 tx=0x7f100002e0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85a74cd2beae40fc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:39.367 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.367+0000 7f1007e00640 1 -- 172.21.15.163:0/471019878 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100003b070 con 0x7f1008151700 2024-04-01T17:05:39.367 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.367+0000 7f1007e00640 1 -- 172.21.15.163:0/471019878 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1000036440 con 0x7f1008151700 2024-04-01T17:05:39.367 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.367+0000 7f1007e00640 1 -- 172.21.15.163:0/471019878 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100002ee60 con 0x7f1008151700 2024-04-01T17:05:39.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.368+0000 7f1010600640 1 -- 172.21.15.163:0/471019878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1008151700 msgr2=0x7f100815aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:39.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.368+0000 7f1010600640 1 --2- 172.21.15.163:0/471019878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1008151700 0x7f100815aa00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1000009d90 tx=0x7f100002e0b0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.368+0000 7f1010600640 1 -- 172.21.15.163:0/471019878 shutdown_connections 2024-04-01T17:05:39.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.368+0000 7f1010600640 1 --2- 172.21.15.163:0/471019878 >> v2:172.21.15.189:3300/0 conn(0x7f10080c8160 0x7f10080c0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.368+0000 7f1010600640 1 --2- 172.21.15.163:0/471019878 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1008151700 0x7f100815aa00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.368+0000 7f1010600640 1 -- 172.21.15.163:0/471019878 >> 172.21.15.163:0/471019878 conn(0x7f10080cbe20 msgr2=0x7f10080cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:39.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.368+0000 7f1010600640 1 -- 172.21.15.163:0/471019878 shutdown_connections 2024-04-01T17:05:39.370 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.368+0000 7f1010600640 1 -- 172.21.15.163:0/471019878 wait complete. 2024-04-01T17:05:39.370 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.370+0000 7f1010600640 1 Processor -- start 2024-04-01T17:05:39.371 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.371+0000 7f1010600640 1 -- start start 2024-04-01T17:05:39.372 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.372+0000 7f1010600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1008070100 0x7f1008159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:39.372 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.372+0000 7f1010600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10080c8160 0x7f1008159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:39.372 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.372+0000 7f1010600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1008151700 0x7f10081e2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:39.372 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.372+0000 7f1010600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f10080c7020 con 0x7f1008070100 2024-04-01T17:05:39.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.372+0000 7f1010600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10080c7390 con 0x7f10080c8160 2024-04-01T17:05:39.373 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.372+0000 7f1010600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1008151ae0 con 0x7f1008151700 2024-04-01T17:05:39.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.373+0000 7f100d200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10080c8160 0x7f1008159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:39.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.374+0000 7f100dc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1008070100 0x7f1008159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:39.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.374+0000 7f100d200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10080c8160 0x7f1008159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:43532/0 (socket says 172.21.15.163:43532) 2024-04-01T17:05:39.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.374+0000 7f100d200640 1 -- 172.21.15.163:0/2357895677 learned_addr learned my addr 172.21.15.163:0/2357895677 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:39.374 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.374+0000 7f100e600640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1008151700 0x7f10081e2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:39.378 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.378+0000 7f100dc00640 1 -- 172.21.15.163:0/2357895677 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1008151700 msgr2=0x7f10081e2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:39.378 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.378+0000 7f100dc00640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1008151700 0x7f10081e2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.378 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.378+0000 7f100dc00640 1 -- 172.21.15.163:0/2357895677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10080c8160 msgr2=0x7f1008159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:39.379 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.378+0000 7f100dc00640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10080c8160 0x7f1008159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.379 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.379+0000 7f100dc00640 1 -- 172.21.15.163:0/2357895677 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1008156620 con 0x7f1008070100 2024-04-01T17:05:39.381 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.382+0000 7f100dc00640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1008070100 0x7f1008159430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f10080c62f0 tx=0x7f1000004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:39.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.387+0000 7f1005600640 1 -- 172.21.15.163:0/2357895677 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100003b040 con 0x7f1008070100 2024-04-01T17:05:39.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.387+0000 7f1005600640 1 -- 172.21.15.163:0/2357895677 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1000041670 con 0x7f1008070100 2024-04-01T17:05:39.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.387+0000 7f1005600640 1 -- 172.21.15.163:0/2357895677 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000041a60 con 0x7f1008070100 2024-04-01T17:05:39.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.387+0000 7f1010600640 1 -- 172.21.15.163:0/2357895677 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10081e08c0 con 0x7f1008070100 2024-04-01T17:05:39.387 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.387+0000 7f1010600640 1 -- 172.21.15.163:0/2357895677 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1008158670 con 0x7f1008070100 2024-04-01T17:05:39.388 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.389+0000 7f1010600640 1 -- 172.21.15.163:0/2357895677 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10080756d0 con 0x7f1008070100 2024-04-01T17:05:39.696 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.696+0000 7f1005600640 1 -- 172.21.15.163:0/2357895677 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f100004a470 con 0x7f1008070100 2024-04-01T17:05:39.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.697+0000 7f1005600640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0fe806c970 0x7f0fe806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:39.697 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.698+0000 7f100d200640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0fe806c970 0x7f0fe806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:39.698 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.699+0000 7f100d200640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0fe806c970 0x7f0fe806ee30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f100814a480 tx=0x7f0ff4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:39.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.734+0000 7f1005600640 1 -- 172.21.15.163:0/2357895677 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f1000079ce0 con 0x7f1008070100 2024-04-01T17:05:39.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.735+0000 7f1005600640 1 -- 172.21.15.163:0/2357895677 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1008156620 con 0x7f1008070100 2024-04-01T17:05:39.943 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.943+0000 7f1010600640 1 -- 172.21.15.163:0/2357895677 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f100815aab0 con 0x7f0fe806c970 2024-04-01T17:05:39.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.944+0000 7f1005600640 1 -- 172.21.15.163:0/2357895677 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f100815aab0 con 0x7f0fe806c970 2024-04-01T17:05:39.944 INFO:teuthology.orchestra.run.smithi163.stderr:instructed osd(s) 4 to deep-scrub 2024-04-01T17:05:39.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.947+0000 7f1010600640 1 -- 172.21.15.163:0/2357895677 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0fe806c970 msgr2=0x7f0fe806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:39.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.947+0000 7f1010600640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0fe806c970 0x7f0fe806ee30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f100814a480 tx=0x7f0ff4009040 comp rx=0 tx=0).stop 2024-04-01T17:05:39.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.947+0000 7f1010600640 1 -- 172.21.15.163:0/2357895677 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1008070100 msgr2=0x7f1008159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:39.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.947+0000 7f1010600640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1008070100 0x7f1008159430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f10080c62f0 tx=0x7f1000004a40 comp rx=0 tx=0).stop 2024-04-01T17:05:39.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.947+0000 7f1010600640 1 -- 172.21.15.163:0/2357895677 shutdown_connections 2024-04-01T17:05:39.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.947+0000 7f1010600640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0fe806c970 0x7f0fe806ee30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.947+0000 7f1010600640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1008151700 0x7f10081e2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.947+0000 7f1010600640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10080c8160 0x7f1008159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.947+0000 7f1010600640 1 --2- 172.21.15.163:0/2357895677 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1008070100 0x7f1008159430 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:39.947 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.947+0000 7f1010600640 1 -- 172.21.15.163:0/2357895677 >> 172.21.15.163:0/2357895677 conn(0x7f10080cbe20 msgr2=0x7f10080c0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:39.948 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.947+0000 7f1010600640 1 -- 172.21.15.163:0/2357895677 shutdown_connections 2024-04-01T17:05:39.948 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:39.947+0000 7f1010600640 1 -- 172.21.15.163:0/2357895677 wait complete. 2024-04-01T17:05:39.966 INFO:tasks.ceph:Scrubbing osd.5 2024-04-01T17:05:39.966 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-01T17:05:40.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.182+0000 7f1b93800640 1 Processor -- start 2024-04-01T17:05:40.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.182+0000 7f1b93800640 1 -- start start 2024-04-01T17:05:40.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.184+0000 7f1b93800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b8c0c1900 0x7f1b8c073060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:40.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.184+0000 7f1b93800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1b8c0735a0 0x7f1b8c157510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:40.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.184+0000 7f1b93800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b8c0c7620 con 0x7f1b8c1517e0 2024-04-01T17:05:40.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.184+0000 7f1b93800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f1b8c0b20b0 con 0x7f1b8c0735a0 2024-04-01T17:05:40.185 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.184+0000 7f1b93800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8c0c8350 con 0x7f1b8c0c1900 2024-04-01T17:05:40.259 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.259+0000 7f1b8be00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b8c0c1900 0x7f1b8c073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:40.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.261+0000 7f1b8be00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b8c0c1900 0x7f1b8c073060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:35020/0 (socket says 172.21.15.163:35020) 2024-04-01T17:05:40.260 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.261+0000 7f1b8be00640 1 -- 172.21.15.163:0/4217685888 learned_addr learned my addr 172.21.15.163:0/4217685888 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:40.267 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.266+0000 7f1b8be00640 1 -- 172.21.15.163:0/4217685888 >> v2:172.21.15.163:3300/0 conn(0x7f1b8c0735a0 msgr2=0x7f1b8c157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:40.267 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.266+0000 7f1b8be00640 1 --2- 172.21.15.163:0/4217685888 >> v2:172.21.15.163:3300/0 conn(0x7f1b8c0735a0 0x7f1b8c157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:40.267 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.266+0000 7f1b8be00640 1 -- 172.21.15.163:0/4217685888 >> v1:172.21.15.163:6789/0 conn(0x7f1b8c1517e0 legacy=0x7f1b8c0c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:40.267 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.267+0000 7f1b8be00640 1 -- 172.21.15.163:0/4217685888 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c0c7340 con 0x7f1b8c0c1900 2024-04-01T17:05:40.274 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.274+0000 7f1b8be00640 1 --2- 172.21.15.163:0/4217685888 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b8c0c1900 0x7f1b8c073060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009870 tx=0x7f1b7c02da70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f24d969fbe8534ee server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:40.288 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.288+0000 7f1b8b400640 1 -- 172.21.15.163:0/4217685888 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c02f830 con 0x7f1b8c0c1900 2024-04-01T17:05:40.288 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.288+0000 7f1b8b400640 1 -- 172.21.15.163:0/4217685888 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7c02f9d0 con 0x7f1b8c0c1900 2024-04-01T17:05:40.288 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.288+0000 7f1b8b400640 1 -- 172.21.15.163:0/4217685888 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c02fda0 con 0x7f1b8c0c1900 2024-04-01T17:05:40.289 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.289+0000 7f1b93800640 1 -- 172.21.15.163:0/4217685888 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b8c0c1900 msgr2=0x7f1b8c073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:40.289 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.289+0000 7f1b93800640 1 --2- 172.21.15.163:0/4217685888 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b8c0c1900 0x7f1b8c073060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009870 tx=0x7f1b7c02da70 comp rx=0 tx=0).stop 2024-04-01T17:05:40.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.289+0000 7f1b93800640 1 -- 172.21.15.163:0/4217685888 shutdown_connections 2024-04-01T17:05:40.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.289+0000 7f1b93800640 1 --2- 172.21.15.163:0/4217685888 >> v2:172.21.15.163:3300/0 conn(0x7f1b8c0735a0 0x7f1b8c157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:40.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.289+0000 7f1b93800640 1 --2- 172.21.15.163:0/4217685888 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b8c0c1900 0x7f1b8c073060 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:40.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.289+0000 7f1b93800640 1 -- 172.21.15.163:0/4217685888 >> 172.21.15.163:0/4217685888 conn(0x7f1b8c0c8a00 msgr2=0x7f1b8c0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:40.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.289+0000 7f1b93800640 1 -- 172.21.15.163:0/4217685888 shutdown_connections 2024-04-01T17:05:40.291 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.290+0000 7f1b93800640 1 -- 172.21.15.163:0/4217685888 wait complete. 2024-04-01T17:05:40.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.293+0000 7f1b93800640 1 Processor -- start 2024-04-01T17:05:40.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.293+0000 7f1b93800640 1 -- start start 2024-04-01T17:05:40.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.295+0000 7f1b93800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b8c0735a0 0x7f1b8c145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:40.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.295+0000 7f1b93800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b8c0c1900 0x7f1b8c14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:40.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.295+0000 7f1b93800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b8c1517e0 0x7f1b8c1e3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:40.296 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.295+0000 7f1b93800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c0c7fe0 con 0x7f1b8c0735a0 2024-04-01T17:05:40.296 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.295+0000 7f1b93800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c0c7d00 con 0x7f1b8c1517e0 2024-04-01T17:05:40.296 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.295+0000 7f1b93800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8c0c7010 con 0x7f1b8c0c1900 2024-04-01T17:05:40.297 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.297+0000 7f1b90e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b8c0735a0 0x7f1b8c145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:40.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.299+0000 7f1b90e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b8c0735a0 0x7f1b8c145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:50876/0 (socket says 172.21.15.163:50876) 2024-04-01T17:05:40.299 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.299+0000 7f1b90e00640 1 -- 172.21.15.163:0/17236315 learned_addr learned my addr 172.21.15.163:0/17236315 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:40.304 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.304+0000 7f1b91800640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b8c1517e0 0x7f1b8c1e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:40.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.311+0000 7f1b8be00640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b8c0c1900 0x7f1b8c14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:40.316 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.317+0000 7f1b91800640 1 -- 172.21.15.163:0/17236315 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b8c0c1900 msgr2=0x7f1b8c14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:40.316 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.317+0000 7f1b91800640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b8c0c1900 0x7f1b8c14dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:40.316 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.317+0000 7f1b91800640 1 -- 172.21.15.163:0/17236315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b8c0735a0 msgr2=0x7f1b8c145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:40.316 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.317+0000 7f1b91800640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b8c0735a0 0x7f1b8c145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:40.316 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.317+0000 7f1b91800640 1 -- 172.21.15.163:0/17236315 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c157470 con 0x7f1b8c1517e0 2024-04-01T17:05:40.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.323+0000 7f1b91800640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b8c1517e0 0x7f1b8c1e3800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400be20 tx=0x7f1b8400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:40.333 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.333+0000 7f1b88c00640 1 -- 172.21.15.163:0/17236315 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b84019070 con 0x7f1b8c1517e0 2024-04-01T17:05:40.333 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.333+0000 7f1b88c00640 1 -- 172.21.15.163:0/17236315 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b84014440 con 0x7f1b8c1517e0 2024-04-01T17:05:40.334 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.333+0000 7f1b88c00640 1 -- 172.21.15.163:0/17236315 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b84014830 con 0x7f1b8c1517e0 2024-04-01T17:05:40.334 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.333+0000 7f1b93800640 1 -- 172.21.15.163:0/17236315 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8c14e810 con 0x7f1b8c1517e0 2024-04-01T17:05:40.334 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.334+0000 7f1b93800640 1 -- 172.21.15.163:0/17236315 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8c1579c0 con 0x7f1b8c1517e0 2024-04-01T17:05:40.334 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.335+0000 7f1b93800640 1 -- 172.21.15.163:0/17236315 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b8c0756d0 con 0x7f1b8c1517e0 2024-04-01T17:05:40.398 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:32:12.081 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:40.409 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.409+0000 7f1b88c00640 1 -- 172.21.15.163:0/17236315 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b8401c070 con 0x7f1b8c1517e0 2024-04-01T17:05:40.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.411+0000 7f1b88c00640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1b6806c970 0x7f1b6806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:40.411 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.412+0000 7f1b90e00640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1b6806c970 0x7f1b6806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:40.412 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.413+0000 7f1b90e00640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1b6806c970 0x7f1b6806ee30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b740099a0 tx=0x7f1b740090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:40.417 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.418+0000 7f1b88c00640 1 -- 172.21.15.163:0/17236315 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f1b84057f70 con 0x7f1b8c1517e0 2024-04-01T17:05:40.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.418+0000 7f1b88c00640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] conn(0x7f1b68074cf0 0x7f1b68077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:40.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.418+0000 7f1b88c00640 1 -- 172.21.15.163:0/17236315 --> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b84010e50 con 0x7f1b68074cf0 2024-04-01T17:05:40.418 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.419+0000 7f1b8be00640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] conn(0x7f1b68074cf0 0x7f1b68077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:40.420 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.421+0000 7f1b8be00640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] conn(0x7f1b68074cf0 0x7f1b68077170 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:40.422 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.422+0000 7f1b88c00640 1 -- 172.21.15.163:0/17236315 <== osd.5 v2:172.21.15.189:6800/1777830067 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b84010e50 con 0x7f1b68074cf0 2024-04-01T17:05:40.423 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:32:12.106 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:40.435 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:32:12.103 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:40.441 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.441+0000 7f1b93800640 1 -- 172.21.15.163:0/17236315 --> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1b8c0b1c10 con 0x7f1b68074cf0 2024-04-01T17:05:40.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.442+0000 7f1b88c00640 1 -- 172.21.15.163:0/17236315 <== osd.5 v2:172.21.15.189:6800/1777830067 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1b8c0b1c10 con 0x7f1b68074cf0 2024-04-01T17:05:40.442 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-01T17:05:40.442 INFO:teuthology.orchestra.run.smithi163.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T17:05:40.442 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-01T17:05:40.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.443+0000 7f1b93800640 1 -- 172.21.15.163:0/17236315 >> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] conn(0x7f1b68074cf0 msgr2=0x7f1b68077170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:40.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.443+0000 7f1b93800640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.189:6800/1777830067,v1:172.21.15.189:6801/1777830067] conn(0x7f1b68074cf0 0x7f1b68077170 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:40.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.443+0000 7f1b93800640 1 -- 172.21.15.163:0/17236315 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1b6806c970 msgr2=0x7f1b6806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:40.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.443+0000 7f1b93800640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1b6806c970 0x7f1b6806ee30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b740099a0 tx=0x7f1b740090e0 comp rx=0 tx=0).stop 2024-04-01T17:05:40.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.443+0000 7f1b93800640 1 -- 172.21.15.163:0/17236315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b8c1517e0 msgr2=0x7f1b8c1e3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:40.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.443+0000 7f1b93800640 1 --2- 172.21.15.163:0/17236315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b8c1517e0 0x7f1b8c1e3800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400be20 tx=0x7f1b8400bf10 comp rx=0 tx=0).stop 2024-04-01T17:05:40.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.443+0000 7f1b91800640 1 -- 172.21.15.163:0/17236315 reap_dead start 2024-04-01T17:05:40.443 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.443+0000 7f1b93800640 1 -- 172.21.15.163:0/17236315 shutdown_connections 2024-04-01T17:05:40.444 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.443+0000 7f1b93800640 1 -- 172.21.15.163:0/17236315 >> 172.21.15.163:0/17236315 conn(0x7f1b8c0c8a00 msgr2=0x7f1b8c06dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:40.444 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.444+0000 7f1b93800640 1 -- 172.21.15.163:0/17236315 shutdown_connections 2024-04-01T17:05:40.444 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.444+0000 7f1b93800640 1 -- 172.21.15.163:0/17236315 wait complete. 2024-04-01T17:05:40.445 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:32:12.112 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:40.457 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:32:12.124 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:40.466 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:32:12.134 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:40.468 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-01T17:05:40.572 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:32:12.254 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:40.606 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:32:12.273 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:40.608 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:32:12.276 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:40.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.693+0000 7f5465400640 1 Processor -- start 2024-04-01T17:05:40.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.693+0000 7f5465400640 1 -- start start 2024-04-01T17:05:40.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.695+0000 7f5465400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5460152440 0x7f54600c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:40.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.695+0000 7f5465400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460067650 0x7f54600c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:40.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.695+0000 7f5465400640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5460159310 con 0x7f546006c900 2024-04-01T17:05:40.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.695+0000 7f5465400640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f54600c7120 con 0x7f5460152440 2024-04-01T17:05:40.695 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.695+0000 7f5465400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f546006b540 con 0x7f5460067650 2024-04-01T17:05:40.718 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.719+0000 7f545e800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5460152440 0x7f54600c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:40.781 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.782+0000 7f5455e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460067650 0x7f54600c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:40.809 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.809+0000 7f5455e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460067650 0x7f54600c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:35044/0 (socket says 172.21.15.163:35044) 2024-04-01T17:05:40.809 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.809+0000 7f5455e00640 1 -- 172.21.15.163:0/2114887180 learned_addr learned my addr 172.21.15.163:0/2114887180 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:40.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.830+0000 7f5455e00640 1 -- 172.21.15.163:0/2114887180 >> v2:172.21.15.163:3300/0 conn(0x7f5460152440 msgr2=0x7f54600c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:40.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.830+0000 7f5455e00640 1 --2- 172.21.15.163:0/2114887180 >> v2:172.21.15.163:3300/0 conn(0x7f5460152440 0x7f54600c5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:40.830 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.830+0000 7f5455e00640 1 -- 172.21.15.163:0/2114887180 >> v1:172.21.15.163:6789/0 conn(0x7f546006c900 legacy=0x7f54600c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:40.831 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.831+0000 7f5455e00640 1 -- 172.21.15.163:0/2114887180 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546006b820 con 0x7f5460067650 2024-04-01T17:05:40.839 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:40.839+0000 7f5455e00640 1 --2- 172.21.15.163:0/2114887180 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460067650 0x7f54600c60d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5448009870 tx=0x7f544802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3215717b7345b6df server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:41.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.073+0000 7f545de00640 1 -- 172.21.15.163:0/2114887180 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5448035020 con 0x7f5460067650 2024-04-01T17:05:41.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.073+0000 7f545de00640 1 -- 172.21.15.163:0/2114887180 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5448031640 con 0x7f5460067650 2024-04-01T17:05:41.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.073+0000 7f545de00640 1 -- 172.21.15.163:0/2114887180 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544802d040 con 0x7f5460067650 2024-04-01T17:05:41.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.074+0000 7f5465400640 1 -- 172.21.15.163:0/2114887180 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460067650 msgr2=0x7f54600c60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:41.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.074+0000 7f5465400640 1 --2- 172.21.15.163:0/2114887180 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460067650 0x7f54600c60d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5448009870 tx=0x7f544802b8f0 comp rx=0 tx=0).stop 2024-04-01T17:05:41.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.074+0000 7f5465400640 1 -- 172.21.15.163:0/2114887180 shutdown_connections 2024-04-01T17:05:41.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.074+0000 7f5465400640 1 --2- 172.21.15.163:0/2114887180 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460067650 0x7f54600c60d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:41.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.074+0000 7f5465400640 1 --2- 172.21.15.163:0/2114887180 >> v2:172.21.15.163:3300/0 conn(0x7f5460152440 0x7f54600c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:41.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.074+0000 7f5465400640 1 -- 172.21.15.163:0/2114887180 >> 172.21.15.163:0/2114887180 conn(0x7f54600c8f80 msgr2=0x7f54600c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:41.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.075+0000 7f5465400640 1 -- 172.21.15.163:0/2114887180 shutdown_connections 2024-04-01T17:05:41.075 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.075+0000 7f5465400640 1 -- 172.21.15.163:0/2114887180 wait complete. 2024-04-01T17:05:41.076 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.077+0000 7f5465400640 1 Processor -- start 2024-04-01T17:05:41.077 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.077+0000 7f5465400640 1 -- start start 2024-04-01T17:05:41.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.078+0000 7f5465400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5460067650 0x7f5460154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:41.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.078+0000 7f5465400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f546006c900 0x7f54601e51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:41.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.078+0000 7f5465400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460152440 0x7f54601f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:41.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.078+0000 7f5465400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5460152820 con 0x7f5460067650 2024-04-01T17:05:41.078 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.078+0000 7f5465400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5460158fb0 con 0x7f546006c900 2024-04-01T17:05:41.079 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.078+0000 7f5465400640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f54601529a0 con 0x7f5460152440 2024-04-01T17:05:41.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.087+0000 7f545f200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460152440 0x7f54601f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:41.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.091+0000 7f545f200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460152440 0x7f54601f3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:40230/0 (socket says 172.21.15.163:40230) 2024-04-01T17:05:41.091 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.091+0000 7f545f200640 1 -- 172.21.15.163:0/1633822694 learned_addr learned my addr 172.21.15.163:0/1633822694 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:41.095 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.096+0000 7f545e800640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5460067650 0x7f5460154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:41.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.101+0000 7f545f200640 1 -- 172.21.15.163:0/1633822694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f546006c900 msgr2=0x7f54601e51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:41.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.101+0000 7f545f200640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f546006c900 0x7f54601e51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:41.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.101+0000 7f545f200640 1 -- 172.21.15.163:0/1633822694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5460067650 msgr2=0x7f5460154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:41.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.101+0000 7f545f200640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5460067650 0x7f5460154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:41.100 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.101+0000 7f545f200640 1 -- 172.21.15.163:0/1633822694 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5460154f50 con 0x7f5460152440 2024-04-01T17:05:41.108 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.108+0000 7f545f200640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460152440 0x7f54601f3b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f545800c7b0 tx=0x7f545800cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:41.119 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.119+0000 7f5457400640 1 -- 172.21.15.163:0/1633822694 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5458017070 con 0x7f5460152440 2024-04-01T17:05:41.120 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.120+0000 7f5457400640 1 -- 172.21.15.163:0/1633822694 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5458003da0 con 0x7f5460152440 2024-04-01T17:05:41.120 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.120+0000 7f5457400640 1 -- 172.21.15.163:0/1633822694 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54580052b0 con 0x7f5460152440 2024-04-01T17:05:41.120 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.120+0000 7f5465400640 1 -- 172.21.15.163:0/1633822694 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5460155b80 con 0x7f5460152440 2024-04-01T17:05:41.120 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.120+0000 7f5465400640 1 -- 172.21.15.163:0/1633822694 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54600c3eb0 con 0x7f5460152440 2024-04-01T17:05:41.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.122+0000 7f5465400640 1 -- 172.21.15.163:0/1633822694 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54600cbcb0 con 0x7f5460152440 2024-04-01T17:05:41.498 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.498+0000 7f5457400640 1 -- 172.21.15.163:0/1633822694 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f545801a070 con 0x7f5460152440 2024-04-01T17:05:41.500 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.500+0000 7f5457400640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f543c06c940 0x7f543c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:41.500 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.501+0000 7f545e800640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f543c06c940 0x7f543c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:41.502 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.503+0000 7f545e800640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f543c06c940 0x7f543c06ee00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f545000aa20 tx=0x7f5450008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:41.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.512+0000 7f5457400640 1 -- 172.21.15.163:0/1633822694 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f5458057410 con 0x7f5460152440 2024-04-01T17:05:41.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.566+0000 7f5457400640 1 -- 172.21.15.163:0/1633822694 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f54600cbcb0 con 0x7f5460152440 2024-04-01T17:05:41.783 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.784+0000 7f5465400640 1 -- 172.21.15.163:0/1633822694 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f54600c3980 con 0x7f543c06c940 2024-04-01T17:05:41.784 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.784+0000 7f5457400640 1 -- 172.21.15.163:0/1633822694 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f54600c3980 con 0x7f543c06c940 2024-04-01T17:05:41.784 INFO:teuthology.orchestra.run.smithi163.stderr:instructed osd(s) 5 to deep-scrub 2024-04-01T17:05:41.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.787+0000 7f5465400640 1 -- 172.21.15.163:0/1633822694 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f543c06c940 msgr2=0x7f543c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:41.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.787+0000 7f5465400640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f543c06c940 0x7f543c06ee00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f545000aa20 tx=0x7f5450008040 comp rx=0 tx=0).stop 2024-04-01T17:05:41.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.787+0000 7f5465400640 1 -- 172.21.15.163:0/1633822694 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460152440 msgr2=0x7f54601f3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:41.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.787+0000 7f5465400640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460152440 0x7f54601f3b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f545800c7b0 tx=0x7f545800cc70 comp rx=0 tx=0).stop 2024-04-01T17:05:41.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.787+0000 7f5465400640 1 -- 172.21.15.163:0/1633822694 shutdown_connections 2024-04-01T17:05:41.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.787+0000 7f5465400640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f543c06c940 0x7f543c06ee00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:41.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.787+0000 7f5465400640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f5460152440 0x7f54601f3b20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:41.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.787+0000 7f5465400640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f546006c900 0x7f54601e51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:41.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.787+0000 7f5465400640 1 --2- 172.21.15.163:0/1633822694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5460067650 0x7f5460154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:41.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.787+0000 7f5465400640 1 -- 172.21.15.163:0/1633822694 >> 172.21.15.163:0/1633822694 conn(0x7f54600c8f80 msgr2=0x7f54600c5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:41.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.787+0000 7f5465400640 1 -- 172.21.15.163:0/1633822694 shutdown_connections 2024-04-01T17:05:41.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:41.787+0000 7f5465400640 1 -- 172.21.15.163:0/1633822694 wait complete. 2024-04-01T17:05:41.805 INFO:tasks.ceph:Scrubbing osd.6 2024-04-01T17:05:41.805 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-01T17:05:42.011 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.012+0000 7ffb9f000640 1 Processor -- start 2024-04-01T17:05:42.011 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.012+0000 7ffb9f000640 1 -- start start 2024-04-01T17:05:42.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.013+0000 7ffb9f000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ffb98152a10 0x7ffb9806eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.013+0000 7ffb9f000640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ffb98158d80 0x7ffb98162f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.013+0000 7ffb9f000640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb980c7620 con 0x7ffb980c4800 2024-04-01T17:05:42.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.013+0000 7ffb9f000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7ffb98152df0 con 0x7ffb98152a10 2024-04-01T17:05:42.013 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.013+0000 7ffb9f000640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ffb9806ead0 con 0x7ffb98158d80 2024-04-01T17:05:42.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.014+0000 7ffb97e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ffb98152a10 0x7ffb9806eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:42.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.015+0000 7ffb97e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ffb98152a10 0x7ffb9806eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38932/0 (socket says 172.21.15.163:38932) 2024-04-01T17:05:42.014 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.015+0000 7ffb97e00640 1 -- 172.21.15.163:0/3924452949 learned_addr learned my addr 172.21.15.163:0/3924452949 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:42.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.017+0000 7ffb97e00640 1 -- 172.21.15.163:0/3924452949 >> v2:172.21.15.189:3300/0 conn(0x7ffb98158d80 msgr2=0x7ffb98162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:42.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.017+0000 7ffb97e00640 1 --2- 172.21.15.163:0/3924452949 >> v2:172.21.15.189:3300/0 conn(0x7ffb98158d80 0x7ffb98162f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.017+0000 7ffb97e00640 1 -- 172.21.15.163:0/3924452949 >> v1:172.21.15.189:6789/0 conn(0x7ffb980c4800 legacy=0x7ffb98158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:42.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.017+0000 7ffb97e00640 1 -- 172.21.15.163:0/3924452949 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb980c7890 con 0x7ffb98152a10 2024-04-01T17:05:42.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.021+0000 7ffb97e00640 1 --2- 172.21.15.163:0/3924452949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb98152a10 0x7ffb9806eec0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffb980c6a90 tx=0x7ffb8802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a7c1ef8ebcedd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:42.026 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.026+0000 7ffb96a00640 1 -- 172.21.15.163:0/3924452949 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88035020 con 0x7ffb98152a10 2024-04-01T17:05:42.026 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.026+0000 7ffb96a00640 1 -- 172.21.15.163:0/3924452949 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb88031870 con 0x7ffb98152a10 2024-04-01T17:05:42.026 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.027+0000 7ffb96a00640 1 -- 172.21.15.163:0/3924452949 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88031c40 con 0x7ffb98152a10 2024-04-01T17:05:42.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.027+0000 7ffb9f000640 1 -- 172.21.15.163:0/3924452949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb98152a10 msgr2=0x7ffb9806eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.027+0000 7ffb9f000640 1 --2- 172.21.15.163:0/3924452949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb98152a10 0x7ffb9806eec0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffb980c6a90 tx=0x7ffb8802b910 comp rx=0 tx=0).stop 2024-04-01T17:05:42.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.027+0000 7ffb9f000640 1 -- 172.21.15.163:0/3924452949 shutdown_connections 2024-04-01T17:05:42.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.027+0000 7ffb9f000640 1 --2- 172.21.15.163:0/3924452949 >> v2:172.21.15.189:3300/0 conn(0x7ffb98158d80 0x7ffb98162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.027+0000 7ffb9f000640 1 --2- 172.21.15.163:0/3924452949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb98152a10 0x7ffb9806eec0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.027+0000 7ffb9f000640 1 -- 172.21.15.163:0/3924452949 >> 172.21.15.163:0/3924452949 conn(0x7ffb980c8a00 msgr2=0x7ffb980c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:42.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.027+0000 7ffb9f000640 1 -- 172.21.15.163:0/3924452949 shutdown_connections 2024-04-01T17:05:42.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.027+0000 7ffb9f000640 1 -- 172.21.15.163:0/3924452949 wait complete. 2024-04-01T17:05:42.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.030+0000 7ffb9f000640 1 Processor -- start 2024-04-01T17:05:42.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.030+0000 7ffb9f000640 1 -- start start 2024-04-01T17:05:42.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.031+0000 7ffb9f000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb980c4800 0x7ffb98153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.031+0000 7ffb9f000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb98158d80 0x7ffb980c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.031+0000 7ffb9f000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb98073380 0x7ffb980c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.031+0000 7ffb9f000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ffb980c8130 con 0x7ffb98073380 2024-04-01T17:05:42.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.031+0000 7ffb9f000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffb980c7e50 con 0x7ffb98158d80 2024-04-01T17:05:42.031 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.031+0000 7ffb9f000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ffb9806e6b0 con 0x7ffb980c4800 2024-04-01T17:05:42.031 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.031+0000 7ffb9d000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb98073380 0x7ffb980c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:42.031 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.032+0000 7ffb9d000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb98073380 0x7ffb980c23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38940/0 (socket says 172.21.15.163:38940) 2024-04-01T17:05:42.031 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.032+0000 7ffb9d000640 1 -- 172.21.15.163:0/2713130769 learned_addr learned my addr 172.21.15.163:0/2713130769 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:42.031 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.032+0000 7ffb97e00640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb980c4800 0x7ffb98153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:42.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.035+0000 7ffb9d000640 1 -- 172.21.15.163:0/2713130769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb980c4800 msgr2=0x7ffb98153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.035+0000 7ffb9d000640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ffb980c4800 0x7ffb98153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.035+0000 7ffb9d000640 1 -- 172.21.15.163:0/2713130769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb98158d80 msgr2=0x7ffb980c1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.035+0000 7ffb9d000640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb98158d80 0x7ffb980c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.035+0000 7ffb9d000640 1 -- 172.21.15.163:0/2713130769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb981f0a20 con 0x7ffb98073380 2024-04-01T17:05:42.037 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.038+0000 7ffb9d000640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb98073380 0x7ffb980c23a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000b970 tx=0x7ffb9000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:42.040 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.040+0000 7ffb8fe00640 1 -- 172.21.15.163:0/2713130769 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90019070 con 0x7ffb98073380 2024-04-01T17:05:42.040 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.040+0000 7ffb9f000640 1 -- 172.21.15.163:0/2713130769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb981f0d00 con 0x7ffb98073380 2024-04-01T17:05:42.040 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.040+0000 7ffb9f000640 1 -- 172.21.15.163:0/2713130769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb981f12c0 con 0x7ffb98073380 2024-04-01T17:05:42.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.041+0000 7ffb9f000640 1 -- 172.21.15.163:0/2713130769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb980756d0 con 0x7ffb98073380 2024-04-01T17:05:42.042 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.042+0000 7ffb8fe00640 1 -- 172.21.15.163:0/2713130769 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb980756d0 con 0x7ffb98073380 2024-04-01T17:05:42.042 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.042+0000 7ffb8fe00640 1 -- 172.21.15.163:0/2713130769 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90023060 con 0x7ffb98073380 2024-04-01T17:05:42.068 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.068+0000 7ffb8fe00640 1 -- 172.21.15.163:0/2713130769 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb9001c070 con 0x7ffb98073380 2024-04-01T17:05:42.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.070+0000 7ffb8fe00640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ffb7806c920 0x7ffb7806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.070+0000 7ffb8fe00640 1 -- 172.21.15.163:0/2713130769 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7ffb9008c170 con 0x7ffb98073380 2024-04-01T17:05:42.070 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.070+0000 7ffb97e00640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ffb7806c920 0x7ffb7806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:42.070 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.070+0000 7ffb8fe00640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] conn(0x7ffb78074ca0 0x7ffb78077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.070 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.070+0000 7ffb8fe00640 1 -- 172.21.15.163:0/2713130769 --> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb90013ec0 con 0x7ffb78074ca0 2024-04-01T17:05:42.070 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.070+0000 7ffb8fe00640 1 -- 172.21.15.163:0/2713130769 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffb9008c600 con 0x7ffb98073380 2024-04-01T17:05:42.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.071+0000 7ffb97400640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] conn(0x7ffb78074ca0 0x7ffb78077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:42.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.071+0000 7ffb97e00640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ffb7806c920 0x7ffb7806ede0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffb88036000 tx=0x7ffb8803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:42.071 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.072+0000 7ffb97400640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] conn(0x7ffb78074ca0 0x7ffb78077120 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:42.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.073+0000 7ffb8fe00640 1 -- 172.21.15.163:0/2713130769 <== osd.6 v2:172.21.15.189:6809/4014790814 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb90013ec0 con 0x7ffb78074ca0 2024-04-01T17:05:42.087 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.088+0000 7ffb9f000640 1 -- 172.21.15.163:0/2713130769 --> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffb9806e490 con 0x7ffb78074ca0 2024-04-01T17:05:42.088 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.089+0000 7ffb8fe00640 1 -- 172.21.15.163:0/2713130769 <== osd.6 v2:172.21.15.189:6809/4014790814 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffb9806e490 con 0x7ffb78074ca0 2024-04-01T17:05:42.088 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-01T17:05:42.088 INFO:teuthology.orchestra.run.smithi163.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T17:05:42.089 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-01T17:05:42.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.089+0000 7ffb9f000640 1 -- 172.21.15.163:0/2713130769 >> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] conn(0x7ffb78074ca0 msgr2=0x7ffb78077120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.089 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.089+0000 7ffb9f000640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.189:6809/4014790814,v1:172.21.15.189:6811/4014790814] conn(0x7ffb78074ca0 0x7ffb78077120 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.089+0000 7ffb9f000640 1 -- 172.21.15.163:0/2713130769 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ffb7806c920 msgr2=0x7ffb7806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.089+0000 7ffb9f000640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ffb7806c920 0x7ffb7806ede0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffb88036000 tx=0x7ffb8803c040 comp rx=0 tx=0).stop 2024-04-01T17:05:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.089+0000 7ffb9f000640 1 -- 172.21.15.163:0/2713130769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb98073380 msgr2=0x7ffb980c23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.089+0000 7ffb9f000640 1 --2- 172.21.15.163:0/2713130769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb98073380 0x7ffb980c23a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000b970 tx=0x7ffb9000be30 comp rx=0 tx=0).stop 2024-04-01T17:05:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.089+0000 7ffb9d000640 1 -- 172.21.15.163:0/2713130769 reap_dead start 2024-04-01T17:05:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.090+0000 7ffb9f000640 1 -- 172.21.15.163:0/2713130769 shutdown_connections 2024-04-01T17:05:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.090+0000 7ffb9f000640 1 -- 172.21.15.163:0/2713130769 >> 172.21.15.163:0/2713130769 conn(0x7ffb980c8a00 msgr2=0x7ffb980c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.090+0000 7ffb9f000640 1 -- 172.21.15.163:0/2713130769 shutdown_connections 2024-04-01T17:05:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.090+0000 7ffb9f000640 1 -- 172.21.15.163:0/2713130769 wait complete. 2024-04-01T17:05:42.108 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-01T17:05:42.309 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.309+0000 7f90d3a00640 1 Processor -- start 2024-04-01T17:05:42.309 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.309+0000 7f90d3a00640 1 -- start start 2024-04-01T17:05:42.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.311+0000 7f90d3a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f90cc152830 0x7f90cc072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.310 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.311+0000 7f90d3a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90cc0737f0 con 0x7f90cc0c6b30 2024-04-01T17:05:42.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.311+0000 7f90d3a00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90cc0c72d0 con 0x7f90cc15c160 2024-04-01T17:05:42.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.311+0000 7f90d3a00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f90cc152c10 con 0x7f90cc152830 2024-04-01T17:05:42.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.312+0000 7f90c3e00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f90cc0c6b30 0x7f90cc15ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:51130/0 (socket says 172.21.15.163:51130) 2024-04-01T17:05:42.311 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.312+0000 7f90c3e00640 1 -- 172.21.15.163:0/1149416033 learned_addr learned my addr 172.21.15.163:0/1149416033 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:42.313 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.313+0000 7f90d1000640 1 --2- 172.21.15.163:0/1149416033 >> v2:172.21.15.189:3300/0 conn(0x7f90cc152830 0x7f90cc072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:42.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.314+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837630206 0 0) 0x7f90cc0737f0 con 0x7f90cc0c6b30 2024-04-01T17:05:42.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.315+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90b0003520 con 0x7f90cc0c6b30 2024-04-01T17:05:42.318 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.318+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2913965187 0 0) 0x7f90b0003520 con 0x7f90cc0c6b30 2024-04-01T17:05:42.318 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.318+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 >> v2:172.21.15.189:3300/0 conn(0x7f90cc152830 msgr2=0x7f90cc072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:42.319 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.318+0000 7f90cbe00640 1 --2- 172.21.15.163:0/1149416033 >> v2:172.21.15.189:3300/0 conn(0x7f90cc152830 0x7f90cc072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.319 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.318+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 >> v1:172.21.15.189:6789/0 conn(0x7f90cc15c160 legacy=0x7f90cc162de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.319 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.318+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc0c75b0 con 0x7f90cc0c6b30 2024-04-01T17:05:42.319 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.318+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7f90b4001670 con 0x7f90cc0c6b30 2024-04-01T17:05:42.319 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.318+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 >> v1:172.21.15.163:6789/0 conn(0x7f90cc0c6b30 legacy=0x7f90cc15ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.319 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.319+0000 7f90cbe00640 1 --2- 172.21.15.163:0/1149416033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90b0003a00 0x7f90b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.319 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.319+0000 7f90cbe00640 1 --2- 172.21.15.163:0/1149416033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90b0004800 0x7f90b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.319 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.319+0000 7f90cbe00640 1 --2- 172.21.15.163:0/1149416033 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f90b00051c0 0x7f90b000fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.319 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.319+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc152c10 con 0x7f90b0004800 2024-04-01T17:05:42.319 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.319+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00104d0 con 0x7f90b0003a00 2024-04-01T17:05:42.319 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.319+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f90b00106d0 con 0x7f90b00051c0 2024-04-01T17:05:42.320 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.321+0000 7f90d1a00640 1 --2- 172.21.15.163:0/1149416033 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f90b00051c0 0x7f90b000fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:42.321 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.321+0000 7f90c3e00640 1 --2- 172.21.15.163:0/1149416033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90b0004800 0x7f90b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:42.325 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.325+0000 7f90c3e00640 1 -- 172.21.15.163:0/1149416033 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f90b00051c0 msgr2=0x7f90b000fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:42.325 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.325+0000 7f90c3e00640 1 --2- 172.21.15.163:0/1149416033 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f90b00051c0 0x7f90b000fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.325 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.325+0000 7f90c3e00640 1 -- 172.21.15.163:0/1149416033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90b0003a00 msgr2=0x7f90b0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:42.325 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.325+0000 7f90c3e00640 1 --2- 172.21.15.163:0/1149416033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90b0003a00 0x7f90b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.325 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.325+0000 7f90c3e00640 1 -- 172.21.15.163:0/1149416033 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b0003520 con 0x7f90b0004800 2024-04-01T17:05:42.325 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.325+0000 7f90d1a00640 1 -- 172.21.15.163:0/1149416033 reap_dead start 2024-04-01T17:05:42.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.328+0000 7f90c3e00640 1 --2- 172.21.15.163:0/1149416033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90b0004800 0x7f90b0004c80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f90b400c110 tx=0x7f90b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4593024659f71 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:42.333 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.334+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b4007c40 con 0x7f90b0004800 2024-04-01T17:05:42.334 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.334+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b4030070 con 0x7f90b0004800 2024-04-01T17:05:42.334 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.334+0000 7f90cbe00640 1 -- 172.21.15.163:0/1149416033 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b4005d70 con 0x7f90b0004800 2024-04-01T17:05:42.335 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.335+0000 7f90d3a00640 1 -- 172.21.15.163:0/1149416033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90b0004800 msgr2=0x7f90b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.335 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.335+0000 7f90d3a00640 1 --2- 172.21.15.163:0/1149416033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90b0004800 0x7f90b0004c80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f90b400c110 tx=0x7f90b0005830 comp rx=0 tx=0).stop 2024-04-01T17:05:42.335 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.335+0000 7f90d3a00640 1 -- 172.21.15.163:0/1149416033 shutdown_connections 2024-04-01T17:05:42.335 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.335+0000 7f90d3a00640 1 --2- 172.21.15.163:0/1149416033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90b0004800 0x7f90b0004c80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.335 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.335+0000 7f90d3a00640 1 -- 172.21.15.163:0/1149416033 >> 172.21.15.163:0/1149416033 conn(0x7f90cc0cbe20 msgr2=0x7f90cc0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:42.335 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.335+0000 7f90d3a00640 1 -- 172.21.15.163:0/1149416033 shutdown_connections 2024-04-01T17:05:42.335 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.335+0000 7f90d3a00640 1 -- 172.21.15.163:0/1149416033 wait complete. 2024-04-01T17:05:42.338 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.339+0000 7f90d3a00640 1 Processor -- start 2024-04-01T17:05:42.338 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.339+0000 7f90d3a00640 1 -- start start 2024-04-01T17:05:42.340 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.340+0000 7f90d3a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f90b0004800 0x7f90cc150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.340 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.340+0000 7f90d3a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90cc1ec9f0 0x7f90cc150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.340 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.340+0000 7f90d3a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc0cb160 0x7f90cc0cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.340 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.340+0000 7f90d3a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc073a90 con 0x7f90cc1ec9f0 2024-04-01T17:05:42.340 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.340+0000 7f90d3a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc0c7b70 con 0x7f90cc0cb160 2024-04-01T17:05:42.340 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.340+0000 7f90d3a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f90cc0707f0 con 0x7f90b0004800 2024-04-01T17:05:42.340 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.341+0000 7f90c3e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90cc1ec9f0 0x7f90cc150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:42.341 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.342+0000 7f90c3e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90cc1ec9f0 0x7f90cc150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38946/0 (socket says 172.21.15.163:38946) 2024-04-01T17:05:42.341 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.342+0000 7f90c3e00640 1 -- 172.21.15.163:0/3603961009 learned_addr learned my addr 172.21.15.163:0/3603961009 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:42.341 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.342+0000 7f90d1000640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f90b0004800 0x7f90cc150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:42.341 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.342+0000 7f90d1a00640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc0cb160 0x7f90cc0cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:42.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.345+0000 7f90c3e00640 1 -- 172.21.15.163:0/3603961009 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f90b0004800 msgr2=0x7f90cc150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.345+0000 7f90c3e00640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f90b0004800 0x7f90cc150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.345+0000 7f90c3e00640 1 -- 172.21.15.163:0/3603961009 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc0cb160 msgr2=0x7f90cc0cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.345+0000 7f90c3e00640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc0cb160 0x7f90cc0cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.345 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.345+0000 7f90c3e00640 1 -- 172.21.15.163:0/3603961009 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc1ecee0 con 0x7f90cc1ec9f0 2024-04-01T17:05:42.347 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.348+0000 7f90c3e00640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90cc1ec9f0 0x7f90cc150570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f90b402c450 tx=0x7f90b402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:42.352 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.352+0000 7f90c9600640 1 -- 172.21.15.163:0/3603961009 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b4007c40 con 0x7f90cc1ec9f0 2024-04-01T17:05:42.352 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.352+0000 7f90c9600640 1 -- 172.21.15.163:0/3603961009 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b4000ed0 con 0x7f90cc1ec9f0 2024-04-01T17:05:42.352 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.352+0000 7f90c9600640 1 -- 172.21.15.163:0/3603961009 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b402ce10 con 0x7f90cc1ec9f0 2024-04-01T17:05:42.352 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.352+0000 7f90d3a00640 1 -- 172.21.15.163:0/3603961009 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90cc1ef650 con 0x7f90cc1ec9f0 2024-04-01T17:05:42.352 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.353+0000 7f90d3a00640 1 -- 172.21.15.163:0/3603961009 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90cc1ef8f0 con 0x7f90cc1ec9f0 2024-04-01T17:05:42.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.354+0000 7f90d3a00640 1 -- 172.21.15.163:0/3603961009 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90cc0c4f30 con 0x7f90cc1ec9f0 2024-04-01T17:05:42.376 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.376+0000 7f90c9600640 1 -- 172.21.15.163:0/3603961009 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90b4007070 con 0x7f90cc1ec9f0 2024-04-01T17:05:42.377 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.377+0000 7f90c9600640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f90a806c970 0x7f90a806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:42.377 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.378+0000 7f90d1000640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f90a806c970 0x7f90a806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:42.378 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.379+0000 7f90d1000640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f90a806c970 0x7f90a806ee30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f90cc069d50 tx=0x7f90bc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:42.681 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.681+0000 7f90c9600640 1 -- 172.21.15.163:0/3603961009 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f90b40796b0 con 0x7f90cc1ec9f0 2024-04-01T17:05:42.681 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.682+0000 7f90c9600640 1 -- 172.21.15.163:0/3603961009 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f90cc0c4f30 con 0x7f90cc1ec9f0 2024-04-01T17:05:42.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.905+0000 7f90d3a00640 1 -- 172.21.15.163:0/3603961009 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f90cc0756d0 con 0x7f90a806c970 2024-04-01T17:05:42.905 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.906+0000 7f90c9600640 1 -- 172.21.15.163:0/3603961009 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f90cc0756d0 con 0x7f90a806c970 2024-04-01T17:05:42.905 INFO:teuthology.orchestra.run.smithi163.stderr:instructed osd(s) 6 to deep-scrub 2024-04-01T17:05:42.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.908+0000 7f90d3a00640 1 -- 172.21.15.163:0/3603961009 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f90a806c970 msgr2=0x7f90a806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.908+0000 7f90d3a00640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f90a806c970 0x7f90a806ee30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f90cc069d50 tx=0x7f90bc009190 comp rx=0 tx=0).stop 2024-04-01T17:05:42.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.908+0000 7f90d3a00640 1 -- 172.21.15.163:0/3603961009 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90cc1ec9f0 msgr2=0x7f90cc150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:42.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.908+0000 7f90d3a00640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90cc1ec9f0 0x7f90cc150570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f90b402c450 tx=0x7f90b402e070 comp rx=0 tx=0).stop 2024-04-01T17:05:42.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.908+0000 7f90d3a00640 1 -- 172.21.15.163:0/3603961009 shutdown_connections 2024-04-01T17:05:42.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.908+0000 7f90d3a00640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f90a806c970 0x7f90a806ee30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.908+0000 7f90d3a00640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90cc0cb160 0x7f90cc0cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.908+0000 7f90d3a00640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90cc1ec9f0 0x7f90cc150570 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.908+0000 7f90d3a00640 1 --2- 172.21.15.163:0/3603961009 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f90b0004800 0x7f90cc150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:42.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.909+0000 7f90d3a00640 1 -- 172.21.15.163:0/3603961009 >> 172.21.15.163:0/3603961009 conn(0x7f90cc0cbe20 msgr2=0x7f90cc1573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:42.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.909+0000 7f90d3a00640 1 -- 172.21.15.163:0/3603961009 shutdown_connections 2024-04-01T17:05:42.910 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:42.909+0000 7f90d3a00640 1 -- 172.21.15.163:0/3603961009 wait complete. 2024-04-01T17:05:42.928 INFO:tasks.ceph:Scrubbing osd.7 2024-04-01T17:05:42.928 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-01T17:05:43.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.139+0000 7f1b16800640 1 Processor -- start 2024-04-01T17:05:43.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.140+0000 7f1b16800640 1 -- start start 2024-04-01T17:05:43.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.141+0000 7f1b16800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b100cd0e0 0x7f1b1015a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.141+0000 7f1b16800640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1b100cd4c0 0x7f1b10154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.141+0000 7f1b16800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1b100cadd0 0x7f1b10154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.141+0000 7f1b16800640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f1b1006c590 con 0x7f1b100cd4c0 2024-04-01T17:05:43.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.141+0000 7f1b16800640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f1b1006c850 con 0x7f1b100cadd0 2024-04-01T17:05:43.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.141+0000 7f1b16800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1006cb30 con 0x7f1b100cd0e0 2024-04-01T17:05:43.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.142+0000 7f1b0fe00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1b100cadd0 0x7f1b10154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.142+0000 7f1b06a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1b100cd4c0 0x7f1b10154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.142 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.143+0000 7f1b0f400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b100cd0e0 0x7f1b1015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.143+0000 7f1b0fe00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f1b100cadd0 0x7f1b10154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:40636/0 (socket says 172.21.15.163:40636) 2024-04-01T17:05:43.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.143+0000 7f1b0fe00640 1 -- 172.21.15.163:0/3344826597 learned_addr learned my addr 172.21.15.163:0/3344826597 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:43.145 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.146+0000 7f1b06a00640 1 -- 172.21.15.163:0/3344826597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b100cd0e0 msgr2=0x7f1b1015a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:43.145 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.146+0000 7f1b06a00640 1 --2- 172.21.15.163:0/3344826597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b100cd0e0 0x7f1b1015a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.146 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.146+0000 7f1b06a00640 1 -- 172.21.15.163:0/3344826597 >> v2:172.21.15.189:3300/0 conn(0x7f1b100cadd0 msgr2=0x7f1b10154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:43.146 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.146+0000 7f1b06a00640 1 --2- 172.21.15.163:0/3344826597 >> v2:172.21.15.189:3300/0 conn(0x7f1b100cadd0 0x7f1b10154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.146 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.146+0000 7f1b06a00640 1 -- 172.21.15.163:0/3344826597 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1006ce10 con 0x7f1b100cd4c0 2024-04-01T17:05:43.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.148+0000 7f1b06a00640 1 --2- 172.21.15.163:0/3344826597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b100cd4c0 0x7f1b10154550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1b1015b820 tx=0x7f1af802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c9f81bfc59bbb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:43.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.153+0000 7f1b0ea00640 1 -- 172.21.15.163:0/3344826597 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af80315a0 con 0x7f1b100cd4c0 2024-04-01T17:05:43.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.153+0000 7f1b0ea00640 1 -- 172.21.15.163:0/3344826597 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af8037070 con 0x7f1b100cd4c0 2024-04-01T17:05:43.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.153+0000 7f1b0ea00640 1 -- 172.21.15.163:0/3344826597 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af8031960 con 0x7f1b100cd4c0 2024-04-01T17:05:43.153 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.154+0000 7f1b16800640 1 -- 172.21.15.163:0/3344826597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b100cd4c0 msgr2=0x7f1b10154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:43.153 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.154+0000 7f1b16800640 1 --2- 172.21.15.163:0/3344826597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b100cd4c0 0x7f1b10154550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1b1015b820 tx=0x7f1af802b840 comp rx=0 tx=0).stop 2024-04-01T17:05:43.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.154+0000 7f1b16800640 1 -- 172.21.15.163:0/3344826597 shutdown_connections 2024-04-01T17:05:43.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.154+0000 7f1b16800640 1 --2- 172.21.15.163:0/3344826597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b100cd4c0 0x7f1b10154550 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.154+0000 7f1b16800640 1 --2- 172.21.15.163:0/3344826597 >> v2:172.21.15.189:3300/0 conn(0x7f1b100cadd0 0x7f1b10154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.154+0000 7f1b16800640 1 --2- 172.21.15.163:0/3344826597 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b100cd0e0 0x7f1b1015a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.154+0000 7f1b16800640 1 -- 172.21.15.163:0/3344826597 >> 172.21.15.163:0/3344826597 conn(0x7f1b10067460 msgr2=0x7f1b10067870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:43.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.154+0000 7f1b16800640 1 -- 172.21.15.163:0/3344826597 shutdown_connections 2024-04-01T17:05:43.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.154+0000 7f1b16800640 1 -- 172.21.15.163:0/3344826597 wait complete. 2024-04-01T17:05:43.155 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.156+0000 7f1b16800640 1 Processor -- start 2024-04-01T17:05:43.155 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.156+0000 7f1b16800640 1 -- start start 2024-04-01T17:05:43.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.157+0000 7f1b16800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b100cadd0 0x7f1b101f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.157+0000 7f1b16800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b100cd0e0 0x7f1b100cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.157+0000 7f1b16800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b100cd4c0 0x7f1b101498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.157+0000 7f1b16800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1006e050 con 0x7f1b100cd0e0 2024-04-01T17:05:43.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.157+0000 7f1b16800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1006d3d0 con 0x7f1b100cd4c0 2024-04-01T17:05:43.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.157+0000 7f1b16800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1006e1d0 con 0x7f1b100cadd0 2024-04-01T17:05:43.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.157+0000 7f1b06a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b100cd0e0 0x7f1b100cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.158+0000 7f1b0fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b100cd4c0 0x7f1b101498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.158+0000 7f1b0fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b100cd4c0 0x7f1b101498c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:40646/0 (socket says 172.21.15.163:40646) 2024-04-01T17:05:43.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.158+0000 7f1b0fe00640 1 -- 172.21.15.163:0/3201717 learned_addr learned my addr 172.21.15.163:0/3201717 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:43.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.158+0000 7f1b0f400640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b100cadd0 0x7f1b101f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.162+0000 7f1b06a00640 1 -- 172.21.15.163:0/3201717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b100cadd0 msgr2=0x7f1b101f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:43.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.162+0000 7f1b06a00640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f1b100cadd0 0x7f1b101f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.162 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.162+0000 7f1b06a00640 1 -- 172.21.15.163:0/3201717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b100cd4c0 msgr2=0x7f1b101498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:43.162 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.162+0000 7f1b06a00640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b100cd4c0 0x7f1b101498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.162 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.162+0000 7f1b06a00640 1 -- 172.21.15.163:0/3201717 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b101f4930 con 0x7f1b100cd0e0 2024-04-01T17:05:43.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.164+0000 7f1b06a00640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b100cd0e0 0x7f1b100cf9b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1b100d11e0 tx=0x7f1af80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:43.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.168+0000 7f1b07e00640 1 -- 172.21.15.163:0/3201717 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af8032630 con 0x7f1b100cd0e0 2024-04-01T17:05:43.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.168+0000 7f1b07e00640 1 -- 172.21.15.163:0/3201717 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af80327d0 con 0x7f1b100cd0e0 2024-04-01T17:05:43.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.168+0000 7f1b16800640 1 -- 172.21.15.163:0/3201717 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b101f4090 con 0x7f1b100cd0e0 2024-04-01T17:05:43.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.168+0000 7f1b07e00640 1 -- 172.21.15.163:0/3201717 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af8032bc0 con 0x7f1b100cd0e0 2024-04-01T17:05:43.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.169+0000 7f1b16800640 1 -- 172.21.15.163:0/3201717 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b101f4650 con 0x7f1b100cd0e0 2024-04-01T17:05:43.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.170+0000 7f1b16800640 1 -- 172.21.15.163:0/3201717 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b100756d0 con 0x7f1b100cd0e0 2024-04-01T17:05:43.198 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.199+0000 7f1b07e00640 1 -- 172.21.15.163:0/3201717 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1af804c070 con 0x7f1b100cd0e0 2024-04-01T17:05:43.199 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.200+0000 7f1b07e00640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1aec06c940 0x7f1aec06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.199 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.200+0000 7f1b0f400640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1aec06c940 0x7f1aec06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.201+0000 7f1b0f400640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1aec06c940 0x7f1aec06ee00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1b000113e0 tx=0x7f1b0000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:43.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.201+0000 7f1b07e00640 1 -- 172.21.15.163:0/3201717 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f1af802f060 con 0x7f1b100cd0e0 2024-04-01T17:05:43.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.202+0000 7f1b07e00640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] conn(0x7f1aec074cc0 0x7f1aec077140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.202+0000 7f1b07e00640 1 -- 172.21.15.163:0/3201717 --> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1af80067f0 con 0x7f1aec074cc0 2024-04-01T17:05:43.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.202+0000 7f1b07e00640 1 -- 172.21.15.163:0/3201717 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1af8077780 con 0x7f1b100cd0e0 2024-04-01T17:05:43.202 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.202+0000 7f1b0fe00640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] conn(0x7f1aec074cc0 0x7f1aec077140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.202 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.203+0000 7f1b0fe00640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] conn(0x7f1aec074cc0 0x7f1aec077140 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:43.204 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.205+0000 7f1b07e00640 1 -- 172.21.15.163:0/3201717 <== osd.7 v2:172.21.15.189:6808/2925885107 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1af80067f0 con 0x7f1aec074cc0 2024-04-01T17:05:43.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.222+0000 7f1b16800640 1 -- 172.21.15.163:0/3201717 --> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1b10159330 con 0x7f1aec074cc0 2024-04-01T17:05:43.222 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.223+0000 7f1b07e00640 1 -- 172.21.15.163:0/3201717 <== osd.7 v2:172.21.15.189:6808/2925885107 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1b10159330 con 0x7f1aec074cc0 2024-04-01T17:05:43.223 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-01T17:05:43.223 INFO:teuthology.orchestra.run.smithi163.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T17:05:43.223 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-01T17:05:43.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.223+0000 7f1b16800640 1 -- 172.21.15.163:0/3201717 >> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] conn(0x7f1aec074cc0 msgr2=0x7f1aec077140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:43.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.223+0000 7f1b16800640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.189:6808/2925885107,v1:172.21.15.189:6810/2925885107] conn(0x7f1aec074cc0 0x7f1aec077140 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.224+0000 7f1b16800640 1 -- 172.21.15.163:0/3201717 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1aec06c940 msgr2=0x7f1aec06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:43.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.224+0000 7f1b16800640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f1aec06c940 0x7f1aec06ee00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1b000113e0 tx=0x7f1b0000b040 comp rx=0 tx=0).stop 2024-04-01T17:05:43.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.224+0000 7f1b16800640 1 -- 172.21.15.163:0/3201717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b100cd0e0 msgr2=0x7f1b100cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:43.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.224+0000 7f1b16800640 1 --2- 172.21.15.163:0/3201717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b100cd0e0 0x7f1b100cf9b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1b100d11e0 tx=0x7f1af80046c0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.224+0000 7f1b0fe00640 1 -- 172.21.15.163:0/3201717 reap_dead start 2024-04-01T17:05:43.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.224+0000 7f1b16800640 1 -- 172.21.15.163:0/3201717 shutdown_connections 2024-04-01T17:05:43.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.224+0000 7f1b16800640 1 -- 172.21.15.163:0/3201717 >> 172.21.15.163:0/3201717 conn(0x7f1b10067460 msgr2=0x7f1b101585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:43.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.224+0000 7f1b16800640 1 -- 172.21.15.163:0/3201717 shutdown_connections 2024-04-01T17:05:43.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.224+0000 7f1b16800640 1 -- 172.21.15.163:0/3201717 wait complete. 2024-04-01T17:05:43.242 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-01T17:05:43.450 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.451+0000 7f2bfee00640 1 Processor -- start 2024-04-01T17:05:43.450 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.451+0000 7f2bfee00640 1 -- start start 2024-04-01T17:05:43.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.453+0000 7f2bfee00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf8152760 0x7f2bf806edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.453+0000 7f2bfee00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf81589d0 con 0x7f2bf8070010 2024-04-01T17:05:43.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.453+0000 7f2bfee00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf8158cb0 con 0x7f2bf815c1d0 2024-04-01T17:05:43.452 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.453+0000 7f2bfee00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf8159550 con 0x7f2bf8152760 2024-04-01T17:05:43.453 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.454+0000 7f2bf7400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f2bf8070010 0x7f2bf80c99a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:51142/0 (socket says 172.21.15.163:51142) 2024-04-01T17:05:43.453 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.454+0000 7f2bf7400640 1 -- 172.21.15.163:0/3891562864 learned_addr learned my addr 172.21.15.163:0/3891562864 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:05:43.454 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.454+0000 7f2bf7e00640 1 --2- 172.21.15.163:0/3891562864 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf8152760 0x7f2bf806edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.456 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.457+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426819792 0 0) 0x7f2bf81589d0 con 0x7f2bf8070010 2024-04-01T17:05:43.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.457+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bdc003520 con 0x7f2bf8070010 2024-04-01T17:05:43.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.460+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1269785301 0 0) 0x7f2bf8158cb0 con 0x7f2bf815c1d0 2024-04-01T17:05:43.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.460+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf81589d0 con 0x7f2bf815c1d0 2024-04-01T17:05:43.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.460+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2232123399 0 0) 0x7f2bdc003520 con 0x7f2bf8070010 2024-04-01T17:05:43.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.460+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf8152760 msgr2=0x7f2bf806edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:43.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.460+0000 7f2bf6a00640 1 --2- 172.21.15.163:0/3891562864 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf8152760 0x7f2bf806edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.460+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 >> v1:172.21.15.189:6789/0 conn(0x7f2bf815c1d0 legacy=0x7f2bf8162f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:43.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.461+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf8158f90 con 0x7f2bf8070010 2024-04-01T17:05:43.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.461+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7f2be4001670 con 0x7f2bf8070010 2024-04-01T17:05:43.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.461+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 >> v1:172.21.15.163:6789/0 conn(0x7f2bf8070010 legacy=0x7f2bf80c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:43.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.461+0000 7f2bf6a00640 1 --2- 172.21.15.163:0/3891562864 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf8152760 0x7f2bdc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.461+0000 7f2bf6a00640 1 --2- 172.21.15.163:0/3891562864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bdc004120 0x7f2bdc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.461+0000 7f2bf6a00640 1 --2- 172.21.15.163:0/3891562864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bdc004d40 0x7f2bdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.461+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8159550 con 0x7f2bdc004d40 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.461+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc00bb00 con 0x7f2bdc004120 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.461+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2bdc00bd00 con 0x7f2bf8152760 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.462+0000 7f2bfce00640 1 --2- 172.21.15.163:0/3891562864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bdc004d40 0x7f2bdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.468+0000 7f2bfce00640 1 -- 172.21.15.163:0/3891562864 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf8152760 msgr2=0x7f2bdc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.468+0000 7f2bfce00640 1 --2- 172.21.15.163:0/3891562864 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf8152760 0x7f2bdc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.468+0000 7f2bfce00640 1 -- 172.21.15.163:0/3891562864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bdc004120 msgr2=0x7f2bdc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.468+0000 7f2bfce00640 1 --2- 172.21.15.163:0/3891562864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bdc004120 0x7f2bdc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.468+0000 7f2bfce00640 1 -- 172.21.15.163:0/3891562864 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bdc003520 con 0x7f2bdc004d40 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.471+0000 7f2bfce00640 1 --2- 172.21.15.163:0/3891562864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bdc004d40 0x7f2bdc0051c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0001fd0 tx=0x7f2bdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8375d9b94ea6b99 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.475+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0001bf0 con 0x7f2bdc004d40 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.475+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf0003b70 con 0x7f2bdc004d40 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.475+0000 7f2bf6a00640 1 -- 172.21.15.163:0/3891562864 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf00050d0 con 0x7f2bdc004d40 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.476+0000 7f2bfee00640 1 -- 172.21.15.163:0/3891562864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bdc004d40 msgr2=0x7f2bdc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.476+0000 7f2bfee00640 1 --2- 172.21.15.163:0/3891562864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bdc004d40 0x7f2bdc0051c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0001fd0 tx=0x7f2bdc005830 comp rx=0 tx=0).stop 2024-04-01T17:05:43.509 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.476+0000 7f2bfce00640 1 -- 172.21.15.163:0/3891562864 reap_dead start 2024-04-01T17:05:43.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.476+0000 7f2bfee00640 1 -- 172.21.15.163:0/3891562864 shutdown_connections 2024-04-01T17:05:43.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.476+0000 7f2bfee00640 1 -- 172.21.15.163:0/3891562864 >> 172.21.15.163:0/3891562864 conn(0x7f2bf806c650 msgr2=0x7f2bf806ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:43.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.476+0000 7f2bfee00640 1 -- 172.21.15.163:0/3891562864 shutdown_connections 2024-04-01T17:05:43.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.476+0000 7f2bfee00640 1 -- 172.21.15.163:0/3891562864 wait complete. 2024-04-01T17:05:43.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.478+0000 7f2bfee00640 1 Processor -- start 2024-04-01T17:05:43.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.478+0000 7f2bfee00640 1 -- start start 2024-04-01T17:05:43.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.479+0000 7f2bfee00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bdc004d40 0x7f2bf81e3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.479+0000 7f2bfee00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bf81e3ba0 0x7f2bf80c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.479+0000 7f2bfee00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf80c32a0 0x7f2bf81503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.479+0000 7f2bfee00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8071910 con 0x7f2bf81e3ba0 2024-04-01T17:05:43.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.479+0000 7f2bfee00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf815bcb0 con 0x7f2bdc004d40 2024-04-01T17:05:43.510 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.479+0000 7f2bfee00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf80ca0b0 con 0x7f2bf80c32a0 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.481+0000 7f2bf7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bdc004d40 0x7f2bf81e3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.481+0000 7f2bfce00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf80c32a0 0x7f2bf81503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.481+0000 7f2bfce00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf80c32a0 0x7f2bf81503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:40296/0 (socket says 172.21.15.163:40296) 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.481+0000 7f2bfce00640 1 -- 172.21.15.163:0/3447272014 learned_addr learned my addr 172.21.15.163:0/3447272014 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.483+0000 7f2bf7400640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bf81e3ba0 0x7f2bf80c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.485+0000 7f2bfce00640 1 -- 172.21.15.163:0/3447272014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bdc004d40 msgr2=0x7f2bf81e3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.485+0000 7f2bfce00640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bdc004d40 0x7f2bf81e3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.485+0000 7f2bfce00640 1 -- 172.21.15.163:0/3447272014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bf81e3ba0 msgr2=0x7f2bf80c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.485+0000 7f2bfce00640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bf81e3ba0 0x7f2bf80c2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.485+0000 7f2bfce00640 1 -- 172.21.15.163:0/3447272014 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf80cbf90 con 0x7f2bf80c32a0 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.491+0000 7f2bfce00640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf80c32a0 0x7f2bf81503f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0005040 tx=0x7f2bf0001650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.499+0000 7f2befe00640 1 -- 172.21.15.163:0/3447272014 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0001bf0 con 0x7f2bf80c32a0 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.499+0000 7f2befe00640 1 -- 172.21.15.163:0/3447272014 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf0042070 con 0x7f2bf80c32a0 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.499+0000 7f2befe00640 1 -- 172.21.15.163:0/3447272014 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf00052e0 con 0x7f2bf80c32a0 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.499+0000 7f2bfee00640 1 -- 172.21.15.163:0/3447272014 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf80cc230 con 0x7f2bf80c32a0 2024-04-01T17:05:43.511 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.499+0000 7f2bfee00640 1 -- 172.21.15.163:0/3447272014 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf8151f60 con 0x7f2bf80c32a0 2024-04-01T17:05:43.512 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.500+0000 7f2bfee00640 1 -- 172.21.15.163:0/3447272014 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf806d5e0 con 0x7f2bf80c32a0 2024-04-01T17:05:43.851 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.851+0000 7f2befe00640 1 -- 172.21.15.163:0/3447272014 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2bf003c070 con 0x7f2bf80c32a0 2024-04-01T17:05:43.853 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.853+0000 7f2befe00640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2bd806c940 0x7f2bd806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:43.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.854+0000 7f2bf7e00640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2bd806c940 0x7f2bd806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:43.855 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.856+0000 7f2bf7e00640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2bd806c940 0x7f2bd806ee00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2be8004770 tx=0x7f2be8006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:43.860 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.861+0000 7f2befe00640 1 -- 172.21.15.163:0/3447272014 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f2bf0079670 con 0x7f2bf80c32a0 2024-04-01T17:05:43.893 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:43.894+0000 7f2befe00640 1 -- 172.21.15.163:0/3447272014 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2bf007bcd0 con 0x7f2bf80c32a0 2024-04-01T17:05:44.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.118+0000 7f2bfee00640 1 -- 172.21.15.163:0/3447272014 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f2bf80c8c80 con 0x7f2bd806c940 2024-04-01T17:05:44.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.119+0000 7f2befe00640 1 -- 172.21.15.163:0/3447272014 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2bf80c8c80 con 0x7f2bd806c940 2024-04-01T17:05:44.118 INFO:teuthology.orchestra.run.smithi163.stderr:instructed osd(s) 7 to deep-scrub 2024-04-01T17:05:44.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.121+0000 7f2bfee00640 1 -- 172.21.15.163:0/3447272014 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2bd806c940 msgr2=0x7f2bd806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:44.121 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.121+0000 7f2bfee00640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2bd806c940 0x7f2bd806ee00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2be8004770 tx=0x7f2be8006a20 comp rx=0 tx=0).stop 2024-04-01T17:05:44.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.121+0000 7f2bfee00640 1 -- 172.21.15.163:0/3447272014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf80c32a0 msgr2=0x7f2bf81503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:44.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.121+0000 7f2bfee00640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf80c32a0 0x7f2bf81503f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0005040 tx=0x7f2bf0001650 comp rx=0 tx=0).stop 2024-04-01T17:05:44.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.122+0000 7f2bfee00640 1 -- 172.21.15.163:0/3447272014 shutdown_connections 2024-04-01T17:05:44.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.122+0000 7f2bfee00640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2bd806c940 0x7f2bd806ee00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.122+0000 7f2bfee00640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2bf80c32a0 0x7f2bf81503f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.122+0000 7f2bfee00640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bf81e3ba0 0x7f2bf80c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.122+0000 7f2bfee00640 1 --2- 172.21.15.163:0/3447272014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bdc004d40 0x7f2bf81e3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.122+0000 7f2bfee00640 1 -- 172.21.15.163:0/3447272014 >> 172.21.15.163:0/3447272014 conn(0x7f2bf806c650 msgr2=0x7f2bf80c7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:44.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.122+0000 7f2bfee00640 1 -- 172.21.15.163:0/3447272014 shutdown_connections 2024-04-01T17:05:44.122 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.122+0000 7f2bfee00640 1 -- 172.21.15.163:0/3447272014 wait complete. 2024-04-01T17:05:44.139 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T17:05:44.341 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.341+0000 7f6660a00640 1 Processor -- start 2024-04-01T17:05:44.341 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.341+0000 7f6660a00640 1 -- start start 2024-04-01T17:05:44.342 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.343+0000 7f6660a00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f665c151530 0x7f665c071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:44.342 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.343+0000 7f6660a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665c15b250 0x7f665c0c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:44.343 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.343+0000 7f6660a00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665c0722d0 con 0x7f665c0c7330 2024-04-01T17:05:44.343 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.343+0000 7f6660a00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f665c0c10d0 con 0x7f665c151530 2024-04-01T17:05:44.343 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.343+0000 7f6660a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f665c0725b0 con 0x7f665c15b250 2024-04-01T17:05:44.343 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.344+0000 7f665b400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f665c151530 0x7f665c071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:44.344 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.344+0000 7f665b400640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f665c151530 0x7f665c071c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:39012/0 (socket says 172.21.15.163:39012) 2024-04-01T17:05:44.344 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.344+0000 7f665b400640 1 -- 172.21.15.163:0/1525092226 learned_addr learned my addr 172.21.15.163:0/1525092226 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:44.344 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.344+0000 7f6652a00640 1 --2- 172.21.15.163:0/1525092226 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665c15b250 0x7f665c0c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:44.346 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.347+0000 7f665b400640 1 -- 172.21.15.163:0/1525092226 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665c15b250 msgr2=0x7f665c0c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:05:44.346 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.347+0000 7f665b400640 1 --2- 172.21.15.163:0/1525092226 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665c15b250 0x7f665c0c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.346 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.347+0000 7f665b400640 1 -- 172.21.15.163:0/1525092226 >> v1:172.21.15.189:6789/0 conn(0x7f665c0c7330 legacy=0x7f665c0c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:44.346 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.347+0000 7f665b400640 1 -- 172.21.15.163:0/1525092226 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c072890 con 0x7f665c151530 2024-04-01T17:05:44.348 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.349+0000 7f665b400640 1 --2- 172.21.15.163:0/1525092226 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f665c151530 0x7f665c071c20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f664c00bb10 tx=0x7f664c02e1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1305574b3b6b83d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:44.353 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.353+0000 7f665aa00640 1 -- 172.21.15.163:0/1525092226 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c03b070 con 0x7f665c151530 2024-04-01T17:05:44.353 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.353+0000 7f665aa00640 1 -- 172.21.15.163:0/1525092226 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c036440 con 0x7f665c151530 2024-04-01T17:05:44.353 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.353+0000 7f665aa00640 1 -- 172.21.15.163:0/1525092226 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c036810 con 0x7f665c151530 2024-04-01T17:05:44.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.354+0000 7f6660a00640 1 -- 172.21.15.163:0/1525092226 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f665c151530 msgr2=0x7f665c071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:44.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.354+0000 7f6660a00640 1 --2- 172.21.15.163:0/1525092226 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f665c151530 0x7f665c071c20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f664c00bb10 tx=0x7f664c02e1f0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.354+0000 7f6660a00640 1 -- 172.21.15.163:0/1525092226 shutdown_connections 2024-04-01T17:05:44.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.354+0000 7f6660a00640 1 --2- 172.21.15.163:0/1525092226 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665c15b250 0x7f665c0c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.354+0000 7f6660a00640 1 --2- 172.21.15.163:0/1525092226 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f665c151530 0x7f665c071c20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.354+0000 7f6660a00640 1 -- 172.21.15.163:0/1525092226 >> 172.21.15.163:0/1525092226 conn(0x7f665c06f7d0 msgr2=0x7f665c06fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:44.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.354+0000 7f6660a00640 1 -- 172.21.15.163:0/1525092226 shutdown_connections 2024-04-01T17:05:44.354 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.354+0000 7f6660a00640 1 -- 172.21.15.163:0/1525092226 wait complete. 2024-04-01T17:05:44.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.356+0000 7f6660a00640 1 Processor -- start 2024-04-01T17:05:44.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.356+0000 7f6660a00640 1 -- start start 2024-04-01T17:05:44.356 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.357+0000 7f6660a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f665c0c7330 0x7f665c1f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:44.356 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.357+0000 7f6660a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f665c151530 0x7f665c14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:44.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.357+0000 7f6660a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665c15b250 0x7f665c159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:44.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.357+0000 7f6660a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f665c0c80b0 con 0x7f665c151530 2024-04-01T17:05:44.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.357+0000 7f6660a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f665c15b690 con 0x7f665c0c7330 2024-04-01T17:05:44.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.357+0000 7f6660a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f665c0c8230 con 0x7f665c15b250 2024-04-01T17:05:44.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.358+0000 7f6652a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f665c151530 0x7f665c14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:44.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.358+0000 7f6652a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f665c151530 0x7f665c14ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:39018/0 (socket says 172.21.15.163:39018) 2024-04-01T17:05:44.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.358+0000 7f6652a00640 1 -- 172.21.15.163:0/2251132192 learned_addr learned my addr 172.21.15.163:0/2251132192 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:05:44.358 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.358+0000 7f665b400640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f665c0c7330 0x7f665c1f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:44.358 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.359+0000 7f665be00640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665c15b250 0x7f665c159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:44.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.362+0000 7f6652a00640 1 -- 172.21.15.163:0/2251132192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665c15b250 msgr2=0x7f665c159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:44.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.362+0000 7f6652a00640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665c15b250 0x7f665c159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.362+0000 7f6652a00640 1 -- 172.21.15.163:0/2251132192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f665c0c7330 msgr2=0x7f665c1f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:44.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.362+0000 7f6652a00640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f665c0c7330 0x7f665c1f1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.362 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.362+0000 7f6652a00640 1 -- 172.21.15.163:0/2251132192 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c14ca10 con 0x7f665c151530 2024-04-01T17:05:44.363 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.364+0000 7f6652a00640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f665c151530 0x7f665c14ddd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f664400d620 tx=0x7f664400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:44.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.368+0000 7f6653e00640 1 -- 172.21.15.163:0/2251132192 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664400b620 con 0x7f665c151530 2024-04-01T17:05:44.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.368+0000 7f6653e00640 1 -- 172.21.15.163:0/2251132192 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6644019070 con 0x7f665c151530 2024-04-01T17:05:44.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.368+0000 7f6653e00640 1 -- 172.21.15.163:0/2251132192 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664400ba00 con 0x7f665c151530 2024-04-01T17:05:44.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.368+0000 7f6660a00640 1 -- 172.21.15.163:0/2251132192 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665c14e310 con 0x7f665c151530 2024-04-01T17:05:44.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.368+0000 7f6660a00640 1 -- 172.21.15.163:0/2251132192 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665c14cf90 con 0x7f665c151530 2024-04-01T17:05:44.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.369+0000 7f6660a00640 1 -- 172.21.15.163:0/2251132192 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f665c06f0b0 con 0x7f665c151530 2024-04-01T17:05:44.390 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.390+0000 7f6653e00640 1 -- 172.21.15.163:0/2251132192 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f664400bba0 con 0x7f665c151530 2024-04-01T17:05:44.391 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.391+0000 7f6653e00640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f663806c940 0x7f663806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:05:44.391 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.391+0000 7f6653e00640 1 -- 172.21.15.163:0/2251132192 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f664408c8b0 con 0x7f665c151530 2024-04-01T17:05:44.391 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.392+0000 7f665b400640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f663806c940 0x7f663806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:05:44.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.392+0000 7f665b400640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f663806c940 0x7f663806ee00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f664c038000 tx=0x7f664c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:05:44.693 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.693+0000 7f6653e00640 1 -- 172.21.15.163:0/2251132192 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f665c06f0b0 con 0x7f665c151530 2024-04-01T17:05:44.889 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.888+0000 7f6660a00640 1 -- 172.21.15.163:0/2251132192 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f665c072f30 con 0x7f663806c940 2024-04-01T17:05:44.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.896+0000 7f6653e00640 1 -- 172.21.15.163:0/2251132192 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251333 (secure 0 0 0) 0x7f664c0825e0 con 0x7f663806c940 2024-04-01T17:05:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T17:05:44.901 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T17:05:44.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.902+0000 7f6660a00640 1 -- 172.21.15.163:0/2251132192 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f663806c940 msgr2=0x7f663806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:44.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.902+0000 7f6660a00640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f663806c940 0x7f663806ee00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f664c038000 tx=0x7f664c032000 comp rx=0 tx=0).stop 2024-04-01T17:05:44.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.902+0000 7f6660a00640 1 -- 172.21.15.163:0/2251132192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f665c151530 msgr2=0x7f665c14ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:05:44.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.902+0000 7f6660a00640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f665c151530 0x7f665c14ddd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f664400d620 tx=0x7f664400dae0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.903+0000 7f6660a00640 1 -- 172.21.15.163:0/2251132192 shutdown_connections 2024-04-01T17:05:44.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.903+0000 7f6660a00640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f663806c940 0x7f663806ee00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.903+0000 7f6660a00640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f665c15b250 0x7f665c159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.903+0000 7f6660a00640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f665c151530 0x7f665c14ddd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.903+0000 7f6660a00640 1 --2- 172.21.15.163:0/2251132192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f665c0c7330 0x7f665c1f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:05:44.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.903+0000 7f6660a00640 1 -- 172.21.15.163:0/2251132192 >> 172.21.15.163:0/2251132192 conn(0x7f665c06f7d0 msgr2=0x7f665c0c1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:05:44.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.903+0000 7f6660a00640 1 -- 172.21.15.163:0/2251132192 shutdown_connections 2024-04-01T17:05:44.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:05:44.903+0000 7f6660a00640 1 -- 172.21.15.163:0/2251132192 wait complete. 2024-04-01T17:05:44.922 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":975,"stamp":"2024-04-01T17:05:44.590372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23181253,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":535,"num_read_kb":554,"num_write":8981,"num_write_kb":279196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8126,"ondisk_log_size":8126,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":334400,"kb_used_data":47552,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754640320,"statfs":{"total":773094113280,"available":772751687680,"internally_reserved":0,"allocated":48693248,"data_stored":47217626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":293654068},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004375"},"pg_stats":[{"pgid":"3.3f","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.153864+0000","last_change":"2024-04-01T16:34:34.033508+0000","last_active":"2024-04-01T17:05:23.153864+0000","last_peered":"2024-04-01T17:05:23.153864+0000","last_clean":"2024-04-01T17:05:23.153864+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T17:05:23.153864+0000","last_undegraded":"2024-04-01T17:05:23.153864+0000","last_fullsized":"2024-04-01T17:05:23.153864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'41","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.108703+0000","last_change":"2024-04-01T16:34:34.065375+0000","last_active":"2024-04-01T17:05:23.108703+0000","last_peered":"2024-04-01T17:05:23.108703+0000","last_clean":"2024-04-01T17:05:23.108703+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T17:05:23.108703+0000","last_undegraded":"2024-04-01T17:05:23.108703+0000","last_fullsized":"2024-04-01T17:05:23.108703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":1086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'48","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.314377+0000","last_change":"2024-04-01T16:34:34.084618+0000","last_active":"2024-04-01T17:05:23.314377+0000","last_peered":"2024-04-01T17:05:23.314377+0000","last_clean":"2024-04-01T17:05:23.314377+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T17:05:23.314377+0000","last_undegraded":"2024-04-01T17:05:23.314377+0000","last_fullsized":"2024-04-01T17:05:23.314377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.231935+0000","last_change":"2024-04-01T16:34:34.088694+0000","last_active":"2024-04-01T17:05:23.231935+0000","last_peered":"2024-04-01T17:05:23.231935+0000","last_clean":"2024-04-01T17:05:23.231935+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T17:05:23.231935+0000","last_undegraded":"2024-04-01T17:05:23.231935+0000","last_fullsized":"2024-04-01T17:05:23.231935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.154843+0000","last_change":"2024-04-01T16:34:34.085765+0000","last_active":"2024-04-01T17:05:23.154843+0000","last_peered":"2024-04-01T17:05:23.154843+0000","last_clean":"2024-04-01T17:05:23.154843+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T17:05:23.154843+0000","last_undegraded":"2024-04-01T17:05:23.154843+0000","last_fullsized":"2024-04-01T17:05:23.154843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'60","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.234713+0000","last_change":"2024-04-01T16:34:34.066150+0000","last_active":"2024-04-01T17:05:23.234713+0000","last_peered":"2024-04-01T17:05:23.234713+0000","last_clean":"2024-04-01T17:05:23.234713+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T17:05:23.234713+0000","last_undegraded":"2024-04-01T17:05:23.234713+0000","last_fullsized":"2024-04-01T17:05:23.234713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:08:56.651785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":2601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'34","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.147912+0000","last_change":"2024-04-01T16:34:34.072924+0000","last_active":"2024-04-01T17:05:23.147912+0000","last_peered":"2024-04-01T17:05:23.147912+0000","last_clean":"2024-04-01T17:05:23.147912+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T17:05:23.147912+0000","last_undegraded":"2024-04-01T17:05:23.147912+0000","last_fullsized":"2024-04-01T17:05:23.147912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:57:59.860831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'42","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.198441+0000","last_change":"2024-04-01T16:34:34.088361+0000","last_active":"2024-04-01T17:05:23.198441+0000","last_peered":"2024-04-01T17:05:23.198441+0000","last_clean":"2024-04-01T17:05:23.198441+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T17:05:23.198441+0000","last_undegraded":"2024-04-01T17:05:23.198441+0000","last_fullsized":"2024-04-01T17:05:23.198441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":1328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'48","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.155956+0000","last_change":"2024-04-01T16:34:34.038534+0000","last_active":"2024-04-01T17:05:23.155956+0000","last_peered":"2024-04-01T17:05:23.155956+0000","last_clean":"2024-04-01T17:05:23.155956+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T17:05:23.155956+0000","last_undegraded":"2024-04-01T17:05:23.155956+0000","last_fullsized":"2024-04-01T17:05:23.155956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:54.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.252744+0000","last_change":"2024-04-01T16:34:34.040513+0000","last_active":"2024-04-01T17:05:23.252744+0000","last_peered":"2024-04-01T17:05:23.252744+0000","last_clean":"2024-04-01T17:05:23.252744+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T17:05:23.252744+0000","last_undegraded":"2024-04-01T17:05:23.252744+0000","last_fullsized":"2024-04-01T17:05:23.252744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'36","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.245760+0000","last_change":"2024-04-01T16:34:34.038167+0000","last_active":"2024-04-01T17:05:23.245760+0000","last_peered":"2024-04-01T17:05:23.245760+0000","last_clean":"2024-04-01T17:05:23.245760+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T17:05:23.245760+0000","last_undegraded":"2024-04-01T17:05:23.245760+0000","last_fullsized":"2024-04-01T17:05:23.245760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'32","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.961495+0000","last_change":"2024-04-01T16:34:34.035177+0000","last_active":"2024-04-01T17:05:22.961495+0000","last_peered":"2024-04-01T17:05:22.961495+0000","last_clean":"2024-04-01T17:05:22.961495+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T17:05:22.961495+0000","last_undegraded":"2024-04-01T17:05:22.961495+0000","last_fullsized":"2024-04-01T17:05:22.961495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'66","reported_seq":108,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.098668+0000","last_change":"2024-04-01T17:05:43.098726+0000","last_active":"2024-04-01T17:05:43.098668+0000","last_peered":"2024-04-01T17:05:43.098668+0000","last_clean":"2024-04-01T17:05:43.098668+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T17:05:43.098668+0000","last_undegraded":"2024-04-01T17:05:43.098668+0000","last_fullsized":"2024-04-01T17:05:43.098668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2024-04-01T17:05:43.098457+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2024-04-01T17:05:43.098457+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.098457+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:00:34.364158+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'46","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.314064+0000","last_change":"2024-04-01T16:34:34.071535+0000","last_active":"2024-04-01T17:05:23.314064+0000","last_peered":"2024-04-01T17:05:23.314064+0000","last_clean":"2024-04-01T17:05:23.314064+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T17:05:23.314064+0000","last_undegraded":"2024-04-01T17:05:23.314064+0000","last_fullsized":"2024-04-01T17:05:23.314064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'45","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.633839+0000","last_change":"2024-04-01T17:05:42.633898+0000","last_active":"2024-04-01T17:05:42.633839+0000","last_peered":"2024-04-01T17:05:42.633839+0000","last_clean":"2024-04-01T17:05:42.633839+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T17:05:42.633839+0000","last_undegraded":"2024-04-01T17:05:42.633839+0000","last_fullsized":"2024-04-01T17:05:42.633839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-01T17:05:42.633595+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-01T17:05:42.633595+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.633595+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:05:41.844393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":3152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'51","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.231758+0000","last_change":"2024-04-01T16:34:34.064695+0000","last_active":"2024-04-01T17:05:23.231758+0000","last_peered":"2024-04-01T17:05:23.231758+0000","last_clean":"2024-04-01T17:05:23.231758+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T17:05:23.231758+0000","last_undegraded":"2024-04-01T17:05:23.231758+0000","last_fullsized":"2024-04-01T17:05:23.231758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:50.798148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'54","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.234026+0000","last_change":"2024-04-01T16:34:34.032994+0000","last_active":"2024-04-01T17:05:23.234026+0000","last_peered":"2024-04-01T17:05:23.234026+0000","last_clean":"2024-04-01T17:05:23.234026+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T17:05:23.234026+0000","last_undegraded":"2024-04-01T17:05:23.234026+0000","last_fullsized":"2024-04-01T17:05:23.234026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:05:34.436443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":6831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'56","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.050960+0000","last_change":"2024-04-01T16:34:34.082238+0000","last_active":"2024-04-01T17:05:23.050960+0000","last_peered":"2024-04-01T17:05:23.050960+0000","last_clean":"2024-04-01T17:05:23.050960+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T17:05:23.050960+0000","last_undegraded":"2024-04-01T17:05:23.050960+0000","last_fullsized":"2024-04-01T17:05:23.050960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.147694+0000","last_change":"2024-04-01T16:34:34.083056+0000","last_active":"2024-04-01T17:05:23.147694+0000","last_peered":"2024-04-01T17:05:23.147694+0000","last_clean":"2024-04-01T17:05:23.147694+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T17:05:23.147694+0000","last_undegraded":"2024-04-01T17:05:23.147694+0000","last_fullsized":"2024-04-01T17:05:23.147694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"27'66","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.248410+0000","last_change":"2024-04-01T16:34:34.034017+0000","last_active":"2024-04-01T17:05:23.248410+0000","last_peered":"2024-04-01T17:05:23.248410+0000","last_clean":"2024-04-01T17:05:23.248410+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T17:05:23.248410+0000","last_undegraded":"2024-04-01T17:05:23.248410+0000","last_fullsized":"2024-04-01T17:05:23.248410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"27'53","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.118822+0000","last_change":"2024-04-01T17:05:40.118919+0000","last_active":"2024-04-01T17:05:40.118822+0000","last_peered":"2024-04-01T17:05:40.118822+0000","last_clean":"2024-04-01T17:05:40.118822+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T17:05:40.118822+0000","last_undegraded":"2024-04-01T17:05:40.118822+0000","last_fullsized":"2024-04-01T17:05:40.118822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-04-01T17:05:40.118570+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-04-01T17:05:40.118570+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.118570+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:44:54.364433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"27'41","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.234841+0000","last_change":"2024-04-01T16:34:34.031774+0000","last_active":"2024-04-01T17:05:23.234841+0000","last_peered":"2024-04-01T17:05:23.234841+0000","last_clean":"2024-04-01T17:05:23.234841+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T17:05:23.234841+0000","last_undegraded":"2024-04-01T17:05:23.234841+0000","last_fullsized":"2024-04-01T17:05:23.234841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:39.294525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'56","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.195432+0000","last_change":"2024-04-01T16:34:34.090324+0000","last_active":"2024-04-01T17:05:23.195432+0000","last_peered":"2024-04-01T17:05:23.195432+0000","last_clean":"2024-04-01T17:05:23.195432+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T17:05:23.195432+0000","last_undegraded":"2024-04-01T17:05:23.195432+0000","last_fullsized":"2024-04-01T17:05:23.195432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":6379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'42","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.231684+0000","last_change":"2024-04-01T16:34:34.083544+0000","last_active":"2024-04-01T17:05:23.231684+0000","last_peered":"2024-04-01T17:05:23.231684+0000","last_clean":"2024-04-01T17:05:23.231684+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T17:05:23.231684+0000","last_undegraded":"2024-04-01T17:05:23.231684+0000","last_fullsized":"2024-04-01T17:05:23.231684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"27'33","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.191231+0000","last_change":"2024-04-01T16:34:34.090721+0000","last_active":"2024-04-01T17:05:23.191231+0000","last_peered":"2024-04-01T17:05:23.191231+0000","last_clean":"2024-04-01T17:05:23.191231+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T17:05:23.191231+0000","last_undegraded":"2024-04-01T17:05:23.191231+0000","last_fullsized":"2024-04-01T17:05:23.191231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"27'56","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.252321+0000","last_change":"2024-04-01T16:34:54.510600+0000","last_active":"2024-04-01T17:05:23.252321+0000","last_peered":"2024-04-01T17:05:23.252321+0000","last_clean":"2024-04-01T17:05:23.252321+0000","last_became_active":"2024-04-01T16:34:54.510173+0000","last_became_peered":"2024-04-01T16:34:54.510173+0000","last_unstale":"2024-04-01T17:05:23.252321+0000","last_undegraded":"2024-04-01T17:05:23.252321+0000","last_fullsized":"2024-04-01T17:05:23.252321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'40","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.103389+0000","last_change":"2024-04-01T16:34:34.091911+0000","last_active":"2024-04-01T17:05:23.103389+0000","last_peered":"2024-04-01T17:05:23.103389+0000","last_clean":"2024-04-01T17:05:23.103389+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T17:05:23.103389+0000","last_undegraded":"2024-04-01T17:05:23.103389+0000","last_fullsized":"2024-04-01T17:05:23.103389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"27'25","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.198160+0000","last_change":"2024-04-01T16:34:34.091540+0000","last_active":"2024-04-01T17:05:23.198160+0000","last_peered":"2024-04-01T17:05:23.198160+0000","last_clean":"2024-04-01T17:05:23.198160+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T17:05:23.198160+0000","last_undegraded":"2024-04-01T17:05:23.198160+0000","last_fullsized":"2024-04-01T17:05:23.198160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'39","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.242725+0000","last_change":"2024-04-01T16:34:34.087634+0000","last_active":"2024-04-01T17:05:23.242725+0000","last_peered":"2024-04-01T17:05:23.242725+0000","last_clean":"2024-04-01T17:05:23.242725+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T17:05:23.242725+0000","last_undegraded":"2024-04-01T17:05:23.242725+0000","last_fullsized":"2024-04-01T17:05:23.242725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"27'56","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.230780+0000","last_change":"2024-04-01T16:34:34.084026+0000","last_active":"2024-04-01T17:05:23.230780+0000","last_peered":"2024-04-01T17:05:23.230780+0000","last_clean":"2024-04-01T17:05:23.230780+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T17:05:23.230780+0000","last_undegraded":"2024-04-01T17:05:23.230780+0000","last_fullsized":"2024-04-01T17:05:23.230780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"27'46","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.049280+0000","last_change":"2024-04-01T16:34:34.088300+0000","last_active":"2024-04-01T17:05:23.049280+0000","last_peered":"2024-04-01T17:05:23.049280+0000","last_clean":"2024-04-01T17:05:23.049280+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T17:05:23.049280+0000","last_undegraded":"2024-04-01T17:05:23.049280+0000","last_fullsized":"2024-04-01T17:05:23.049280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"27'56","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.248155+0000","last_change":"2024-04-01T16:34:34.068348+0000","last_active":"2024-04-01T17:05:23.248155+0000","last_peered":"2024-04-01T17:05:23.248155+0000","last_clean":"2024-04-01T17:05:23.248155+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T17:05:23.248155+0000","last_undegraded":"2024-04-01T17:05:23.248155+0000","last_fullsized":"2024-04-01T17:05:23.248155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":5837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"27'29","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.957929+0000","last_change":"2024-04-01T16:34:33.901019+0000","last_active":"2024-04-01T17:05:22.957929+0000","last_peered":"2024-04-01T17:05:22.957929+0000","last_clean":"2024-04-01T17:05:22.957929+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T17:05:22.957929+0000","last_undegraded":"2024-04-01T17:05:22.957929+0000","last_fullsized":"2024-04-01T17:05:22.957929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'510","reported_seq":556,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:39.003970+0000","last_change":"2024-04-01T17:05:39.004003+0000","last_active":"2024-04-01T17:05:39.003970+0000","last_peered":"2024-04-01T17:05:39.003970+0000","last_clean":"2024-04-01T17:05:39.003970+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T17:05:39.003970+0000","last_undegraded":"2024-04-01T17:05:39.003970+0000","last_fullsized":"2024-04-01T17:05:39.003970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'510","last_scrub_stamp":"2024-04-01T17:05:39.003870+0000","last_deep_scrub":"27'510","last_deep_scrub_stamp":"2024-04-01T17:05:39.003870+0000","last_clean_scrub_stamp":"2024-04-01T17:05:39.003870+0000","objects_scrubbed":1,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:16:47.186005+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'34","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:37.044058+0000","last_change":"2024-04-01T17:05:37.044119+0000","last_active":"2024-04-01T17:05:37.044058+0000","last_peered":"2024-04-01T17:05:37.044058+0000","last_clean":"2024-04-01T17:05:37.044058+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T17:05:37.044058+0000","last_undegraded":"2024-04-01T17:05:37.044058+0000","last_fullsized":"2024-04-01T17:05:37.044058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T17:05:37.043862+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T17:05:37.043862+0000","last_clean_scrub_stamp":"2024-04-01T17:05:37.043862+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:47:39.797490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"27'433","reported_seq":479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.081837+0000","last_change":"2024-04-01T17:05:43.081901+0000","last_active":"2024-04-01T17:05:43.081837+0000","last_peered":"2024-04-01T17:05:43.081837+0000","last_clean":"2024-04-01T17:05:43.081837+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T17:05:43.081837+0000","last_undegraded":"2024-04-01T17:05:43.081837+0000","last_fullsized":"2024-04-01T17:05:43.081837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'433","last_scrub_stamp":"2024-04-01T17:05:43.081565+0000","last_deep_scrub":"27'433","last_deep_scrub_stamp":"2024-04-01T17:05:43.081565+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.081565+0000","objects_scrubbed":1,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:58.553659+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.034297+0000","last_change":"2024-04-01T17:05:41.034354+0000","last_active":"2024-04-01T17:05:41.034297+0000","last_peered":"2024-04-01T17:05:41.034297+0000","last_clean":"2024-04-01T17:05:41.034297+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T17:05:41.034297+0000","last_undegraded":"2024-04-01T17:05:41.034297+0000","last_fullsized":"2024-04-01T17:05:41.034297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-01T17:05:41.034109+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-01T17:05:41.034109+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.034109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:42:03.426829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'57","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.194319+0000","last_change":"2024-04-01T16:34:34.091302+0000","last_active":"2024-04-01T17:05:23.194319+0000","last_peered":"2024-04-01T17:05:23.194319+0000","last_clean":"2024-04-01T17:05:23.194319+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T17:05:23.194319+0000","last_undegraded":"2024-04-01T17:05:23.194319+0000","last_fullsized":"2024-04-01T17:05:23.194319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":3573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:50.021371+0000","last_change":"2024-04-01T16:34:31.567946+0000","last_active":"2024-04-01T17:04:50.021371+0000","last_peered":"2024-04-01T17:04:50.021371+0000","last_clean":"2024-04-01T17:04:50.021371+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T17:04:50.021371+0000","last_undegraded":"2024-04-01T17:04:50.021371+0000","last_fullsized":"2024-04-01T17:04:50.021371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'43","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.109356+0000","last_change":"2024-04-01T16:34:34.088894+0000","last_active":"2024-04-01T17:05:23.109356+0000","last_peered":"2024-04-01T17:05:23.109356+0000","last_clean":"2024-04-01T17:05:23.109356+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T17:05:23.109356+0000","last_undegraded":"2024-04-01T17:05:23.109356+0000","last_fullsized":"2024-04-01T17:05:23.109356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:55.160287+0000","last_change":"2024-04-01T16:34:31.566997+0000","last_active":"2024-04-01T17:04:55.160287+0000","last_peered":"2024-04-01T17:04:55.160287+0000","last_clean":"2024-04-01T17:04:55.160287+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T17:04:55.160287+0000","last_undegraded":"2024-04-01T17:04:55.160287+0000","last_fullsized":"2024-04-01T17:04:55.160287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'70","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.229858+0000","last_change":"2024-04-01T16:34:34.030831+0000","last_active":"2024-04-01T17:05:23.229858+0000","last_peered":"2024-04-01T17:05:23.229858+0000","last_clean":"2024-04-01T17:05:23.229858+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T17:05:23.229858+0000","last_undegraded":"2024-04-01T17:05:23.229858+0000","last_fullsized":"2024-04-01T17:05:23.229858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:14:56.155341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:36.765896+0000","last_change":"2024-04-01T16:34:31.569927+0000","last_active":"2024-04-01T17:04:36.765896+0000","last_peered":"2024-04-01T17:04:36.765896+0000","last_clean":"2024-04-01T17:04:36.765896+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T17:04:36.765896+0000","last_undegraded":"2024-04-01T17:04:36.765896+0000","last_fullsized":"2024-04-01T17:04:36.765896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:11:41.162258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'48","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.150120+0000","last_change":"2024-04-01T17:05:41.150163+0000","last_active":"2024-04-01T17:05:41.150120+0000","last_peered":"2024-04-01T17:05:41.150120+0000","last_clean":"2024-04-01T17:05:41.150120+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T17:05:41.150120+0000","last_undegraded":"2024-04-01T17:05:41.150120+0000","last_fullsized":"2024-04-01T17:05:41.150120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-01T17:05:41.149974+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-01T17:05:41.149974+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.149974+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:45:12.015247+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"27'310","reported_seq":356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.620480+0000","last_change":"2024-04-01T17:05:41.620536+0000","last_active":"2024-04-01T17:05:41.620480+0000","last_peered":"2024-04-01T17:05:41.620480+0000","last_clean":"2024-04-01T17:05:41.620480+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T17:05:41.620480+0000","last_undegraded":"2024-04-01T17:05:41.620480+0000","last_fullsized":"2024-04-01T17:05:41.620480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'310","last_scrub_stamp":"2024-04-01T17:05:41.620340+0000","last_deep_scrub":"27'310","last_deep_scrub_stamp":"2024-04-01T17:05:41.620340+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.620340+0000","objects_scrubbed":2,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:42:04.013060+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'53","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.963648+0000","last_change":"2024-04-01T16:34:33.916652+0000","last_active":"2024-04-01T17:05:22.963648+0000","last_peered":"2024-04-01T17:05:22.963648+0000","last_clean":"2024-04-01T17:05:22.963648+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T17:05:22.963648+0000","last_undegraded":"2024-04-01T17:05:22.963648+0000","last_fullsized":"2024-04-01T17:05:22.963648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":3009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"27'798","reported_seq":837,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:18.690012+0000","last_change":"2024-04-01T16:34:31.531366+0000","last_active":"2024-04-01T17:05:18.690012+0000","last_peered":"2024-04-01T17:05:18.690012+0000","last_clean":"2024-04-01T17:05:18.690012+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T17:05:18.690012+0000","last_undegraded":"2024-04-01T17:05:18.690012+0000","last_fullsized":"2024-04-01T17:05:18.690012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'42","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.147953+0000","last_change":"2024-04-01T16:34:34.085449+0000","last_active":"2024-04-01T17:05:23.147953+0000","last_peered":"2024-04-01T17:05:23.147953+0000","last_clean":"2024-04-01T17:05:23.147953+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T17:05:23.147953+0000","last_undegraded":"2024-04-01T17:05:23.147953+0000","last_fullsized":"2024-04-01T17:05:23.147953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.493799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:36.092993+0000","last_change":"2024-04-01T17:05:36.093056+0000","last_active":"2024-04-01T17:05:36.092993+0000","last_peered":"2024-04-01T17:05:36.092993+0000","last_clean":"2024-04-01T17:05:36.092993+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T17:05:36.092993+0000","last_undegraded":"2024-04-01T17:05:36.092993+0000","last_fullsized":"2024-04-01T17:05:36.092993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-01T17:05:36.092790+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-01T17:05:36.092790+0000","last_clean_scrub_stamp":"2024-04-01T17:05:36.092790+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:15:24.776059+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'50","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.313601+0000","last_change":"2024-04-01T16:34:34.071521+0000","last_active":"2024-04-01T17:05:23.313601+0000","last_peered":"2024-04-01T17:05:23.313601+0000","last_clean":"2024-04-01T17:05:23.313601+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T17:05:23.313601+0000","last_undegraded":"2024-04-01T17:05:23.313601+0000","last_fullsized":"2024-04-01T17:05:23.313601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:12.982073+0000","last_change":"2024-04-01T16:34:31.566202+0000","last_active":"2024-04-01T17:05:12.982073+0000","last_peered":"2024-04-01T17:05:12.982073+0000","last_clean":"2024-04-01T17:05:12.982073+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T17:05:12.982073+0000","last_undegraded":"2024-04-01T17:05:12.982073+0000","last_fullsized":"2024-04-01T17:05:12.982073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:54.543283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'72","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.182012+0000","last_change":"2024-04-01T16:34:33.930561+0000","last_active":"2024-04-01T17:05:23.182012+0000","last_peered":"2024-04-01T17:05:23.182012+0000","last_clean":"2024-04-01T17:05:23.182012+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T17:05:23.182012+0000","last_undegraded":"2024-04-01T17:05:23.182012+0000","last_fullsized":"2024-04-01T17:05:23.182012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:37:27.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":8452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:53.438875+0000","last_change":"2024-04-01T16:34:31.535895+0000","last_active":"2024-04-01T17:04:53.438875+0000","last_peered":"2024-04-01T17:04:53.438875+0000","last_clean":"2024-04-01T17:04:53.438875+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T17:04:53.438875+0000","last_undegraded":"2024-04-01T17:04:53.438875+0000","last_fullsized":"2024-04-01T17:04:53.438875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'37","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.246317+0000","last_change":"2024-04-01T16:34:34.068194+0000","last_active":"2024-04-01T17:05:23.246317+0000","last_peered":"2024-04-01T17:05:23.246317+0000","last_clean":"2024-04-01T17:05:23.246317+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T17:05:23.246317+0000","last_undegraded":"2024-04-01T17:05:23.246317+0000","last_fullsized":"2024-04-01T17:05:23.246317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.219567+0000","last_change":"2024-04-01T17:05:40.219633+0000","last_active":"2024-04-01T17:05:40.219567+0000","last_peered":"2024-04-01T17:05:40.219567+0000","last_clean":"2024-04-01T17:05:40.219567+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T17:05:40.219567+0000","last_undegraded":"2024-04-01T17:05:40.219567+0000","last_fullsized":"2024-04-01T17:05:40.219567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-01T17:05:40.219401+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-01T17:05:40.219401+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.219401+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:04:46.211962+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.149246+0000","last_change":"2024-04-01T16:34:33.926318+0000","last_active":"2024-04-01T17:05:23.149246+0000","last_peered":"2024-04-01T17:05:23.149246+0000","last_clean":"2024-04-01T17:05:23.149246+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T17:05:23.149246+0000","last_undegraded":"2024-04-01T17:05:23.149246+0000","last_fullsized":"2024-04-01T17:05:23.149246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:32:36.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.355119+0000","last_change":"2024-04-01T17:05:40.355160+0000","last_active":"2024-04-01T17:05:40.355119+0000","last_peered":"2024-04-01T17:05:40.355119+0000","last_clean":"2024-04-01T17:05:40.355119+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T17:05:40.355119+0000","last_undegraded":"2024-04-01T17:05:40.355119+0000","last_fullsized":"2024-04-01T17:05:40.355119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T17:05:40.355024+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T17:05:40.355024+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.355024+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:02:14.569947+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'29","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.146008+0000","last_change":"2024-04-01T16:34:33.931211+0000","last_active":"2024-04-01T17:05:23.146008+0000","last_peered":"2024-04-01T17:05:23.146008+0000","last_clean":"2024-04-01T17:05:23.146008+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T17:05:23.146008+0000","last_undegraded":"2024-04-01T17:05:23.146008+0000","last_fullsized":"2024-04-01T17:05:23.146008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:15:45.228051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:39.217283+0000","last_change":"2024-04-01T17:05:39.217329+0000","last_active":"2024-04-01T17:05:39.217283+0000","last_peered":"2024-04-01T17:05:39.217283+0000","last_clean":"2024-04-01T17:05:39.217283+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T17:05:39.217283+0000","last_undegraded":"2024-04-01T17:05:39.217283+0000","last_fullsized":"2024-04-01T17:05:39.217283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:39.217203+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:39.217203+0000","last_clean_scrub_stamp":"2024-04-01T17:05:39.217203+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:26:19.798332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'39","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.155875+0000","last_change":"2024-04-01T16:34:33.930791+0000","last_active":"2024-04-01T17:05:23.155875+0000","last_peered":"2024-04-01T17:05:23.155875+0000","last_clean":"2024-04-01T17:05:23.155875+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T17:05:23.155875+0000","last_undegraded":"2024-04-01T17:05:23.155875+0000","last_fullsized":"2024-04-01T17:05:23.155875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:07:53.102054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:37.543319+0000","last_change":"2024-04-01T17:05:37.543363+0000","last_active":"2024-04-01T17:05:37.543319+0000","last_peered":"2024-04-01T17:05:37.543319+0000","last_clean":"2024-04-01T17:05:37.543319+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T17:05:37.543319+0000","last_undegraded":"2024-04-01T17:05:37.543319+0000","last_fullsized":"2024-04-01T17:05:37.543319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T17:05:37.543210+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T17:05:37.543210+0000","last_clean_scrub_stamp":"2024-04-01T17:05:37.543210+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:53.015304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'50","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.230734+0000","last_change":"2024-04-01T16:34:34.085219+0000","last_active":"2024-04-01T17:05:23.230734+0000","last_peered":"2024-04-01T17:05:23.230734+0000","last_clean":"2024-04-01T17:05:23.230734+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T17:05:23.230734+0000","last_undegraded":"2024-04-01T17:05:23.230734+0000","last_fullsized":"2024-04-01T17:05:23.230734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:05:05.286802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"27'1","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.211704+0000","last_change":"2024-04-01T17:05:41.211856+0000","last_active":"2024-04-01T17:05:41.211704+0000","last_peered":"2024-04-01T17:05:41.211704+0000","last_clean":"2024-04-01T17:05:41.211704+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T17:05:41.211704+0000","last_undegraded":"2024-04-01T17:05:41.211704+0000","last_fullsized":"2024-04-01T17:05:41.211704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-01T17:05:41.211442+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-01T17:05:41.211442+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.211442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:54:59.880820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'41","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.148743+0000","last_change":"2024-04-01T16:34:34.039521+0000","last_active":"2024-04-01T17:05:23.148743+0000","last_peered":"2024-04-01T17:05:23.148743+0000","last_clean":"2024-04-01T17:05:23.148743+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T17:05:23.148743+0000","last_undegraded":"2024-04-01T17:05:23.148743+0000","last_fullsized":"2024-04-01T17:05:23.148743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":4631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:02:11.703709+0000","last_change":"2024-04-01T16:34:08.195697+0000","last_active":"2024-04-01T17:02:11.703709+0000","last_peered":"2024-04-01T17:02:11.703709+0000","last_clean":"2024-04-01T17:02:11.703709+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T17:02:11.703709+0000","last_undegraded":"2024-04-01T17:02:11.703709+0000","last_fullsized":"2024-04-01T17:02:11.703709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:06.247737+0000","last_clean_scrub_stamp":"2024-04-01T16:34:06.247737+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:05:51.067541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:06.810588+0000","last_change":"2024-04-01T16:34:31.569697+0000","last_active":"2024-04-01T17:05:06.810588+0000","last_peered":"2024-04-01T17:05:06.810588+0000","last_clean":"2024-04-01T17:05:06.810588+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T17:05:06.810588+0000","last_undegraded":"2024-04-01T17:05:06.810588+0000","last_fullsized":"2024-04-01T17:05:06.810588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:32:01.736852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'39","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.193001+0000","last_change":"2024-04-01T16:34:34.087298+0000","last_active":"2024-04-01T17:05:23.193001+0000","last_peered":"2024-04-01T17:05:23.193001+0000","last_clean":"2024-04-01T17:05:23.193001+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T17:05:23.193001+0000","last_undegraded":"2024-04-01T17:05:23.193001+0000","last_fullsized":"2024-04-01T17:05:23.193001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:36.417042+0000","last_change":"2024-04-01T16:34:31.509150+0000","last_active":"2024-04-01T17:04:36.417042+0000","last_peered":"2024-04-01T17:04:36.417042+0000","last_clean":"2024-04-01T17:04:36.417042+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T17:04:36.417042+0000","last_undegraded":"2024-04-01T17:04:36.417042+0000","last_fullsized":"2024-04-01T17:04:36.417042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:39:43.101422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'25","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:39.092065+0000","last_change":"2024-04-01T17:05:39.092125+0000","last_active":"2024-04-01T17:05:39.092065+0000","last_peered":"2024-04-01T17:05:39.092065+0000","last_clean":"2024-04-01T17:05:39.092065+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T17:05:39.092065+0000","last_undegraded":"2024-04-01T17:05:39.092065+0000","last_fullsized":"2024-04-01T17:05:39.092065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-01T17:05:39.091867+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-01T17:05:39.091867+0000","last_clean_scrub_stamp":"2024-04-01T17:05:39.091867+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:56:52.638072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"27'432","reported_seq":899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:38.239241+0000","last_change":"2024-04-01T17:05:38.239306+0000","last_active":"2024-04-01T17:05:38.239241+0000","last_peered":"2024-04-01T17:05:38.239241+0000","last_clean":"2024-04-01T17:05:38.239241+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T17:05:38.239241+0000","last_undegraded":"2024-04-01T17:05:38.239241+0000","last_fullsized":"2024-04-01T17:05:38.239241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'432","last_scrub_stamp":"2024-04-01T17:05:38.239062+0000","last_deep_scrub":"27'432","last_deep_scrub_stamp":"2024-04-01T17:05:38.239062+0000","last_clean_scrub_stamp":"2024-04-01T17:05:38.239062+0000","objects_scrubbed":1,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:54:04.547897+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110595,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":419,"num_read_kb":454,"num_write":427,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'53","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.106094+0000","last_change":"2024-04-01T16:34:34.083194+0000","last_active":"2024-04-01T17:05:23.106094+0000","last_peered":"2024-04-01T17:05:23.106094+0000","last_clean":"2024-04-01T17:05:23.106094+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T17:05:23.106094+0000","last_undegraded":"2024-04-01T17:05:23.106094+0000","last_fullsized":"2024-04-01T17:05:23.106094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:43.692930+0000","last_change":"2024-04-01T16:34:31.569571+0000","last_active":"2024-04-01T17:04:43.692930+0000","last_peered":"2024-04-01T17:04:43.692930+0000","last_clean":"2024-04-01T17:04:43.692930+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T17:04:43.692930+0000","last_undegraded":"2024-04-01T17:04:43.692930+0000","last_fullsized":"2024-04-01T17:04:43.692930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:01:10.626933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'26","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.959176+0000","last_change":"2024-04-01T16:34:34.063200+0000","last_active":"2024-04-01T17:05:22.959176+0000","last_peered":"2024-04-01T17:05:22.959176+0000","last_clean":"2024-04-01T17:05:22.959176+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T17:05:22.959176+0000","last_undegraded":"2024-04-01T17:05:22.959176+0000","last_fullsized":"2024-04-01T17:05:22.959176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":2569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:38.538088+0000","last_change":"2024-04-01T17:05:38.538148+0000","last_active":"2024-04-01T17:05:38.538088+0000","last_peered":"2024-04-01T17:05:38.538088+0000","last_clean":"2024-04-01T17:05:38.538088+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T17:05:38.538088+0000","last_undegraded":"2024-04-01T17:05:38.538088+0000","last_fullsized":"2024-04-01T17:05:38.538088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:38.537869+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:38.537869+0000","last_clean_scrub_stamp":"2024-04-01T17:05:38.537869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:02:05.299257+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'34","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.049655+0000","last_change":"2024-04-01T16:34:54.510347+0000","last_active":"2024-04-01T17:05:23.049655+0000","last_peered":"2024-04-01T17:05:23.049655+0000","last_clean":"2024-04-01T17:05:23.049655+0000","last_became_active":"2024-04-01T16:34:54.509976+0000","last_became_peered":"2024-04-01T16:34:54.509976+0000","last_unstale":"2024-04-01T17:05:23.049655+0000","last_undegraded":"2024-04-01T17:05:23.049655+0000","last_fullsized":"2024-04-01T17:05:23.049655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:01.205221+0000","last_change":"2024-04-01T16:34:31.426647+0000","last_active":"2024-04-01T17:05:01.205221+0000","last_peered":"2024-04-01T17:05:01.205221+0000","last_clean":"2024-04-01T17:05:01.205221+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T17:05:01.205221+0000","last_undegraded":"2024-04-01T17:05:01.205221+0000","last_fullsized":"2024-04-01T17:05:01.205221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:53:36.926701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'40","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.104311+0000","last_change":"2024-04-01T16:34:34.087431+0000","last_active":"2024-04-01T17:05:23.104311+0000","last_peered":"2024-04-01T17:05:23.104311+0000","last_clean":"2024-04-01T17:05:23.104311+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T17:05:23.104311+0000","last_undegraded":"2024-04-01T17:05:23.104311+0000","last_fullsized":"2024-04-01T17:05:23.104311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"27'1149","reported_seq":1197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.590920+0000","last_change":"2024-04-01T17:05:40.590944+0000","last_active":"2024-04-01T17:05:40.590920+0000","last_peered":"2024-04-01T17:05:40.590920+0000","last_clean":"2024-04-01T17:05:40.590920+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T17:05:40.590920+0000","last_undegraded":"2024-04-01T17:05:40.590920+0000","last_fullsized":"2024-04-01T17:05:40.590920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1149","last_scrub_stamp":"2024-04-01T17:05:40.590838+0000","last_deep_scrub":"27'1149","last_deep_scrub_stamp":"2024-04-01T17:05:40.590838+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.590838+0000","objects_scrubbed":1,"log_size":1149,"log_dups_size":0,"ondisk_log_size":1149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:45:57.078147+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2752,"num_write_kb":935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'33","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.050523+0000","last_change":"2024-04-01T17:05:42.050558+0000","last_active":"2024-04-01T17:05:42.050523+0000","last_peered":"2024-04-01T17:05:42.050523+0000","last_clean":"2024-04-01T17:05:42.050523+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T17:05:42.050523+0000","last_undegraded":"2024-04-01T17:05:42.050523+0000","last_fullsized":"2024-04-01T17:05:42.050523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-04-01T17:05:42.050400+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-04-01T17:05:42.050400+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.050400+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:05:41.261198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:14.910885+0000","last_change":"2024-04-01T16:34:31.534057+0000","last_active":"2024-04-01T17:05:14.910885+0000","last_peered":"2024-04-01T17:05:14.910885+0000","last_clean":"2024-04-01T17:05:14.910885+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T17:05:14.910885+0000","last_undegraded":"2024-04-01T17:05:14.910885+0000","last_fullsized":"2024-04-01T17:05:14.910885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'56","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.313764+0000","last_change":"2024-04-01T16:34:34.073261+0000","last_active":"2024-04-01T17:05:23.313764+0000","last_peered":"2024-04-01T17:05:23.313764+0000","last_clean":"2024-04-01T17:05:23.313764+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T17:05:23.313764+0000","last_undegraded":"2024-04-01T17:05:23.313764+0000","last_fullsized":"2024-04-01T17:05:23.313764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":6288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:00.296785+0000","last_change":"2024-04-01T16:34:31.423531+0000","last_active":"2024-04-01T17:05:00.296785+0000","last_peered":"2024-04-01T17:05:00.296785+0000","last_clean":"2024-04-01T17:05:00.296785+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T17:05:00.296785+0000","last_undegraded":"2024-04-01T17:05:00.296785+0000","last_fullsized":"2024-04-01T17:05:00.296785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:02:43.708254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'38","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:22.952826+0000","last_change":"2024-04-01T16:34:34.086029+0000","last_active":"2024-04-01T17:05:22.952826+0000","last_peered":"2024-04-01T17:05:22.952826+0000","last_clean":"2024-04-01T17:05:22.952826+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T17:05:22.952826+0000","last_undegraded":"2024-04-01T17:05:22.952826+0000","last_fullsized":"2024-04-01T17:05:22.952826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:36.507430+0000","last_change":"2024-04-01T17:05:36.507464+0000","last_active":"2024-04-01T17:05:36.507430+0000","last_peered":"2024-04-01T17:05:36.507430+0000","last_clean":"2024-04-01T17:05:36.507430+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T17:05:36.507430+0000","last_undegraded":"2024-04-01T17:05:36.507430+0000","last_fullsized":"2024-04-01T17:05:36.507430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:36.507322+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:36.507322+0000","last_clean_scrub_stamp":"2024-04-01T17:05:36.507322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:43:12.680568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'43","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.197678+0000","last_change":"2024-04-01T16:34:34.091932+0000","last_active":"2024-04-01T17:05:23.197678+0000","last_peered":"2024-04-01T17:05:23.197678+0000","last_clean":"2024-04-01T17:05:23.197678+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T17:05:23.197678+0000","last_undegraded":"2024-04-01T17:05:23.197678+0000","last_fullsized":"2024-04-01T17:05:23.197678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:39.578374+0000","last_change":"2024-04-01T17:05:39.578429+0000","last_active":"2024-04-01T17:05:39.578374+0000","last_peered":"2024-04-01T17:05:39.578374+0000","last_clean":"2024-04-01T17:05:39.578374+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T17:05:39.578374+0000","last_undegraded":"2024-04-01T17:05:39.578374+0000","last_fullsized":"2024-04-01T17:05:39.578374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-01T17:05:39.578178+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-01T17:05:39.578178+0000","last_clean_scrub_stamp":"2024-04-01T17:05:39.578178+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:16:47.760313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'58","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.108394+0000","last_change":"2024-04-01T16:34:55.004709+0000","last_active":"2024-04-01T17:05:23.108394+0000","last_peered":"2024-04-01T17:05:23.108394+0000","last_clean":"2024-04-01T17:05:23.108394+0000","last_became_active":"2024-04-01T16:34:55.003987+0000","last_became_peered":"2024-04-01T16:34:55.003987+0000","last_unstale":"2024-04-01T17:05:23.108394+0000","last_undegraded":"2024-04-01T17:05:23.108394+0000","last_fullsized":"2024-04-01T17:05:23.108394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"27'622","reported_seq":660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:20.069789+0000","last_change":"2024-04-01T16:34:31.444603+0000","last_active":"2024-04-01T17:04:20.069789+0000","last_peered":"2024-04-01T17:04:20.069789+0000","last_clean":"2024-04-01T17:04:20.069789+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T17:04:20.069789+0000","last_undegraded":"2024-04-01T17:04:20.069789+0000","last_fullsized":"2024-04-01T17:04:20.069789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:27:36.252146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.247882+0000","last_change":"2024-04-01T16:34:34.034061+0000","last_active":"2024-04-01T17:05:23.247882+0000","last_peered":"2024-04-01T17:05:23.247882+0000","last_clean":"2024-04-01T17:05:23.247882+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T17:05:23.247882+0000","last_undegraded":"2024-04-01T17:05:23.247882+0000","last_fullsized":"2024-04-01T17:05:23.247882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"27'54","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.049534+0000","last_change":"2024-04-01T16:34:55.011962+0000","last_active":"2024-04-01T17:05:23.049534+0000","last_peered":"2024-04-01T17:05:23.049534+0000","last_clean":"2024-04-01T17:05:23.049534+0000","last_became_active":"2024-04-01T16:34:55.011400+0000","last_became_peered":"2024-04-01T16:34:55.011400+0000","last_unstale":"2024-04-01T17:05:23.049534+0000","last_undegraded":"2024-04-01T17:05:23.049534+0000","last_fullsized":"2024-04-01T17:05:23.049534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":3157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:04:49.977812+0000","last_change":"2024-04-01T16:34:31.563882+0000","last_active":"2024-04-01T17:04:49.977812+0000","last_peered":"2024-04-01T17:04:49.977812+0000","last_clean":"2024-04-01T17:04:49.977812+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T17:04:49.977812+0000","last_undegraded":"2024-04-01T17:04:49.977812+0000","last_fullsized":"2024-04-01T17:04:49.977812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:12:27.209535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'35","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.233213+0000","last_change":"2024-04-01T16:34:34.034904+0000","last_active":"2024-04-01T17:05:23.233213+0000","last_peered":"2024-04-01T17:05:23.233213+0000","last_clean":"2024-04-01T17:05:23.233213+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T17:05:23.233213+0000","last_undegraded":"2024-04-01T17:05:23.233213+0000","last_fullsized":"2024-04-01T17:05:23.233213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T20:06:41.632547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:00.297118+0000","last_change":"2024-04-01T16:34:31.530246+0000","last_active":"2024-04-01T17:05:00.297118+0000","last_peered":"2024-04-01T17:05:00.297118+0000","last_clean":"2024-04-01T17:05:00.297118+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T17:05:00.297118+0000","last_undegraded":"2024-04-01T17:05:00.297118+0000","last_fullsized":"2024-04-01T17:05:00.297118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:29.918031+0000","last_clean_scrub_stamp":"2024-04-01T16:34:29.918031+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:48.430325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"27'50","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:38.055119+0000","last_change":"2024-04-01T17:05:38.055147+0000","last_active":"2024-04-01T17:05:38.055119+0000","last_peered":"2024-04-01T17:05:38.055119+0000","last_clean":"2024-04-01T17:05:38.055119+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T17:05:38.055119+0000","last_undegraded":"2024-04-01T17:05:38.055119+0000","last_fullsized":"2024-04-01T17:05:38.055119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-01T17:05:38.055022+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-01T17:05:38.055022+0000","last_clean_scrub_stamp":"2024-04-01T17:05:38.055022+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:33:14.299302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":6181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"27'145","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.029202+0000","last_change":"2024-04-01T17:05:40.029324+0000","last_active":"2024-04-01T17:05:40.029202+0000","last_peered":"2024-04-01T17:05:40.029202+0000","last_clean":"2024-04-01T17:05:40.029202+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T17:05:40.029202+0000","last_undegraded":"2024-04-01T17:05:40.029202+0000","last_fullsized":"2024-04-01T17:05:40.029202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'145","last_scrub_stamp":"2024-04-01T17:05:40.028905+0000","last_deep_scrub":"27'145","last_deep_scrub_stamp":"2024-04-01T17:05:40.028905+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.028905+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:45:56.516215+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507300,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.194449+0000","last_change":"2024-04-01T16:34:34.087097+0000","last_active":"2024-04-01T17:05:23.194449+0000","last_peered":"2024-04-01T17:05:23.194449+0000","last_clean":"2024-04-01T17:05:23.194449+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T17:05:23.194449+0000","last_undegraded":"2024-04-01T17:05:23.194449+0000","last_fullsized":"2024-04-01T17:05:23.194449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'624","reported_seq":672,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:35.131323+0000","last_change":"2024-04-01T17:05:35.131515+0000","last_active":"2024-04-01T17:05:35.131323+0000","last_peered":"2024-04-01T17:05:35.131323+0000","last_clean":"2024-04-01T17:05:35.131323+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T17:05:35.131323+0000","last_undegraded":"2024-04-01T17:05:35.131323+0000","last_fullsized":"2024-04-01T17:05:35.131323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'624","last_scrub_stamp":"2024-04-01T17:05:35.131096+0000","last_deep_scrub":"27'624","last_deep_scrub_stamp":"2024-04-01T17:05:35.131096+0000","last_clean_scrub_stamp":"2024-04-01T17:05:35.131096+0000","objects_scrubbed":3,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:23:24.577710+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2204,"num_write_kb":251439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2871,"ondisk_log_size":2871,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22590885,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":419,"num_read_kb":454,"num_write":6618,"num_write_kb":25341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45244416,"data_stored":45181770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5138,"ondisk_log_size":5138,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509823,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52644,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319196,"statfs":{"total":96636764160,"available":96582856704,"internally_reserved":0,"allocated":13463552,"data_stored":13280752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509825,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":217485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509821,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41772,"kb_used_data":6436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330068,"statfs":{"total":96636764160,"available":96593989632,"internally_reserved":0,"allocated":6590464,"data_stored":6399500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509822,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":106980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509823,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43816,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328024,"statfs":{"total":96636764160,"available":96591896576,"internally_reserved":0,"allocated":8683520,"data_stored":8495624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542528,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47972,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323868,"statfs":{"total":96636764160,"available":96587640832,"internally_reserved":0,"allocated":8679424,"data_stored":8496170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542526,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49556,"kb_used_data":10060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322284,"statfs":{"total":96636764160,"available":96586018816,"internally_reserved":0,"allocated":10301440,"data_stored":10114065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542529,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35620,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336220,"statfs":{"total":96636764160,"available":96600289280,"internally_reserved":0,"allocated":290816,"data_stored":107050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5713920,"data_stored":5702242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":110595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10018816,"data_stored":10007175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8389280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T17:05:44.928 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.929 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.929 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.929 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.929 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.929 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.929 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.929 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.929 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.929 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.929 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.930 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.930 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.930 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.930 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.930 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.930 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.930 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.930 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.931 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.931 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.931 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.931 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.931 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.931 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.931 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.931 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.931 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.931 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.932 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.932 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.932 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.932 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.932 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.932 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.932 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.932 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.932 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.933 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.933 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.933 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.933 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.933 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.933 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.933 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.933 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.933 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.934 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.934 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.934 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-01T16:34:06.247737+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=6, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.934 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.934 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.934 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.934 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.935 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.935 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.935 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.935 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.935 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.935 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.935 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.935 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.935 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.935 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.936 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.936 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.936 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.936 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.936 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.936 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.936 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-01T16:34:29.918031+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=29, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.936 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:05:44.936 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-01T17:05:46.971 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:32:18.654 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:46.983 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:32:18.666 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:47.038 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:32:18.721 36799== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:47.093 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:32:18.760 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:47.095 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:32:18.763 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:47.099 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:32:18.766 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:47.109 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:32:18.777 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:47.149 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:32:18.817 36837== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:47.166 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:32:18.833 36836== Warning: unimplemented fcntl command: 1036 2024-04-01T17:05:53.495 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:05:53.503 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:06:04.938 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T17:06:05.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.160+0000 7f0c3a600640 1 Processor -- start 2024-04-01T17:06:05.160 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.160+0000 7f0c3a600640 1 -- start start 2024-04-01T17:06:05.162 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.162+0000 7f0c3a600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0c3406e490 0x7f0c34071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:05.162 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.162+0000 7f0c3a600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c34072570 con 0x7f0c340c6d50 2024-04-01T17:06:05.162 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.162+0000 7f0c3a600640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c340c2080 con 0x7f0c34154a60 2024-04-01T17:06:05.162 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.162+0000 7f0c3a600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f0c340c2360 con 0x7f0c3406e490 2024-04-01T17:06:05.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.163+0000 7f0c33e00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0c3406e490 0x7f0c34071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:05.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.163+0000 7f0c33400640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f0c34154a60 0x7f0c34073210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:45066/0 (socket says 172.21.15.163:45066) 2024-04-01T17:06:05.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.163+0000 7f0c33400640 1 -- 172.21.15.163:0/776094802 learned_addr learned my addr 172.21.15.163:0/776094802 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:06:05.166 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.167+0000 7f0c33e00640 1 -- 172.21.15.163:0/776094802 >> v1:172.21.15.189:6789/0 conn(0x7f0c34154a60 legacy=0x7f0c34073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:05.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.167+0000 7f0c33e00640 1 -- 172.21.15.163:0/776094802 >> v1:172.21.15.163:6789/0 conn(0x7f0c340c6d50 legacy=0x7f0c3406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:05.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.167+0000 7f0c33e00640 1 -- 172.21.15.163:0/776094802 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c340c2640 con 0x7f0c3406e490 2024-04-01T17:06:05.172 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.173+0000 7f0c33e00640 1 --2- 172.21.15.163:0/776094802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c3406e490 0x7f0c34071ee0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009d90 tx=0x7f0c2c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86bf17c93c6b10dc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:05.177 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.178+0000 7f0c32a00640 1 -- 172.21.15.163:0/776094802 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c039070 con 0x7f0c3406e490 2024-04-01T17:06:05.177 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.178+0000 7f0c32a00640 1 -- 172.21.15.163:0/776094802 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c02cd80 con 0x7f0c3406e490 2024-04-01T17:06:05.177 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.178+0000 7f0c32a00640 1 -- 172.21.15.163:0/776094802 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c034660 con 0x7f0c3406e490 2024-04-01T17:06:05.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.179+0000 7f0c3a600640 1 -- 172.21.15.163:0/776094802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c3406e490 msgr2=0x7f0c34071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:05.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.179+0000 7f0c3a600640 1 --2- 172.21.15.163:0/776094802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c3406e490 0x7f0c34071ee0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009d90 tx=0x7f0c2c02bfd0 comp rx=0 tx=0).stop 2024-04-01T17:06:05.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.179+0000 7f0c3a600640 1 -- 172.21.15.163:0/776094802 shutdown_connections 2024-04-01T17:06:05.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.179+0000 7f0c3a600640 1 --2- 172.21.15.163:0/776094802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c3406e490 0x7f0c34071ee0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:05.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.179+0000 7f0c3a600640 1 -- 172.21.15.163:0/776094802 >> 172.21.15.163:0/776094802 conn(0x7f0c340cbe20 msgr2=0x7f0c340cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:05.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.179+0000 7f0c3a600640 1 -- 172.21.15.163:0/776094802 shutdown_connections 2024-04-01T17:06:05.179 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.179+0000 7f0c3a600640 1 -- 172.21.15.163:0/776094802 wait complete. 2024-04-01T17:06:05.181 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.181+0000 7f0c3a600640 1 Processor -- start 2024-04-01T17:06:05.181 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.182+0000 7f0c3a600640 1 -- start start 2024-04-01T17:06:05.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.183+0000 7f0c3a600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c3406e490 0x7f0c340cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:05.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.183+0000 7f0c3a600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c340c6d50 0x7f0c341e4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:05.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.183+0000 7f0c3a600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c34154a60 0x7f0c341e4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:05.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.183+0000 7f0c3a600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34073920 con 0x7f0c3406e490 2024-04-01T17:06:05.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.183+0000 7f0c3a600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0c340c1d80 con 0x7f0c340c6d50 2024-04-01T17:06:05.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.183+0000 7f0c3a600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f0c34073aa0 con 0x7f0c34154a60 2024-04-01T17:06:05.183 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.184+0000 7f0c33400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c3406e490 0x7f0c340cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:05.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.184+0000 7f0c33400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c3406e490 0x7f0c340cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:43696/0 (socket says 172.21.15.163:43696) 2024-04-01T17:06:05.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.184+0000 7f0c33400640 1 -- 172.21.15.163:0/3548254062 learned_addr learned my addr 172.21.15.163:0/3548254062 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:06:05.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.185+0000 7f0c2aa00640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c340c6d50 0x7f0c341e4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:05.184 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.185+0000 7f0c33e00640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c34154a60 0x7f0c341e4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:05.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.188+0000 7f0c33400640 1 -- 172.21.15.163:0/3548254062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c34154a60 msgr2=0x7f0c341e4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:05.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.188+0000 7f0c33400640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c34154a60 0x7f0c341e4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:05.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.188+0000 7f0c33400640 1 -- 172.21.15.163:0/3548254062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c340c6d50 msgr2=0x7f0c341e4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:05.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.188+0000 7f0c33400640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c340c6d50 0x7f0c341e4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:05.188 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.188+0000 7f0c33400640 1 -- 172.21.15.163:0/3548254062 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c340c5fd0 con 0x7f0c3406e490 2024-04-01T17:06:05.190 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.191+0000 7f0c33400640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c3406e490 0x7f0c340cb0f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400c3f0 tx=0x7f0c2400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:05.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.195+0000 7f0c2be00640 1 -- 172.21.15.163:0/3548254062 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24017070 con 0x7f0c3406e490 2024-04-01T17:06:05.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.195+0000 7f0c2be00640 1 -- 172.21.15.163:0/3548254062 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c24005ce0 con 0x7f0c3406e490 2024-04-01T17:06:05.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.195+0000 7f0c2be00640 1 -- 172.21.15.163:0/3548254062 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c240072f0 con 0x7f0c3406e490 2024-04-01T17:06:05.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.195+0000 7f0c3a600640 1 -- 172.21.15.163:0/3548254062 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c341e3c90 con 0x7f0c3406e490 2024-04-01T17:06:05.195 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.195+0000 7f0c3a600640 1 -- 172.21.15.163:0/3548254062 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c341e4250 con 0x7f0c3406e490 2024-04-01T17:06:05.197 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.197+0000 7f0c3a600640 1 -- 172.21.15.163:0/3548254062 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c340756d0 con 0x7f0c3406e490 2024-04-01T17:06:05.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.496+0000 7f0c2be00640 1 -- 172.21.15.163:0/3548254062 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c2401a070 con 0x7f0c3406e490 2024-04-01T17:06:05.498 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.498+0000 7f0c2be00640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0c1006c940 0x7f0c1006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:05.498 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.499+0000 7f0c2aa00640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0c1006c940 0x7f0c1006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:05.500 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.500+0000 7f0c2aa00640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0c1006c940 0x7f0c1006ee00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0c341e6af0 tx=0x7f0c1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:05.530 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.531+0000 7f0c2be00640 1 -- 172.21.15.163:0/3548254062 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f0c240570f0 con 0x7f0c3406e490 2024-04-01T17:06:05.531 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.532+0000 7f0c2be00640 1 -- 172.21.15.163:0/3548254062 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0c24021020 con 0x7f0c3406e490 2024-04-01T17:06:05.753 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.754+0000 7f0c3a600640 1 -- 172.21.15.163:0/3548254062 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0c341449a0 con 0x7f0c1006c940 2024-04-01T17:06:05.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.764+0000 7f0c2be00640 1 -- 172.21.15.163:0/3548254062 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253011 (secure 0 0 0) 0x7f0c1c001d30 con 0x7f0c1006c940 2024-04-01T17:06:05.770 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T17:06:05.771 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T17:06:05.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.769+0000 7f0c3a600640 1 -- 172.21.15.163:0/3548254062 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0c1006c940 msgr2=0x7f0c1006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:05.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.769+0000 7f0c3a600640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0c1006c940 0x7f0c1006ee00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0c341e6af0 tx=0x7f0c1c009040 comp rx=0 tx=0).stop 2024-04-01T17:06:05.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.769+0000 7f0c3a600640 1 -- 172.21.15.163:0/3548254062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c3406e490 msgr2=0x7f0c340cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:05.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.769+0000 7f0c3a600640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c3406e490 0x7f0c340cb0f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400c3f0 tx=0x7f0c2400c8b0 comp rx=0 tx=0).stop 2024-04-01T17:06:05.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.769+0000 7f0c3a600640 1 -- 172.21.15.163:0/3548254062 shutdown_connections 2024-04-01T17:06:05.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.769+0000 7f0c3a600640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f0c1006c940 0x7f0c1006ee00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:05.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.769+0000 7f0c3a600640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f0c34154a60 0x7f0c341e4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:05.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.769+0000 7f0c3a600640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0c340c6d50 0x7f0c341e4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:05.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.769+0000 7f0c3a600640 1 --2- 172.21.15.163:0/3548254062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c3406e490 0x7f0c340cb0f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:05.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.769+0000 7f0c3a600640 1 -- 172.21.15.163:0/3548254062 >> 172.21.15.163:0/3548254062 conn(0x7f0c340cbe20 msgr2=0x7f0c34143b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:05.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.769+0000 7f0c3a600640 1 -- 172.21.15.163:0/3548254062 shutdown_connections 2024-04-01T17:06:05.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:05.769+0000 7f0c3a600640 1 -- 172.21.15.163:0/3548254062 wait complete. 2024-04-01T17:06:05.790 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":985,"stamp":"2024-04-01T17:06:04.598735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23181253,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":535,"num_read_kb":554,"num_write":8981,"num_write_kb":279196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8136,"ondisk_log_size":8136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":334400,"kb_used_data":47552,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754640320,"statfs":{"total":773094113280,"available":772751687680,"internally_reserved":0,"allocated":48693248,"data_stored":47217626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":293654068},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004837"},"pg_stats":[{"pgid":"3.3f","version":"27'39","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:55.685028+0000","last_change":"2024-04-01T17:05:55.685068+0000","last_active":"2024-04-01T17:05:55.685028+0000","last_peered":"2024-04-01T17:05:55.685028+0000","last_clean":"2024-04-01T17:05:55.685028+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T17:05:55.685028+0000","last_undegraded":"2024-04-01T17:05:55.685028+0000","last_fullsized":"2024-04-01T17:05:55.685028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-01T17:05:55.684922+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-01T17:05:55.684922+0000","last_clean_scrub_stamp":"2024-04-01T17:05:55.684922+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:01:32.551588+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'41","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.599866+0000","last_change":"2024-04-01T17:05:43.599866+0000","last_active":"2024-04-01T17:05:43.599866+0000","last_peered":"2024-04-01T17:05:43.599866+0000","last_clean":"2024-04-01T17:05:43.599866+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T17:05:43.599866+0000","last_undegraded":"2024-04-01T17:05:43.599866+0000","last_fullsized":"2024-04-01T17:05:43.599866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-01T17:05:43.599413+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-01T17:05:43.599413+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.599413+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:00:34.865114+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":1086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'48","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.161502+0000","last_change":"2024-04-01T17:05:45.161502+0000","last_active":"2024-04-01T17:05:45.161502+0000","last_peered":"2024-04-01T17:05:45.161502+0000","last_clean":"2024-04-01T17:05:45.161502+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T17:05:45.161502+0000","last_undegraded":"2024-04-01T17:05:45.161502+0000","last_fullsized":"2024-04-01T17:05:45.161502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-01T17:05:45.161246+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-01T17:05:45.161246+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.161246+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:59:47.568996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'35","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:56.748846+0000","last_change":"2024-04-01T17:05:56.748884+0000","last_active":"2024-04-01T17:05:56.748846+0000","last_peered":"2024-04-01T17:05:56.748846+0000","last_clean":"2024-04-01T17:05:56.748846+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T17:05:56.748846+0000","last_undegraded":"2024-04-01T17:05:56.748846+0000","last_fullsized":"2024-04-01T17:05:56.748846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-01T17:05:56.748749+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-01T17:05:56.748749+0000","last_clean_scrub_stamp":"2024-04-01T17:05:56.748749+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:40:54.664387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:23.155896+0000","last_change":"2024-04-01T16:34:34.085765+0000","last_active":"2024-04-01T17:05:23.155896+0000","last_peered":"2024-04-01T17:05:23.155896+0000","last_clean":"2024-04-01T17:05:23.155896+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T17:05:23.155896+0000","last_undegraded":"2024-04-01T17:05:23.155896+0000","last_fullsized":"2024-04-01T17:05:23.155896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T16:34:32.285854+0000","last_clean_scrub_stamp":"2024-04-01T16:34:32.285854+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'60","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:52.673357+0000","last_change":"2024-04-01T17:05:52.673411+0000","last_active":"2024-04-01T17:05:52.673357+0000","last_peered":"2024-04-01T17:05:52.673357+0000","last_clean":"2024-04-01T17:05:52.673357+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T17:05:52.673357+0000","last_undegraded":"2024-04-01T17:05:52.673357+0000","last_fullsized":"2024-04-01T17:05:52.673357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2024-04-01T17:05:52.673169+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2024-04-01T17:05:52.673169+0000","last_clean_scrub_stamp":"2024-04-01T17:05:52.673169+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:54:16.553141+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":2601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'34","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:58.668441+0000","last_change":"2024-04-01T17:05:58.668492+0000","last_active":"2024-04-01T17:05:58.668441+0000","last_peered":"2024-04-01T17:05:58.668441+0000","last_clean":"2024-04-01T17:05:58.668441+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T17:05:58.668441+0000","last_undegraded":"2024-04-01T17:05:58.668441+0000","last_fullsized":"2024-04-01T17:05:58.668441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T17:05:58.668340+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T17:05:58.668340+0000","last_clean_scrub_stamp":"2024-04-01T17:05:58.668340+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:10:47.255631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'42","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.010658+0000","last_change":"2024-04-01T17:05:46.010722+0000","last_active":"2024-04-01T17:05:46.010658+0000","last_peered":"2024-04-01T17:05:46.010658+0000","last_clean":"2024-04-01T17:05:46.010658+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T17:05:46.010658+0000","last_undegraded":"2024-04-01T17:05:46.010658+0000","last_fullsized":"2024-04-01T17:05:46.010658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-01T17:05:46.010460+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-01T17:05:46.010460+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.010460+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:09:03.853346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":1328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'48","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:56.691279+0000","last_change":"2024-04-01T17:05:56.691336+0000","last_active":"2024-04-01T17:05:56.691279+0000","last_peered":"2024-04-01T17:05:56.691279+0000","last_clean":"2024-04-01T17:05:56.691279+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T17:05:56.691279+0000","last_undegraded":"2024-04-01T17:05:56.691279+0000","last_fullsized":"2024-04-01T17:05:56.691279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-01T17:05:56.691093+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-01T17:05:56.691093+0000","last_clean_scrub_stamp":"2024-04-01T17:05:56.691093+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:40:54.606731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:51.189316+0000","last_change":"2024-04-01T17:05:51.189316+0000","last_active":"2024-04-01T17:05:51.189316+0000","last_peered":"2024-04-01T17:05:51.189316+0000","last_clean":"2024-04-01T17:05:51.189316+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T17:05:51.189316+0000","last_undegraded":"2024-04-01T17:05:51.189316+0000","last_fullsized":"2024-04-01T17:05:51.189316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-01T17:05:51.189064+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-01T17:05:51.189064+0000","last_clean_scrub_stamp":"2024-04-01T17:05:51.189064+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:09:09.031949+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'36","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:50.152794+0000","last_change":"2024-04-01T17:05:50.152794+0000","last_active":"2024-04-01T17:05:50.152794+0000","last_peered":"2024-04-01T17:05:50.152794+0000","last_clean":"2024-04-01T17:05:50.152794+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T17:05:50.152794+0000","last_undegraded":"2024-04-01T17:05:50.152794+0000","last_fullsized":"2024-04-01T17:05:50.152794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-04-01T17:05:50.152672+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-04-01T17:05:50.152672+0000","last_clean_scrub_stamp":"2024-04-01T17:05:50.152672+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:05:02.374826+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'32","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.410670+0000","last_change":"2024-04-01T17:05:43.410670+0000","last_active":"2024-04-01T17:05:43.410670+0000","last_peered":"2024-04-01T17:05:43.410670+0000","last_clean":"2024-04-01T17:05:43.410670+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T17:05:43.410670+0000","last_undegraded":"2024-04-01T17:05:43.410670+0000","last_fullsized":"2024-04-01T17:05:43.410670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2024-04-01T17:05:43.410531+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2024-04-01T17:05:43.410531+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.410531+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:26:23.991661+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'66","reported_seq":109,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.098726+0000","last_change":"2024-04-01T17:05:43.098726+0000","last_active":"2024-04-01T17:05:43.098726+0000","last_peered":"2024-04-01T17:05:43.098726+0000","last_clean":"2024-04-01T17:05:43.098726+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T17:05:43.098726+0000","last_undegraded":"2024-04-01T17:05:43.098726+0000","last_fullsized":"2024-04-01T17:05:43.098726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2024-04-01T17:05:43.098457+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2024-04-01T17:05:43.098457+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.098457+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:00:34.364158+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'46","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.132738+0000","last_change":"2024-04-01T17:05:43.132789+0000","last_active":"2024-04-01T17:05:43.132738+0000","last_peered":"2024-04-01T17:05:43.132738+0000","last_clean":"2024-04-01T17:05:43.132738+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T17:05:43.132738+0000","last_undegraded":"2024-04-01T17:05:43.132738+0000","last_fullsized":"2024-04-01T17:05:43.132738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-01T17:05:43.132627+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-01T17:05:43.132627+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.132627+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:32:07.149822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'45","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.633839+0000","last_change":"2024-04-01T17:05:42.633898+0000","last_active":"2024-04-01T17:05:42.633839+0000","last_peered":"2024-04-01T17:05:42.633839+0000","last_clean":"2024-04-01T17:05:42.633839+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T17:05:42.633839+0000","last_undegraded":"2024-04-01T17:05:42.633839+0000","last_fullsized":"2024-04-01T17:05:42.633839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-01T17:05:42.633595+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-01T17:05:42.633595+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.633595+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:05:41.844393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":3152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'51","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:51.682951+0000","last_change":"2024-04-01T17:05:51.683006+0000","last_active":"2024-04-01T17:05:51.682951+0000","last_peered":"2024-04-01T17:05:51.682951+0000","last_clean":"2024-04-01T17:05:51.682951+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T17:05:51.682951+0000","last_undegraded":"2024-04-01T17:05:51.682951+0000","last_fullsized":"2024-04-01T17:05:51.682951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-01T17:05:51.682774+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-01T17:05:51.682774+0000","last_clean_scrub_stamp":"2024-04-01T17:05:51.682774+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:35:17.471707+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'54","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:49.670916+0000","last_change":"2024-04-01T17:05:49.670975+0000","last_active":"2024-04-01T17:05:49.670916+0000","last_peered":"2024-04-01T17:05:49.670916+0000","last_clean":"2024-04-01T17:05:49.670916+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T17:05:49.670916+0000","last_undegraded":"2024-04-01T17:05:49.670916+0000","last_fullsized":"2024-04-01T17:05:49.670916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-04-01T17:05:49.670690+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-04-01T17:05:49.670690+0000","last_clean_scrub_stamp":"2024-04-01T17:05:49.670690+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:38:15.222029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":6831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'56","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.248454+0000","last_change":"2024-04-01T17:05:42.248514+0000","last_active":"2024-04-01T17:05:42.248454+0000","last_peered":"2024-04-01T17:05:42.248454+0000","last_clean":"2024-04-01T17:05:42.248454+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T17:05:42.248454+0000","last_undegraded":"2024-04-01T17:05:42.248454+0000","last_fullsized":"2024-04-01T17:05:42.248454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'56","last_scrub_stamp":"2024-04-01T17:05:42.248253+0000","last_deep_scrub":"27'56","last_deep_scrub_stamp":"2024-04-01T17:05:42.248253+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.248253+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:20:00.675803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:59.707967+0000","last_change":"2024-04-01T17:05:59.708026+0000","last_active":"2024-04-01T17:05:59.707967+0000","last_peered":"2024-04-01T17:05:59.707967+0000","last_clean":"2024-04-01T17:05:59.707967+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T17:05:59.707967+0000","last_undegraded":"2024-04-01T17:05:59.707967+0000","last_fullsized":"2024-04-01T17:05:59.707967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T17:05:59.707782+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T17:05:59.707782+0000","last_clean_scrub_stamp":"2024-04-01T17:05:59.707782+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:03:04.115663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"27'66","reported_seq":110,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:48.086878+0000","last_change":"2024-04-01T17:05:48.086878+0000","last_active":"2024-04-01T17:05:48.086878+0000","last_peered":"2024-04-01T17:05:48.086878+0000","last_clean":"2024-04-01T17:05:48.086878+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T17:05:48.086878+0000","last_undegraded":"2024-04-01T17:05:48.086878+0000","last_fullsized":"2024-04-01T17:05:48.086878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2024-04-01T17:05:48.086548+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2024-04-01T17:05:48.086548+0000","last_clean_scrub_stamp":"2024-04-01T17:05:48.086548+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:05:47.297346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"27'53","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.118822+0000","last_change":"2024-04-01T17:05:40.118919+0000","last_active":"2024-04-01T17:05:40.118822+0000","last_peered":"2024-04-01T17:05:40.118822+0000","last_clean":"2024-04-01T17:05:40.118822+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T17:05:40.118822+0000","last_undegraded":"2024-04-01T17:05:40.118822+0000","last_fullsized":"2024-04-01T17:05:40.118822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-04-01T17:05:40.118570+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-04-01T17:05:40.118570+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.118570+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:44:54.364433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"27'41","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:48.658670+0000","last_change":"2024-04-01T17:05:48.658728+0000","last_active":"2024-04-01T17:05:48.658670+0000","last_peered":"2024-04-01T17:05:48.658670+0000","last_clean":"2024-04-01T17:05:48.658670+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T17:05:48.658670+0000","last_undegraded":"2024-04-01T17:05:48.658670+0000","last_fullsized":"2024-04-01T17:05:48.658670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-01T17:05:48.658450+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-01T17:05:48.658450+0000","last_clean_scrub_stamp":"2024-04-01T17:05:48.658450+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:37:00.600052+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'56","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.983054+0000","last_change":"2024-04-01T17:05:46.983054+0000","last_active":"2024-04-01T17:05:46.983054+0000","last_peered":"2024-04-01T17:05:46.983054+0000","last_clean":"2024-04-01T17:05:46.983054+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T17:05:46.983054+0000","last_undegraded":"2024-04-01T17:05:46.983054+0000","last_fullsized":"2024-04-01T17:05:46.983054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'56","last_scrub_stamp":"2024-04-01T17:05:46.982790+0000","last_deep_scrub":"27'56","last_deep_scrub_stamp":"2024-04-01T17:05:46.982790+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.982790+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:55:15.850838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":6379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'42","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:53.711797+0000","last_change":"2024-04-01T17:05:53.711839+0000","last_active":"2024-04-01T17:05:53.711797+0000","last_peered":"2024-04-01T17:05:53.711797+0000","last_clean":"2024-04-01T17:05:53.711797+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T17:05:53.711797+0000","last_undegraded":"2024-04-01T17:05:53.711797+0000","last_fullsized":"2024-04-01T17:05:53.711797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-01T17:05:53.711662+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-01T17:05:53.711662+0000","last_clean_scrub_stamp":"2024-04-01T17:05:53.711662+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:38:16.835654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"27'33","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:48.008212+0000","last_change":"2024-04-01T17:05:48.008275+0000","last_active":"2024-04-01T17:05:48.008212+0000","last_peered":"2024-04-01T17:05:48.008212+0000","last_clean":"2024-04-01T17:05:48.008212+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T17:05:48.008212+0000","last_undegraded":"2024-04-01T17:05:48.008212+0000","last_fullsized":"2024-04-01T17:05:48.008212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-04-01T17:05:48.008011+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-04-01T17:05:48.008011+0000","last_clean_scrub_stamp":"2024-04-01T17:05:48.008011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:37:38.542838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"27'56","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:54.140041+0000","last_change":"2024-04-01T17:05:54.140105+0000","last_active":"2024-04-01T17:05:54.140041+0000","last_peered":"2024-04-01T17:05:54.140041+0000","last_clean":"2024-04-01T17:05:54.140041+0000","last_became_active":"2024-04-01T16:34:54.510173+0000","last_became_peered":"2024-04-01T16:34:54.510173+0000","last_unstale":"2024-04-01T17:05:54.140041+0000","last_undegraded":"2024-04-01T17:05:54.140041+0000","last_fullsized":"2024-04-01T17:05:54.140041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'56","last_scrub_stamp":"2024-04-01T17:05:54.139843+0000","last_deep_scrub":"27'56","last_deep_scrub_stamp":"2024-04-01T17:05:54.139843+0000","last_clean_scrub_stamp":"2024-04-01T17:05:54.139843+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:51:53.320967+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'40","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:47.548353+0000","last_change":"2024-04-01T17:05:47.548443+0000","last_active":"2024-04-01T17:05:47.548353+0000","last_peered":"2024-04-01T17:05:47.548353+0000","last_clean":"2024-04-01T17:05:47.548353+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T17:05:47.548353+0000","last_undegraded":"2024-04-01T17:05:47.548353+0000","last_fullsized":"2024-04-01T17:05:47.548353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-01T17:05:47.548124+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-01T17:05:47.548124+0000","last_clean_scrub_stamp":"2024-04-01T17:05:47.548124+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:55:16.416172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"27'25","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:49.946670+0000","last_change":"2024-04-01T17:05:49.946730+0000","last_active":"2024-04-01T17:05:49.946670+0000","last_peered":"2024-04-01T17:05:49.946670+0000","last_clean":"2024-04-01T17:05:49.946670+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T17:05:49.946670+0000","last_undegraded":"2024-04-01T17:05:49.946670+0000","last_fullsized":"2024-04-01T17:05:49.946670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-01T17:05:49.946474+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-01T17:05:49.946474+0000","last_clean_scrub_stamp":"2024-04-01T17:05:49.946474+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:13:40.114037+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'39","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.134239+0000","last_change":"2024-04-01T17:05:46.134239+0000","last_active":"2024-04-01T17:05:46.134239+0000","last_peered":"2024-04-01T17:05:46.134239+0000","last_clean":"2024-04-01T17:05:46.134239+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T17:05:46.134239+0000","last_undegraded":"2024-04-01T17:05:46.134239+0000","last_fullsized":"2024-04-01T17:05:46.134239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-01T17:05:46.133803+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-01T17:05:46.133803+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.133803+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:58:01.954412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"27'56","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:54.738005+0000","last_change":"2024-04-01T17:05:54.738059+0000","last_active":"2024-04-01T17:05:54.738005+0000","last_peered":"2024-04-01T17:05:54.738005+0000","last_clean":"2024-04-01T17:05:54.738005+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T17:05:54.738005+0000","last_undegraded":"2024-04-01T17:05:54.738005+0000","last_fullsized":"2024-04-01T17:05:54.738005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'56","last_scrub_stamp":"2024-04-01T17:05:54.737826+0000","last_deep_scrub":"27'56","last_deep_scrub_stamp":"2024-04-01T17:05:54.737826+0000","last_clean_scrub_stamp":"2024-04-01T17:05:54.737826+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:17:48.727070+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"27'46","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.293132+0000","last_change":"2024-04-01T17:05:43.293132+0000","last_active":"2024-04-01T17:05:43.293132+0000","last_peered":"2024-04-01T17:05:43.293132+0000","last_clean":"2024-04-01T17:05:43.293132+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T17:05:43.293132+0000","last_undegraded":"2024-04-01T17:05:43.293132+0000","last_fullsized":"2024-04-01T17:05:43.293132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-01T17:05:43.293028+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-01T17:05:43.293028+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.293028+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:35:09.777278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"27'56","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:53.179357+0000","last_change":"2024-04-01T17:05:53.179416+0000","last_active":"2024-04-01T17:05:53.179357+0000","last_peered":"2024-04-01T17:05:53.179357+0000","last_clean":"2024-04-01T17:05:53.179357+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T17:05:53.179357+0000","last_undegraded":"2024-04-01T17:05:53.179357+0000","last_fullsized":"2024-04-01T17:05:53.179357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'56","last_scrub_stamp":"2024-04-01T17:05:53.179166+0000","last_deep_scrub":"27'56","last_deep_scrub_stamp":"2024-04-01T17:05:53.179166+0000","last_clean_scrub_stamp":"2024-04-01T17:05:53.179166+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:16:15.944840+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":5837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"27'29","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.357991+0000","last_change":"2024-04-01T17:05:41.358031+0000","last_active":"2024-04-01T17:05:41.357991+0000","last_peered":"2024-04-01T17:05:41.357991+0000","last_clean":"2024-04-01T17:05:41.357991+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T17:05:41.357991+0000","last_undegraded":"2024-04-01T17:05:41.357991+0000","last_fullsized":"2024-04-01T17:05:41.357991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-04-01T17:05:41.357871+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-04-01T17:05:41.357871+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.357871+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:28:35.750340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'510","reported_seq":556,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:39.003970+0000","last_change":"2024-04-01T17:05:39.004003+0000","last_active":"2024-04-01T17:05:39.003970+0000","last_peered":"2024-04-01T17:05:39.003970+0000","last_clean":"2024-04-01T17:05:39.003970+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T17:05:39.003970+0000","last_undegraded":"2024-04-01T17:05:39.003970+0000","last_fullsized":"2024-04-01T17:05:39.003970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'510","last_scrub_stamp":"2024-04-01T17:05:39.003870+0000","last_deep_scrub":"27'510","last_deep_scrub_stamp":"2024-04-01T17:05:39.003870+0000","last_clean_scrub_stamp":"2024-04-01T17:05:39.003870+0000","objects_scrubbed":1,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:16:47.186005+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'34","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:37.044058+0000","last_change":"2024-04-01T17:05:37.044119+0000","last_active":"2024-04-01T17:05:37.044058+0000","last_peered":"2024-04-01T17:05:37.044058+0000","last_clean":"2024-04-01T17:05:37.044058+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T17:05:37.044058+0000","last_undegraded":"2024-04-01T17:05:37.044058+0000","last_fullsized":"2024-04-01T17:05:37.044058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T17:05:37.043862+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T17:05:37.043862+0000","last_clean_scrub_stamp":"2024-04-01T17:05:37.043862+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:47:39.797490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"27'433","reported_seq":479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.081837+0000","last_change":"2024-04-01T17:05:43.081901+0000","last_active":"2024-04-01T17:05:43.081837+0000","last_peered":"2024-04-01T17:05:43.081837+0000","last_clean":"2024-04-01T17:05:43.081837+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T17:05:43.081837+0000","last_undegraded":"2024-04-01T17:05:43.081837+0000","last_fullsized":"2024-04-01T17:05:43.081837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'433","last_scrub_stamp":"2024-04-01T17:05:43.081565+0000","last_deep_scrub":"27'433","last_deep_scrub_stamp":"2024-04-01T17:05:43.081565+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.081565+0000","objects_scrubbed":1,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:58.553659+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.034354+0000","last_change":"2024-04-01T17:05:41.034354+0000","last_active":"2024-04-01T17:05:41.034354+0000","last_peered":"2024-04-01T17:05:41.034354+0000","last_clean":"2024-04-01T17:05:41.034354+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T17:05:41.034354+0000","last_undegraded":"2024-04-01T17:05:41.034354+0000","last_fullsized":"2024-04-01T17:05:41.034354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-01T17:05:41.034109+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-01T17:05:41.034109+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.034109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:42:03.426829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'57","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:48.980807+0000","last_change":"2024-04-01T17:05:48.980807+0000","last_active":"2024-04-01T17:05:48.980807+0000","last_peered":"2024-04-01T17:05:48.980807+0000","last_clean":"2024-04-01T17:05:48.980807+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T17:05:48.980807+0000","last_undegraded":"2024-04-01T17:05:48.980807+0000","last_fullsized":"2024-04-01T17:05:48.980807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2024-04-01T17:05:48.980516+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2024-04-01T17:05:48.980516+0000","last_clean_scrub_stamp":"2024-04-01T17:05:48.980516+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:12:12.167310+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":3573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.610593+0000","last_change":"2024-04-01T17:05:43.610593+0000","last_active":"2024-04-01T17:05:43.610593+0000","last_peered":"2024-04-01T17:05:43.610593+0000","last_clean":"2024-04-01T17:05:43.610593+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T17:05:43.610593+0000","last_undegraded":"2024-04-01T17:05:43.610593+0000","last_fullsized":"2024-04-01T17:05:43.610593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:43.610338+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:43.610338+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.610338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:32:07.627534+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'43","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.594546+0000","last_change":"2024-04-01T17:05:46.594546+0000","last_active":"2024-04-01T17:05:46.594546+0000","last_peered":"2024-04-01T17:05:46.594546+0000","last_clean":"2024-04-01T17:05:46.594546+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T17:05:46.594546+0000","last_undegraded":"2024-04-01T17:05:46.594546+0000","last_fullsized":"2024-04-01T17:05:46.594546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-01T17:05:46.594276+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-01T17:05:46.594276+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.594276+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:09:04.437161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:47.066908+0000","last_change":"2024-04-01T17:05:47.066908+0000","last_active":"2024-04-01T17:05:47.066908+0000","last_peered":"2024-04-01T17:05:47.066908+0000","last_clean":"2024-04-01T17:05:47.066908+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T17:05:47.066908+0000","last_undegraded":"2024-04-01T17:05:47.066908+0000","last_fullsized":"2024-04-01T17:05:47.066908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:47.066770+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:47.066770+0000","last_clean_scrub_stamp":"2024-04-01T17:05:47.066770+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:32.450929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'70","reported_seq":113,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:47.616805+0000","last_change":"2024-04-01T17:05:47.616805+0000","last_active":"2024-04-01T17:05:47.616805+0000","last_peered":"2024-04-01T17:05:47.616805+0000","last_clean":"2024-04-01T17:05:47.616805+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T17:05:47.616805+0000","last_undegraded":"2024-04-01T17:05:47.616805+0000","last_fullsized":"2024-04-01T17:05:47.616805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'70","last_scrub_stamp":"2024-04-01T17:05:47.616587+0000","last_deep_scrub":"27'70","last_deep_scrub_stamp":"2024-04-01T17:05:47.616587+0000","last_clean_scrub_stamp":"2024-04-01T17:05:47.616587+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:16:00.593595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.588760+0000","last_change":"2024-04-01T17:05:46.588760+0000","last_active":"2024-04-01T17:05:46.588760+0000","last_peered":"2024-04-01T17:05:46.588760+0000","last_clean":"2024-04-01T17:05:46.588760+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T17:05:46.588760+0000","last_undegraded":"2024-04-01T17:05:46.588760+0000","last_fullsized":"2024-04-01T17:05:46.588760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-01T17:05:46.588609+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-01T17:05:46.588609+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.588609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:58:02.409218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'48","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.150163+0000","last_change":"2024-04-01T17:05:41.150163+0000","last_active":"2024-04-01T17:05:41.150163+0000","last_peered":"2024-04-01T17:05:41.150163+0000","last_clean":"2024-04-01T17:05:41.150163+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T17:05:41.150163+0000","last_undegraded":"2024-04-01T17:05:41.150163+0000","last_fullsized":"2024-04-01T17:05:41.150163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-01T17:05:41.149974+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-01T17:05:41.149974+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.149974+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:45:12.015247+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"27'310","reported_seq":357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.620536+0000","last_change":"2024-04-01T17:05:41.620536+0000","last_active":"2024-04-01T17:05:41.620536+0000","last_peered":"2024-04-01T17:05:41.620536+0000","last_clean":"2024-04-01T17:05:41.620536+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T17:05:41.620536+0000","last_undegraded":"2024-04-01T17:05:41.620536+0000","last_fullsized":"2024-04-01T17:05:41.620536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'310","last_scrub_stamp":"2024-04-01T17:05:41.620340+0000","last_deep_scrub":"27'310","last_deep_scrub_stamp":"2024-04-01T17:05:41.620340+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.620340+0000","objects_scrubbed":2,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:42:04.013060+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'53","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.390611+0000","last_change":"2024-04-01T17:05:42.390774+0000","last_active":"2024-04-01T17:05:42.390611+0000","last_peered":"2024-04-01T17:05:42.390611+0000","last_clean":"2024-04-01T17:05:42.390611+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T17:05:42.390611+0000","last_undegraded":"2024-04-01T17:05:42.390611+0000","last_fullsized":"2024-04-01T17:05:42.390611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-04-01T17:05:42.390360+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-04-01T17:05:42.390360+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.390360+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:54:08.699195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":3009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"27'801","reported_seq":848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.051144+0000","last_change":"2024-04-01T17:05:44.051205+0000","last_active":"2024-04-01T17:05:44.051144+0000","last_peered":"2024-04-01T17:05:44.051144+0000","last_clean":"2024-04-01T17:05:44.051144+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T17:05:44.051144+0000","last_undegraded":"2024-04-01T17:05:44.051144+0000","last_fullsized":"2024-04-01T17:05:44.051144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'801","last_scrub_stamp":"2024-04-01T17:05:44.051021+0000","last_deep_scrub":"27'801","last_deep_scrub_stamp":"2024-04-01T17:05:44.051021+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.051021+0000","objects_scrubbed":4,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:02:10.812409+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'42","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:06:00.725821+0000","last_change":"2024-04-01T17:06:00.725821+0000","last_active":"2024-04-01T17:06:00.725821+0000","last_peered":"2024-04-01T17:06:00.725821+0000","last_clean":"2024-04-01T17:06:00.725821+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T17:06:00.725821+0000","last_undegraded":"2024-04-01T17:06:00.725821+0000","last_fullsized":"2024-04-01T17:06:00.725821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-01T17:06:00.725562+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-01T17:06:00.725562+0000","last_clean_scrub_stamp":"2024-04-01T17:06:00.725562+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:25:42.001493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:36.092993+0000","last_change":"2024-04-01T17:05:36.093056+0000","last_active":"2024-04-01T17:05:36.092993+0000","last_peered":"2024-04-01T17:05:36.092993+0000","last_clean":"2024-04-01T17:05:36.092993+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T17:05:36.092993+0000","last_undegraded":"2024-04-01T17:05:36.092993+0000","last_fullsized":"2024-04-01T17:05:36.092993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-01T17:05:36.092790+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-01T17:05:36.092790+0000","last_clean_scrub_stamp":"2024-04-01T17:05:36.092790+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:15:24.776059+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'50","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.150126+0000","last_change":"2024-04-01T17:05:42.150147+0000","last_active":"2024-04-01T17:05:42.150126+0000","last_peered":"2024-04-01T17:05:42.150126+0000","last_clean":"2024-04-01T17:05:42.150126+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T17:05:42.150126+0000","last_undegraded":"2024-04-01T17:05:42.150126+0000","last_fullsized":"2024-04-01T17:05:42.150126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-01T17:05:42.150042+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-01T17:05:42.150042+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.150042+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:55:48.004894+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.639883+0000","last_change":"2024-04-01T17:05:42.639945+0000","last_active":"2024-04-01T17:05:42.639883+0000","last_peered":"2024-04-01T17:05:42.639883+0000","last_clean":"2024-04-01T17:05:42.639883+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T17:05:42.639883+0000","last_undegraded":"2024-04-01T17:05:42.639883+0000","last_fullsized":"2024-04-01T17:05:42.639883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-01T17:05:42.639651+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-01T17:05:42.639651+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.639651+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:55:48.494503+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'72","reported_seq":115,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.802073+0000","last_change":"2024-04-01T17:05:45.802178+0000","last_active":"2024-04-01T17:05:45.802073+0000","last_peered":"2024-04-01T17:05:45.802073+0000","last_clean":"2024-04-01T17:05:45.802073+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T17:05:45.802073+0000","last_undegraded":"2024-04-01T17:05:45.802073+0000","last_fullsized":"2024-04-01T17:05:45.802073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'72","last_scrub_stamp":"2024-04-01T17:05:45.801852+0000","last_deep_scrub":"27'72","last_deep_scrub_stamp":"2024-04-01T17:05:45.801852+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.801852+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:42:38.532431+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":8452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.025331+0000","last_change":"2024-04-01T17:05:46.025389+0000","last_active":"2024-04-01T17:05:46.025331+0000","last_peered":"2024-04-01T17:05:46.025331+0000","last_clean":"2024-04-01T17:05:46.025331+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T17:05:46.025331+0000","last_undegraded":"2024-04-01T17:05:46.025331+0000","last_fullsized":"2024-04-01T17:05:46.025331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:46.025173+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:46.025173+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.025173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:26:28.224771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'37","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:52.161844+0000","last_change":"2024-04-01T17:05:52.161902+0000","last_active":"2024-04-01T17:05:52.161844+0000","last_peered":"2024-04-01T17:05:52.161844+0000","last_clean":"2024-04-01T17:05:52.161844+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T17:05:52.161844+0000","last_undegraded":"2024-04-01T17:05:52.161844+0000","last_fullsized":"2024-04-01T17:05:52.161844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-04-01T17:05:52.161642+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-04-01T17:05:52.161642+0000","last_clean_scrub_stamp":"2024-04-01T17:05:52.161642+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:24:28.435952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.219567+0000","last_change":"2024-04-01T17:05:40.219633+0000","last_active":"2024-04-01T17:05:40.219567+0000","last_peered":"2024-04-01T17:05:40.219567+0000","last_clean":"2024-04-01T17:05:40.219567+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T17:05:40.219567+0000","last_undegraded":"2024-04-01T17:05:40.219567+0000","last_fullsized":"2024-04-01T17:05:40.219567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-01T17:05:40.219401+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-01T17:05:40.219401+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.219401+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:04:46.211962+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:53.682329+0000","last_change":"2024-04-01T17:05:53.682385+0000","last_active":"2024-04-01T17:05:53.682329+0000","last_peered":"2024-04-01T17:05:53.682329+0000","last_clean":"2024-04-01T17:05:53.682329+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T17:05:53.682329+0000","last_undegraded":"2024-04-01T17:05:53.682329+0000","last_fullsized":"2024-04-01T17:05:53.682329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-04-01T17:05:53.682094+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-04-01T17:05:53.682094+0000","last_clean_scrub_stamp":"2024-04-01T17:05:53.682094+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:33:31.807910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.355119+0000","last_change":"2024-04-01T17:05:40.355160+0000","last_active":"2024-04-01T17:05:40.355119+0000","last_peered":"2024-04-01T17:05:40.355119+0000","last_clean":"2024-04-01T17:05:40.355119+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T17:05:40.355119+0000","last_undegraded":"2024-04-01T17:05:40.355119+0000","last_fullsized":"2024-04-01T17:05:40.355119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T17:05:40.355024+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T17:05:40.355024+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.355024+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:02:14.569947+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'29","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:54.709246+0000","last_change":"2024-04-01T17:05:54.709303+0000","last_active":"2024-04-01T17:05:54.709246+0000","last_peered":"2024-04-01T17:05:54.709246+0000","last_clean":"2024-04-01T17:05:54.709246+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T17:05:54.709246+0000","last_undegraded":"2024-04-01T17:05:54.709246+0000","last_fullsized":"2024-04-01T17:05:54.709246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-04-01T17:05:54.709064+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-04-01T17:05:54.709064+0000","last_clean_scrub_stamp":"2024-04-01T17:05:54.709064+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:17:48.698308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:39.217329+0000","last_change":"2024-04-01T17:05:39.217329+0000","last_active":"2024-04-01T17:05:39.217329+0000","last_peered":"2024-04-01T17:05:39.217329+0000","last_clean":"2024-04-01T17:05:39.217329+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T17:05:39.217329+0000","last_undegraded":"2024-04-01T17:05:39.217329+0000","last_fullsized":"2024-04-01T17:05:39.217329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:39.217203+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:39.217203+0000","last_clean_scrub_stamp":"2024-04-01T17:05:39.217203+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:26:19.798332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'39","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.849615+0000","last_change":"2024-04-01T17:05:44.849728+0000","last_active":"2024-04-01T17:05:44.849615+0000","last_peered":"2024-04-01T17:05:44.849615+0000","last_clean":"2024-04-01T17:05:44.849615+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T17:05:44.849615+0000","last_undegraded":"2024-04-01T17:05:44.849615+0000","last_fullsized":"2024-04-01T17:05:44.849615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-01T17:05:44.849307+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-01T17:05:44.849307+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.849307+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:43:06.604397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:37.543363+0000","last_change":"2024-04-01T17:05:37.543363+0000","last_active":"2024-04-01T17:05:37.543363+0000","last_peered":"2024-04-01T17:05:37.543363+0000","last_clean":"2024-04-01T17:05:37.543363+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T17:05:37.543363+0000","last_undegraded":"2024-04-01T17:05:37.543363+0000","last_fullsized":"2024-04-01T17:05:37.543363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T17:05:37.543210+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T17:05:37.543210+0000","last_clean_scrub_stamp":"2024-04-01T17:05:37.543210+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:53.015304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'50","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:55.729677+0000","last_change":"2024-04-01T17:05:55.729800+0000","last_active":"2024-04-01T17:05:55.729677+0000","last_peered":"2024-04-01T17:05:55.729677+0000","last_clean":"2024-04-01T17:05:55.729677+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T17:05:55.729677+0000","last_undegraded":"2024-04-01T17:05:55.729677+0000","last_fullsized":"2024-04-01T17:05:55.729677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-01T17:05:55.729445+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-01T17:05:55.729445+0000","last_clean_scrub_stamp":"2024-04-01T17:05:55.729445+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:01:32.596110+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"27'1","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.211856+0000","last_change":"2024-04-01T17:05:41.211856+0000","last_active":"2024-04-01T17:05:41.211856+0000","last_peered":"2024-04-01T17:05:41.211856+0000","last_clean":"2024-04-01T17:05:41.211856+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T17:05:41.211856+0000","last_undegraded":"2024-04-01T17:05:41.211856+0000","last_fullsized":"2024-04-01T17:05:41.211856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-01T17:05:41.211442+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-01T17:05:41.211442+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.211442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:54:59.880820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'41","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:57.697564+0000","last_change":"2024-04-01T17:05:57.697627+0000","last_active":"2024-04-01T17:05:57.697564+0000","last_peered":"2024-04-01T17:05:57.697564+0000","last_clean":"2024-04-01T17:05:57.697564+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T17:05:57.697564+0000","last_undegraded":"2024-04-01T17:05:57.697564+0000","last_fullsized":"2024-04-01T17:05:57.697564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-01T17:05:57.697336+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-01T17:05:57.697336+0000","last_clean_scrub_stamp":"2024-04-01T17:05:57.697336+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:49.613034+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":4631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":206,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.804282+0000","last_change":"2024-04-01T17:05:46.804329+0000","last_active":"2024-04-01T17:05:46.804282+0000","last_peered":"2024-04-01T17:05:46.804282+0000","last_clean":"2024-04-01T17:05:46.804282+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T17:05:46.804282+0000","last_undegraded":"2024-04-01T17:05:46.804282+0000","last_fullsized":"2024-04-01T17:05:46.804282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-01T17:05:46.804170+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-01T17:05:46.804170+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.804170+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:58:02.624779+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.558964+0000","last_change":"2024-04-01T17:05:45.559025+0000","last_active":"2024-04-01T17:05:45.558964+0000","last_peered":"2024-04-01T17:05:45.558964+0000","last_clean":"2024-04-01T17:05:45.558964+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T17:05:45.558964+0000","last_undegraded":"2024-04-01T17:05:45.558964+0000","last_fullsized":"2024-04-01T17:05:45.558964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T17:05:45.558774+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T17:05:45.558774+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.558774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:59:47.966523+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'39","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.044283+0000","last_change":"2024-04-01T17:05:45.044283+0000","last_active":"2024-04-01T17:05:45.044283+0000","last_peered":"2024-04-01T17:05:45.044283+0000","last_clean":"2024-04-01T17:05:45.044283+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T17:05:45.044283+0000","last_undegraded":"2024-04-01T17:05:45.044283+0000","last_fullsized":"2024-04-01T17:05:45.044283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-01T17:05:45.043943+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-01T17:05:45.043943+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.043943+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:41:38.976396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:50.748033+0000","last_change":"2024-04-01T17:05:50.748071+0000","last_active":"2024-04-01T17:05:50.748033+0000","last_peered":"2024-04-01T17:05:50.748033+0000","last_clean":"2024-04-01T17:05:50.748033+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T17:05:50.748033+0000","last_undegraded":"2024-04-01T17:05:50.748033+0000","last_fullsized":"2024-04-01T17:05:50.748033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:50.747922+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:50.747922+0000","last_clean_scrub_stamp":"2024-04-01T17:05:50.747922+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:35.452997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'25","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:39.092125+0000","last_change":"2024-04-01T17:05:39.092125+0000","last_active":"2024-04-01T17:05:39.092125+0000","last_peered":"2024-04-01T17:05:39.092125+0000","last_clean":"2024-04-01T17:05:39.092125+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T17:05:39.092125+0000","last_undegraded":"2024-04-01T17:05:39.092125+0000","last_fullsized":"2024-04-01T17:05:39.092125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-01T17:05:39.091867+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-01T17:05:39.091867+0000","last_clean_scrub_stamp":"2024-04-01T17:05:39.091867+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:56:52.638072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"27'432","reported_seq":900,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:38.239306+0000","last_change":"2024-04-01T17:05:38.239306+0000","last_active":"2024-04-01T17:05:38.239306+0000","last_peered":"2024-04-01T17:05:38.239306+0000","last_clean":"2024-04-01T17:05:38.239306+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T17:05:38.239306+0000","last_undegraded":"2024-04-01T17:05:38.239306+0000","last_fullsized":"2024-04-01T17:05:38.239306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'432","last_scrub_stamp":"2024-04-01T17:05:38.239062+0000","last_deep_scrub":"27'432","last_deep_scrub_stamp":"2024-04-01T17:05:38.239062+0000","last_clean_scrub_stamp":"2024-04-01T17:05:38.239062+0000","objects_scrubbed":1,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:54:04.547897+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110595,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":419,"num_read_kb":454,"num_write":427,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'53","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.589112+0000","last_change":"2024-04-01T17:05:44.589168+0000","last_active":"2024-04-01T17:05:44.589112+0000","last_peered":"2024-04-01T17:05:44.589112+0000","last_clean":"2024-04-01T17:05:44.589112+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T17:05:44.589112+0000","last_undegraded":"2024-04-01T17:05:44.589112+0000","last_fullsized":"2024-04-01T17:05:44.589112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-04-01T17:05:44.588931+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-04-01T17:05:44.588931+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.588931+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:24:15.599579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"27'4","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.571234+0000","last_change":"2024-04-01T17:05:44.571234+0000","last_active":"2024-04-01T17:05:44.571234+0000","last_peered":"2024-04-01T17:05:44.571234+0000","last_clean":"2024-04-01T17:05:44.571234+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T17:05:44.571234+0000","last_undegraded":"2024-04-01T17:05:44.571234+0000","last_fullsized":"2024-04-01T17:05:44.571234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:44.570968+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:44.570968+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.570968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:39:35.337619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'26","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.417686+0000","last_change":"2024-04-01T17:05:44.417686+0000","last_active":"2024-04-01T17:05:44.417686+0000","last_peered":"2024-04-01T17:05:44.417686+0000","last_clean":"2024-04-01T17:05:44.417686+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T17:05:44.417686+0000","last_undegraded":"2024-04-01T17:05:44.417686+0000","last_fullsized":"2024-04-01T17:05:44.417686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-04-01T17:05:44.417418+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-04-01T17:05:44.417418+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.417418+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:55:03.086795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":2569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'4","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:38.538148+0000","last_change":"2024-04-01T17:05:38.538148+0000","last_active":"2024-04-01T17:05:38.538148+0000","last_peered":"2024-04-01T17:05:38.538148+0000","last_clean":"2024-04-01T17:05:38.538148+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T17:05:38.538148+0000","last_undegraded":"2024-04-01T17:05:38.538148+0000","last_fullsized":"2024-04-01T17:05:38.538148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:38.537869+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:38.537869+0000","last_clean_scrub_stamp":"2024-04-01T17:05:38.537869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:02:05.299257+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'34","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.325615+0000","last_change":"2024-04-01T17:05:44.325680+0000","last_active":"2024-04-01T17:05:44.325615+0000","last_peered":"2024-04-01T17:05:44.325615+0000","last_clean":"2024-04-01T17:05:44.325615+0000","last_became_active":"2024-04-01T16:34:54.509976+0000","last_became_peered":"2024-04-01T16:34:54.509976+0000","last_unstale":"2024-04-01T17:05:44.325615+0000","last_undegraded":"2024-04-01T17:05:44.325615+0000","last_fullsized":"2024-04-01T17:05:44.325615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T17:05:44.325410+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T17:05:44.325410+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.325410+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:23:58.469296+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:48.784420+0000","last_change":"2024-04-01T17:05:48.784420+0000","last_active":"2024-04-01T17:05:48.784420+0000","last_peered":"2024-04-01T17:05:48.784420+0000","last_clean":"2024-04-01T17:05:48.784420+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T17:05:48.784420+0000","last_undegraded":"2024-04-01T17:05:48.784420+0000","last_fullsized":"2024-04-01T17:05:48.784420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T17:05:48.784259+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T17:05:48.784259+0000","last_clean_scrub_stamp":"2024-04-01T17:05:48.784259+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:37:00.725861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'40","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.610103+0000","last_change":"2024-04-01T17:05:45.610103+0000","last_active":"2024-04-01T17:05:45.610103+0000","last_peered":"2024-04-01T17:05:45.610103+0000","last_clean":"2024-04-01T17:05:45.610103+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T17:05:45.610103+0000","last_undegraded":"2024-04-01T17:05:45.610103+0000","last_fullsized":"2024-04-01T17:05:45.610103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-01T17:05:45.609839+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-01T17:05:45.609839+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.609839+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:41:39.542291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"27'1149","reported_seq":1197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.590920+0000","last_change":"2024-04-01T17:05:40.590944+0000","last_active":"2024-04-01T17:05:40.590920+0000","last_peered":"2024-04-01T17:05:40.590920+0000","last_clean":"2024-04-01T17:05:40.590920+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T17:05:40.590920+0000","last_undegraded":"2024-04-01T17:05:40.590920+0000","last_fullsized":"2024-04-01T17:05:40.590920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1149","last_scrub_stamp":"2024-04-01T17:05:40.590838+0000","last_deep_scrub":"27'1149","last_deep_scrub_stamp":"2024-04-01T17:05:40.590838+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.590838+0000","objects_scrubbed":1,"log_size":1149,"log_dups_size":0,"ondisk_log_size":1149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:45:57.078147+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2752,"num_write_kb":935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'33","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.050523+0000","last_change":"2024-04-01T17:05:42.050558+0000","last_active":"2024-04-01T17:05:42.050523+0000","last_peered":"2024-04-01T17:05:42.050523+0000","last_clean":"2024-04-01T17:05:42.050523+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T17:05:42.050523+0000","last_undegraded":"2024-04-01T17:05:42.050523+0000","last_fullsized":"2024-04-01T17:05:42.050523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-04-01T17:05:42.050400+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-04-01T17:05:42.050400+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.050400+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:05:41.261198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.992821+0000","last_change":"2024-04-01T17:05:44.992887+0000","last_active":"2024-04-01T17:05:44.992821+0000","last_peered":"2024-04-01T17:05:44.992821+0000","last_clean":"2024-04-01T17:05:44.992821+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T17:05:44.992821+0000","last_undegraded":"2024-04-01T17:05:44.992821+0000","last_fullsized":"2024-04-01T17:05:44.992821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-01T17:05:44.992607+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-01T17:05:44.992607+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.992607+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:16:53.174742+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'56","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.156834+0000","last_change":"2024-04-01T17:05:44.156862+0000","last_active":"2024-04-01T17:05:44.156834+0000","last_peered":"2024-04-01T17:05:44.156834+0000","last_clean":"2024-04-01T17:05:44.156834+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T17:05:44.156834+0000","last_undegraded":"2024-04-01T17:05:44.156834+0000","last_fullsized":"2024-04-01T17:05:44.156834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'56","last_scrub_stamp":"2024-04-01T17:05:44.156719+0000","last_deep_scrub":"27'56","last_deep_scrub_stamp":"2024-04-01T17:05:44.156719+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.156719+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:39:34.923371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":6288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:47.813061+0000","last_change":"2024-04-01T17:05:47.813102+0000","last_active":"2024-04-01T17:05:47.813061+0000","last_peered":"2024-04-01T17:05:47.813061+0000","last_clean":"2024-04-01T17:05:47.813061+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T17:05:47.813061+0000","last_undegraded":"2024-04-01T17:05:47.813061+0000","last_fullsized":"2024-04-01T17:05:47.813061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-01T17:05:47.812910+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-01T17:05:47.812910+0000","last_clean_scrub_stamp":"2024-04-01T17:05:47.812910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:16:00.789918+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'38","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.433897+0000","last_change":"2024-04-01T17:05:45.433936+0000","last_active":"2024-04-01T17:05:45.433897+0000","last_peered":"2024-04-01T17:05:45.433897+0000","last_clean":"2024-04-01T17:05:45.433897+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T17:05:45.433897+0000","last_undegraded":"2024-04-01T17:05:45.433897+0000","last_fullsized":"2024-04-01T17:05:45.433897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-04-01T17:05:45.433794+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-04-01T17:05:45.433794+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.433794+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:14:16.118091+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:36.507430+0000","last_change":"2024-04-01T17:05:36.507464+0000","last_active":"2024-04-01T17:05:36.507430+0000","last_peered":"2024-04-01T17:05:36.507430+0000","last_clean":"2024-04-01T17:05:36.507430+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T17:05:36.507430+0000","last_undegraded":"2024-04-01T17:05:36.507430+0000","last_fullsized":"2024-04-01T17:05:36.507430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:36.507322+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:36.507322+0000","last_clean_scrub_stamp":"2024-04-01T17:05:36.507322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:43:12.680568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'43","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:50.965908+0000","last_change":"2024-04-01T17:05:50.965971+0000","last_active":"2024-04-01T17:05:50.965908+0000","last_peered":"2024-04-01T17:05:50.965908+0000","last_clean":"2024-04-01T17:05:50.965908+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T17:05:50.965908+0000","last_undegraded":"2024-04-01T17:05:50.965908+0000","last_fullsized":"2024-04-01T17:05:50.965908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-01T17:05:50.965695+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-01T17:05:50.965695+0000","last_clean_scrub_stamp":"2024-04-01T17:05:50.965695+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:04:41.792139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:39.578374+0000","last_change":"2024-04-01T17:05:39.578429+0000","last_active":"2024-04-01T17:05:39.578374+0000","last_peered":"2024-04-01T17:05:39.578374+0000","last_clean":"2024-04-01T17:05:39.578374+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T17:05:39.578374+0000","last_undegraded":"2024-04-01T17:05:39.578374+0000","last_fullsized":"2024-04-01T17:05:39.578374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-01T17:05:39.578178+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-01T17:05:39.578178+0000","last_clean_scrub_stamp":"2024-04-01T17:05:39.578178+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:16:47.760313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'58","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:48.565297+0000","last_change":"2024-04-01T17:05:48.565365+0000","last_active":"2024-04-01T17:05:48.565297+0000","last_peered":"2024-04-01T17:05:48.565297+0000","last_clean":"2024-04-01T17:05:48.565297+0000","last_became_active":"2024-04-01T16:34:55.003987+0000","last_became_peered":"2024-04-01T16:34:55.003987+0000","last_unstale":"2024-04-01T17:05:48.565297+0000","last_undegraded":"2024-04-01T17:05:48.565297+0000","last_fullsized":"2024-04-01T17:05:48.565297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-01T17:05:48.565102+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-01T17:05:48.565102+0000","last_clean_scrub_stamp":"2024-04-01T17:05:48.565102+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:37:39.099929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"27'624","reported_seq":672,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:49.819576+0000","last_change":"2024-04-01T17:05:49.819576+0000","last_active":"2024-04-01T17:05:49.819576+0000","last_peered":"2024-04-01T17:05:49.819576+0000","last_clean":"2024-04-01T17:05:49.819576+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T17:05:49.819576+0000","last_undegraded":"2024-04-01T17:05:49.819576+0000","last_fullsized":"2024-04-01T17:05:49.819576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'624","last_scrub_stamp":"2024-04-01T17:05:49.819409+0000","last_deep_scrub":"27'624","last_deep_scrub_stamp":"2024-04-01T17:05:49.819409+0000","last_clean_scrub_stamp":"2024-04-01T17:05:49.819409+0000","objects_scrubbed":2,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:08:03.790368+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:49.135935+0000","last_change":"2024-04-01T17:05:49.135997+0000","last_active":"2024-04-01T17:05:49.135935+0000","last_peered":"2024-04-01T17:05:49.135935+0000","last_clean":"2024-04-01T17:05:49.135935+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T17:05:49.135935+0000","last_undegraded":"2024-04-01T17:05:49.135935+0000","last_fullsized":"2024-04-01T17:05:49.135935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-01T17:05:49.135731+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-01T17:05:49.135731+0000","last_clean_scrub_stamp":"2024-04-01T17:05:49.135731+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:00:40.401431+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"27'54","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.309795+0000","last_change":"2024-04-01T17:05:45.309859+0000","last_active":"2024-04-01T17:05:45.309795+0000","last_peered":"2024-04-01T17:05:45.309795+0000","last_clean":"2024-04-01T17:05:45.309795+0000","last_became_active":"2024-04-01T16:34:55.011400+0000","last_became_peered":"2024-04-01T16:34:55.011400+0000","last_unstale":"2024-04-01T17:05:45.309795+0000","last_undegraded":"2024-04-01T17:05:45.309795+0000","last_fullsized":"2024-04-01T17:05:45.309795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-04-01T17:05:45.309567+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-04-01T17:05:45.309567+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.309567+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:48:54.828805+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":3157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:52.712774+0000","last_change":"2024-04-01T17:05:52.712814+0000","last_active":"2024-04-01T17:05:52.712774+0000","last_peered":"2024-04-01T17:05:52.712774+0000","last_clean":"2024-04-01T17:05:52.712774+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T17:05:52.712774+0000","last_undegraded":"2024-04-01T17:05:52.712774+0000","last_fullsized":"2024-04-01T17:05:52.712774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-01T17:05:52.712684+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-01T17:05:52.712684+0000","last_clean_scrub_stamp":"2024-04-01T17:05:52.712684+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:10:36.539002+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'35","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:50.644402+0000","last_change":"2024-04-01T17:05:50.644466+0000","last_active":"2024-04-01T17:05:50.644402+0000","last_peered":"2024-04-01T17:05:50.644402+0000","last_clean":"2024-04-01T17:05:50.644402+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T17:05:50.644402+0000","last_undegraded":"2024-04-01T17:05:50.644402+0000","last_fullsized":"2024-04-01T17:05:50.644402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-01T17:05:50.644212+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-01T17:05:50.644212+0000","last_clean_scrub_stamp":"2024-04-01T17:05:50.644212+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:35.349287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"27'11","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:51.742822+0000","last_change":"2024-04-01T17:05:51.742888+0000","last_active":"2024-04-01T17:05:51.742822+0000","last_peered":"2024-04-01T17:05:51.742822+0000","last_clean":"2024-04-01T17:05:51.742822+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T17:05:51.742822+0000","last_undegraded":"2024-04-01T17:05:51.742822+0000","last_fullsized":"2024-04-01T17:05:51.742822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-01T17:05:51.742622+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-01T17:05:51.742622+0000","last_clean_scrub_stamp":"2024-04-01T17:05:51.742622+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:57:49.993902+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"27'50","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:38.055147+0000","last_change":"2024-04-01T17:05:38.055147+0000","last_active":"2024-04-01T17:05:38.055147+0000","last_peered":"2024-04-01T17:05:38.055147+0000","last_clean":"2024-04-01T17:05:38.055147+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T17:05:38.055147+0000","last_undegraded":"2024-04-01T17:05:38.055147+0000","last_fullsized":"2024-04-01T17:05:38.055147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-01T17:05:38.055022+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-01T17:05:38.055022+0000","last_clean_scrub_stamp":"2024-04-01T17:05:38.055022+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:33:14.299302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":6181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"27'145","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.029202+0000","last_change":"2024-04-01T17:05:40.029324+0000","last_active":"2024-04-01T17:05:40.029202+0000","last_peered":"2024-04-01T17:05:40.029202+0000","last_clean":"2024-04-01T17:05:40.029202+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T17:05:40.029202+0000","last_undegraded":"2024-04-01T17:05:40.029202+0000","last_fullsized":"2024-04-01T17:05:40.029202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'145","last_scrub_stamp":"2024-04-01T17:05:40.028905+0000","last_deep_scrub":"27'145","last_deep_scrub_stamp":"2024-04-01T17:05:40.028905+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.028905+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:45:56.516215+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507300,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.065794+0000","last_change":"2024-04-01T17:05:44.065854+0000","last_active":"2024-04-01T17:05:44.065794+0000","last_peered":"2024-04-01T17:05:44.065794+0000","last_clean":"2024-04-01T17:05:44.065794+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T17:05:44.065794+0000","last_undegraded":"2024-04-01T17:05:44.065794+0000","last_fullsized":"2024-04-01T17:05:44.065794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-01T17:05:44.065591+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-01T17:05:44.065591+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.065591+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:24:15.076239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'624","reported_seq":673,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:35.131515+0000","last_change":"2024-04-01T17:05:35.131515+0000","last_active":"2024-04-01T17:05:35.131515+0000","last_peered":"2024-04-01T17:05:35.131515+0000","last_clean":"2024-04-01T17:05:35.131515+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T17:05:35.131515+0000","last_undegraded":"2024-04-01T17:05:35.131515+0000","last_fullsized":"2024-04-01T17:05:35.131515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'624","last_scrub_stamp":"2024-04-01T17:05:35.131096+0000","last_deep_scrub":"27'624","last_deep_scrub_stamp":"2024-04-01T17:05:35.131096+0000","last_clean_scrub_stamp":"2024-04-01T17:05:35.131096+0000","objects_scrubbed":3,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:23:24.577710+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2204,"num_write_kb":251439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2871,"ondisk_log_size":2871,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22590885,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":419,"num_read_kb":454,"num_write":6618,"num_write_kb":25341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45244416,"data_stored":45181770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5146,"ondisk_log_size":5146,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509827,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52644,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319196,"statfs":{"total":96636764160,"available":96582856704,"internally_reserved":0,"allocated":13463552,"data_stored":13280752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509829,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":217485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509825,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41772,"kb_used_data":6436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330068,"statfs":{"total":96636764160,"available":96593989632,"internally_reserved":0,"allocated":6590464,"data_stored":6399500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509826,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":106980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509827,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43816,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328024,"statfs":{"total":96636764160,"available":96591896576,"internally_reserved":0,"allocated":8683520,"data_stored":8495624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542532,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47972,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323868,"statfs":{"total":96636764160,"available":96587640832,"internally_reserved":0,"allocated":8679424,"data_stored":8496170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542530,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49556,"kb_used_data":10060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322284,"statfs":{"total":96636764160,"available":96586018816,"internally_reserved":0,"allocated":10301440,"data_stored":10114065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542533,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35620,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336220,"statfs":{"total":96636764160,"available":96600289280,"internally_reserved":0,"allocated":290816,"data_stored":107050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5713920,"data_stored":5702242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":110595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10018816,"data_stored":10007175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8389280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T17:06:05.795 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-01T16:34:32.285854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=16, tm_min=34, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=17, tm_min=5, tm_sec=32, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T17:06:05.796 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-01T17:06:23.624 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:06:23.632 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:06:25.797 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T17:06:26.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.015+0000 7f226d800640 1 Processor -- start 2024-04-01T17:06:26.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.015+0000 7f226d800640 1 -- start start 2024-04-01T17:06:26.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.016+0000 7f226d800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2268154a60 0x7f2268071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:26.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.016+0000 7f226d800640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f2268072aa0 0x7f226806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:26.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.017+0000 7f226d800640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2268072570 con 0x7f22680c6d50 2024-04-01T17:06:26.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.017+0000 7f226d800640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f22680c2080 con 0x7f2268072aa0 2024-04-01T17:06:26.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.017+0000 7f226d800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f22680c2360 con 0x7f2268154a60 2024-04-01T17:06:26.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.018+0000 7f225fe00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f22680c6d50 0x7f2268073210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:52280/0 (socket says 172.21.15.163:52280) 2024-04-01T17:06:26.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.018+0000 7f225fe00640 1 -- 172.21.15.163:0/1470641870 learned_addr learned my addr 172.21.15.163:0/1470641870 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:06:26.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.018+0000 7f2267400640 1 --2- 172.21.15.163:0/1470641870 >> v2:172.21.15.189:3300/0 conn(0x7f2268072aa0 0x7f226806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:26.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.018+0000 7f2266a00640 1 --2- 172.21.15.163:0/1470641870 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2268154a60 0x7f2268071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:26.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.021+0000 7f2266000640 1 -- 172.21.15.163:0/1470641870 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490752890 0 0) 0x7f2268072570 con 0x7f22680c6d50 2024-04-01T17:06:26.021 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.021+0000 7f2266000640 1 -- 172.21.15.163:0/1470641870 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f224c003520 con 0x7f22680c6d50 2024-04-01T17:06:26.022 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.022+0000 7f2267400640 1 -- 172.21.15.163:0/1470641870 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2268154a60 msgr2=0x7f2268071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:26.022 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.022+0000 7f2267400640 1 --2- 172.21.15.163:0/1470641870 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2268154a60 0x7f2268071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.022 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.022+0000 7f2267400640 1 -- 172.21.15.163:0/1470641870 >> v1:172.21.15.163:6789/0 conn(0x7f22680c6d50 legacy=0x7f2268073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:26.022 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.022+0000 7f2267400640 1 -- 172.21.15.163:0/1470641870 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22680c2640 con 0x7f2268072aa0 2024-04-01T17:06:26.025 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.026+0000 7f2267400640 1 --2- 172.21.15.163:0/1470641870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2268072aa0 0x7f226806dd80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2260009d90 tx=0x7f226002bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2074b83d1c0623e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:26.034 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.035+0000 7f2266000640 1 -- 172.21.15.163:0/1470641870 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260039070 con 0x7f2268072aa0 2024-04-01T17:06:26.034 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.035+0000 7f2266000640 1 -- 172.21.15.163:0/1470641870 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226002cce0 con 0x7f2268072aa0 2024-04-01T17:06:26.035 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.035+0000 7f2266000640 1 -- 172.21.15.163:0/1470641870 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260034660 con 0x7f2268072aa0 2024-04-01T17:06:26.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.036+0000 7f226d800640 1 -- 172.21.15.163:0/1470641870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2268072aa0 msgr2=0x7f226806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:26.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.036+0000 7f226d800640 1 --2- 172.21.15.163:0/1470641870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2268072aa0 0x7f226806dd80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2260009d90 tx=0x7f226002bf30 comp rx=0 tx=0).stop 2024-04-01T17:06:26.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.036+0000 7f226d800640 1 -- 172.21.15.163:0/1470641870 shutdown_connections 2024-04-01T17:06:26.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.036+0000 7f226d800640 1 --2- 172.21.15.163:0/1470641870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2268072aa0 0x7f226806dd80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.036+0000 7f226d800640 1 --2- 172.21.15.163:0/1470641870 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2268154a60 0x7f2268071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.036+0000 7f226d800640 1 -- 172.21.15.163:0/1470641870 >> 172.21.15.163:0/1470641870 conn(0x7f22680cbe20 msgr2=0x7f22680cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:26.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.036+0000 7f226d800640 1 -- 172.21.15.163:0/1470641870 shutdown_connections 2024-04-01T17:06:26.036 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.036+0000 7f226d800640 1 -- 172.21.15.163:0/1470641870 wait complete. 2024-04-01T17:06:26.037 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.038+0000 7f226d800640 1 Processor -- start 2024-04-01T17:06:26.037 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.038+0000 7f226d800640 1 -- start start 2024-04-01T17:06:26.038 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.039+0000 7f226d800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2268072aa0 0x7f22680c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:26.039 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.039+0000 7f226d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f22680c6d50 0x7f226814a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:26.039 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.039+0000 7f226d800640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2268154a60 0x7f226814a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:26.039 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.039+0000 7f226d800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2268073920 con 0x7f2268072aa0 2024-04-01T17:06:26.039 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.039+0000 7f226d800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f22680c1d80 con 0x7f22680c6d50 2024-04-01T17:06:26.039 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.039+0000 7f226d800640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2268073aa0 con 0x7f2268154a60 2024-04-01T17:06:26.040 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.040+0000 7f2266a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2268072aa0 0x7f22680c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:26.040 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.040+0000 7f2266a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2268072aa0 0x7f22680c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55674/0 (socket says 172.21.15.163:55674) 2024-04-01T17:06:26.040 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.040+0000 7f2266a00640 1 -- 172.21.15.163:0/1461956057 learned_addr learned my addr 172.21.15.163:0/1461956057 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:06:26.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.042+0000 7f2267400640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2268154a60 0x7f226814a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:26.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.044+0000 7f2266a00640 1 -- 172.21.15.163:0/1461956057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2268154a60 msgr2=0x7f226814a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:26.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.044+0000 7f2266a00640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2268154a60 0x7f226814a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.044+0000 7f2266a00640 1 -- 172.21.15.163:0/1461956057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f22680c6d50 msgr2=0x7f226814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:26.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.044+0000 7f2266a00640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f22680c6d50 0x7f226814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.044 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.044+0000 7f2266a00640 1 -- 172.21.15.163:0/1461956057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22680ca160 con 0x7f2268072aa0 2024-04-01T17:06:26.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.047+0000 7f2266a00640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2268072aa0 0x7f22680c9c20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f225800e8a0 tx=0x7f225800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:26.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.051+0000 7f225ea00640 1 -- 172.21.15.163:0/1461956057 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2258017070 con 0x7f2268072aa0 2024-04-01T17:06:26.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.051+0000 7f225ea00640 1 -- 172.21.15.163:0/1461956057 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f225800c940 con 0x7f2268072aa0 2024-04-01T17:06:26.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.051+0000 7f225ea00640 1 -- 172.21.15.163:0/1461956057 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225800cd30 con 0x7f2268072aa0 2024-04-01T17:06:26.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.051+0000 7f226d800640 1 -- 172.21.15.163:0/1461956057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22681f1460 con 0x7f2268072aa0 2024-04-01T17:06:26.051 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.051+0000 7f226d800640 1 -- 172.21.15.163:0/1461956057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22681f40e0 con 0x7f2268072aa0 2024-04-01T17:06:26.052 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.052+0000 7f226d800640 1 -- 172.21.15.163:0/1461956057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22680756d0 con 0x7f2268072aa0 2024-04-01T17:06:26.343 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.343+0000 7f225ea00640 1 -- 172.21.15.163:0/1461956057 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f225801a070 con 0x7f2268072aa0 2024-04-01T17:06:26.346 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.346+0000 7f225ea00640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f224406c940 0x7f224406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:26.347 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.347+0000 7f225fe00640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f224406c940 0x7f224406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:26.349 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.349+0000 7f225fe00640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f224406c940 0x7f224406ee00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2250000f60 tx=0x7f22500078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:26.385 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.386+0000 7f225ea00640 1 -- 172.21.15.163:0/1461956057 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f2258057f80 con 0x7f2268072aa0 2024-04-01T17:06:26.386 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.387+0000 7f225ea00640 1 -- 172.21.15.163:0/1461956057 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2258059ee0 con 0x7f2268072aa0 2024-04-01T17:06:26.605 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.605+0000 7f226d800640 1 -- 172.21.15.163:0/1461956057 --> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22681f1210 con 0x7f224406c940 2024-04-01T17:06:26.614 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.614+0000 7f225ea00640 1 -- 172.21.15.163:0/1461956057 <== mgr.4103 v2:172.21.15.163:6800/4133086793 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253028 (secure 0 0 0) 0x7f22681f1210 con 0x7f224406c940 2024-04-01T17:06:26.617 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T17:06:26.618 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2024-04-01T17:06:26.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.619+0000 7f226d800640 1 -- 172.21.15.163:0/1461956057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f224406c940 msgr2=0x7f224406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:26.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.619+0000 7f226d800640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f224406c940 0x7f224406ee00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2250000f60 tx=0x7f22500078f0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.619+0000 7f226d800640 1 -- 172.21.15.163:0/1461956057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2268072aa0 msgr2=0x7f22680c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:26.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.619+0000 7f226d800640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2268072aa0 0x7f22680c9c20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f225800e8a0 tx=0x7f225800ed60 comp rx=0 tx=0).stop 2024-04-01T17:06:26.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.619+0000 7f226d800640 1 -- 172.21.15.163:0/1461956057 shutdown_connections 2024-04-01T17:06:26.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.619+0000 7f226d800640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f224406c940 0x7f224406ee00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.619+0000 7f226d800640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2268154a60 0x7f226814a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.620 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.619+0000 7f226d800640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f22680c6d50 0x7f226814a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.621 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.619+0000 7f226d800640 1 --2- 172.21.15.163:0/1461956057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2268072aa0 0x7f22680c9c20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.621 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.619+0000 7f226d800640 1 -- 172.21.15.163:0/1461956057 >> 172.21.15.163:0/1461956057 conn(0x7f22680cbe20 msgr2=0x7f226806dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:26.621 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.619+0000 7f226d800640 1 -- 172.21.15.163:0/1461956057 shutdown_connections 2024-04-01T17:06:26.621 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.619+0000 7f226d800640 1 -- 172.21.15.163:0/1461956057 wait complete. 2024-04-01T17:06:26.640 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":995,"stamp":"2024-04-01T17:06:24.606844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23181253,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":535,"num_read_kb":554,"num_write":8981,"num_write_kb":279196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8136,"ondisk_log_size":8136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":334400,"kb_used_data":47552,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754640320,"statfs":{"total":773094113280,"available":772751687680,"internally_reserved":0,"allocated":48693248,"data_stored":47217626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":293654068},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004859"},"pg_stats":[{"pgid":"3.3f","version":"27'39","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:55.685028+0000","last_change":"2024-04-01T17:05:55.685068+0000","last_active":"2024-04-01T17:05:55.685028+0000","last_peered":"2024-04-01T17:05:55.685028+0000","last_clean":"2024-04-01T17:05:55.685028+0000","last_became_active":"2024-04-01T16:34:34.033166+0000","last_became_peered":"2024-04-01T16:34:34.033166+0000","last_unstale":"2024-04-01T17:05:55.685028+0000","last_undegraded":"2024-04-01T17:05:55.685028+0000","last_fullsized":"2024-04-01T17:05:55.685028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-01T17:05:55.684922+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-01T17:05:55.684922+0000","last_clean_scrub_stamp":"2024-04-01T17:05:55.684922+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:01:32.551588+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":3467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'41","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.599866+0000","last_change":"2024-04-01T17:05:43.599866+0000","last_active":"2024-04-01T17:05:43.599866+0000","last_peered":"2024-04-01T17:05:43.599866+0000","last_clean":"2024-04-01T17:05:43.599866+0000","last_became_active":"2024-04-01T16:34:34.064439+0000","last_became_peered":"2024-04-01T16:34:34.064439+0000","last_unstale":"2024-04-01T17:05:43.599866+0000","last_undegraded":"2024-04-01T17:05:43.599866+0000","last_fullsized":"2024-04-01T17:05:43.599866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-01T17:05:43.599413+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-01T17:05:43.599413+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.599413+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:00:34.865114+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":1086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'48","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.161502+0000","last_change":"2024-04-01T17:05:45.161502+0000","last_active":"2024-04-01T17:05:45.161502+0000","last_peered":"2024-04-01T17:05:45.161502+0000","last_clean":"2024-04-01T17:05:45.161502+0000","last_became_active":"2024-04-01T16:34:34.084316+0000","last_became_peered":"2024-04-01T16:34:34.084316+0000","last_unstale":"2024-04-01T17:05:45.161502+0000","last_undegraded":"2024-04-01T17:05:45.161502+0000","last_fullsized":"2024-04-01T17:05:45.161502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-01T17:05:45.161246+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-01T17:05:45.161246+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.161246+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:59:47.568996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'35","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:56.748846+0000","last_change":"2024-04-01T17:05:56.748884+0000","last_active":"2024-04-01T17:05:56.748846+0000","last_peered":"2024-04-01T17:05:56.748846+0000","last_clean":"2024-04-01T17:05:56.748846+0000","last_became_active":"2024-04-01T16:34:34.088323+0000","last_became_peered":"2024-04-01T16:34:34.088323+0000","last_unstale":"2024-04-01T17:05:56.748846+0000","last_undegraded":"2024-04-01T17:05:56.748846+0000","last_fullsized":"2024-04-01T17:05:56.748846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-01T17:05:56.748749+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-01T17:05:56.748749+0000","last_clean_scrub_stamp":"2024-04-01T17:05:56.748749+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:40:54.664387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:06:01.688892+0000","last_change":"2024-04-01T17:06:01.688932+0000","last_active":"2024-04-01T17:06:01.688892+0000","last_peered":"2024-04-01T17:06:01.688892+0000","last_clean":"2024-04-01T17:06:01.688892+0000","last_became_active":"2024-04-01T16:34:34.085479+0000","last_became_peered":"2024-04-01T16:34:34.085479+0000","last_unstale":"2024-04-01T17:06:01.688892+0000","last_undegraded":"2024-04-01T17:06:01.688892+0000","last_fullsized":"2024-04-01T17:06:01.688892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-01T17:06:01.688788+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-01T17:06:01.688788+0000","last_clean_scrub_stamp":"2024-04-01T17:06:01.688788+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:41:26.789396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'60","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:52.673357+0000","last_change":"2024-04-01T17:05:52.673411+0000","last_active":"2024-04-01T17:05:52.673357+0000","last_peered":"2024-04-01T17:05:52.673357+0000","last_clean":"2024-04-01T17:05:52.673357+0000","last_became_active":"2024-04-01T16:34:34.065798+0000","last_became_peered":"2024-04-01T16:34:34.065798+0000","last_unstale":"2024-04-01T17:05:52.673357+0000","last_undegraded":"2024-04-01T17:05:52.673357+0000","last_fullsized":"2024-04-01T17:05:52.673357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'60","last_scrub_stamp":"2024-04-01T17:05:52.673169+0000","last_deep_scrub":"27'60","last_deep_scrub_stamp":"2024-04-01T17:05:52.673169+0000","last_clean_scrub_stamp":"2024-04-01T17:05:52.673169+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:54:16.553141+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":2601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'34","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:58.668441+0000","last_change":"2024-04-01T17:05:58.668492+0000","last_active":"2024-04-01T17:05:58.668441+0000","last_peered":"2024-04-01T17:05:58.668441+0000","last_clean":"2024-04-01T17:05:58.668441+0000","last_became_active":"2024-04-01T16:34:34.072675+0000","last_became_peered":"2024-04-01T16:34:34.072675+0000","last_unstale":"2024-04-01T17:05:58.668441+0000","last_undegraded":"2024-04-01T17:05:58.668441+0000","last_fullsized":"2024-04-01T17:05:58.668441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T17:05:58.668340+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T17:05:58.668340+0000","last_clean_scrub_stamp":"2024-04-01T17:05:58.668340+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:10:47.255631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'42","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.010658+0000","last_change":"2024-04-01T17:05:46.010722+0000","last_active":"2024-04-01T17:05:46.010658+0000","last_peered":"2024-04-01T17:05:46.010658+0000","last_clean":"2024-04-01T17:05:46.010658+0000","last_became_active":"2024-04-01T16:34:34.088103+0000","last_became_peered":"2024-04-01T16:34:34.088103+0000","last_unstale":"2024-04-01T17:05:46.010658+0000","last_undegraded":"2024-04-01T17:05:46.010658+0000","last_fullsized":"2024-04-01T17:05:46.010658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-01T17:05:46.010460+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-01T17:05:46.010460+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.010460+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:09:03.853346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":1328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'48","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:56.691336+0000","last_change":"2024-04-01T17:05:56.691336+0000","last_active":"2024-04-01T17:05:56.691336+0000","last_peered":"2024-04-01T17:05:56.691336+0000","last_clean":"2024-04-01T17:05:56.691336+0000","last_became_active":"2024-04-01T16:34:34.038201+0000","last_became_peered":"2024-04-01T16:34:34.038201+0000","last_unstale":"2024-04-01T17:05:56.691336+0000","last_undegraded":"2024-04-01T17:05:56.691336+0000","last_fullsized":"2024-04-01T17:05:56.691336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-01T17:05:56.691093+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-01T17:05:56.691093+0000","last_clean_scrub_stamp":"2024-04-01T17:05:56.691093+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:40:54.606731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:51.189316+0000","last_change":"2024-04-01T17:05:51.189316+0000","last_active":"2024-04-01T17:05:51.189316+0000","last_peered":"2024-04-01T17:05:51.189316+0000","last_clean":"2024-04-01T17:05:51.189316+0000","last_became_active":"2024-04-01T16:34:34.040164+0000","last_became_peered":"2024-04-01T16:34:34.040164+0000","last_unstale":"2024-04-01T17:05:51.189316+0000","last_undegraded":"2024-04-01T17:05:51.189316+0000","last_fullsized":"2024-04-01T17:05:51.189316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-01T17:05:51.189064+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-01T17:05:51.189064+0000","last_clean_scrub_stamp":"2024-04-01T17:05:51.189064+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:09:09.031949+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'36","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:50.152794+0000","last_change":"2024-04-01T17:05:50.152794+0000","last_active":"2024-04-01T17:05:50.152794+0000","last_peered":"2024-04-01T17:05:50.152794+0000","last_clean":"2024-04-01T17:05:50.152794+0000","last_became_active":"2024-04-01T16:34:34.037876+0000","last_became_peered":"2024-04-01T16:34:34.037876+0000","last_unstale":"2024-04-01T17:05:50.152794+0000","last_undegraded":"2024-04-01T17:05:50.152794+0000","last_fullsized":"2024-04-01T17:05:50.152794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-04-01T17:05:50.152672+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-04-01T17:05:50.152672+0000","last_clean_scrub_stamp":"2024-04-01T17:05:50.152672+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:05:02.374826+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'32","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.410670+0000","last_change":"2024-04-01T17:05:43.410670+0000","last_active":"2024-04-01T17:05:43.410670+0000","last_peered":"2024-04-01T17:05:43.410670+0000","last_clean":"2024-04-01T17:05:43.410670+0000","last_became_active":"2024-04-01T16:34:34.034260+0000","last_became_peered":"2024-04-01T16:34:34.034260+0000","last_unstale":"2024-04-01T17:05:43.410670+0000","last_undegraded":"2024-04-01T17:05:43.410670+0000","last_fullsized":"2024-04-01T17:05:43.410670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2024-04-01T17:05:43.410531+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2024-04-01T17:05:43.410531+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.410531+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:26:23.991661+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'66","reported_seq":109,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.098726+0000","last_change":"2024-04-01T17:05:43.098726+0000","last_active":"2024-04-01T17:05:43.098726+0000","last_peered":"2024-04-01T17:05:43.098726+0000","last_clean":"2024-04-01T17:05:43.098726+0000","last_became_active":"2024-04-01T16:34:34.085533+0000","last_became_peered":"2024-04-01T16:34:34.085533+0000","last_unstale":"2024-04-01T17:05:43.098726+0000","last_undegraded":"2024-04-01T17:05:43.098726+0000","last_fullsized":"2024-04-01T17:05:43.098726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2024-04-01T17:05:43.098457+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2024-04-01T17:05:43.098457+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.098457+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:00:34.364158+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'46","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.132738+0000","last_change":"2024-04-01T17:05:43.132789+0000","last_active":"2024-04-01T17:05:43.132738+0000","last_peered":"2024-04-01T17:05:43.132738+0000","last_clean":"2024-04-01T17:05:43.132738+0000","last_became_active":"2024-04-01T16:34:34.070895+0000","last_became_peered":"2024-04-01T16:34:34.070895+0000","last_unstale":"2024-04-01T17:05:43.132738+0000","last_undegraded":"2024-04-01T17:05:43.132738+0000","last_fullsized":"2024-04-01T17:05:43.132738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-01T17:05:43.132627+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-01T17:05:43.132627+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.132627+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:32:07.149822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'45","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.633839+0000","last_change":"2024-04-01T17:05:42.633898+0000","last_active":"2024-04-01T17:05:42.633839+0000","last_peered":"2024-04-01T17:05:42.633839+0000","last_clean":"2024-04-01T17:05:42.633839+0000","last_became_active":"2024-04-01T16:34:33.904258+0000","last_became_peered":"2024-04-01T16:34:33.904258+0000","last_unstale":"2024-04-01T17:05:42.633839+0000","last_undegraded":"2024-04-01T17:05:42.633839+0000","last_fullsized":"2024-04-01T17:05:42.633839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-01T17:05:42.633595+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-01T17:05:42.633595+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.633595+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:05:41.844393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":3152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'51","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:51.682951+0000","last_change":"2024-04-01T17:05:51.683006+0000","last_active":"2024-04-01T17:05:51.682951+0000","last_peered":"2024-04-01T17:05:51.682951+0000","last_clean":"2024-04-01T17:05:51.682951+0000","last_became_active":"2024-04-01T16:34:34.064140+0000","last_became_peered":"2024-04-01T16:34:34.064140+0000","last_unstale":"2024-04-01T17:05:51.682951+0000","last_undegraded":"2024-04-01T17:05:51.682951+0000","last_fullsized":"2024-04-01T17:05:51.682951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-01T17:05:51.682774+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-01T17:05:51.682774+0000","last_clean_scrub_stamp":"2024-04-01T17:05:51.682774+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:35:17.471707+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'54","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:49.670916+0000","last_change":"2024-04-01T17:05:49.670975+0000","last_active":"2024-04-01T17:05:49.670916+0000","last_peered":"2024-04-01T17:05:49.670916+0000","last_clean":"2024-04-01T17:05:49.670916+0000","last_became_active":"2024-04-01T16:34:34.031336+0000","last_became_peered":"2024-04-01T16:34:34.031336+0000","last_unstale":"2024-04-01T17:05:49.670916+0000","last_undegraded":"2024-04-01T17:05:49.670916+0000","last_fullsized":"2024-04-01T17:05:49.670916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-04-01T17:05:49.670690+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-04-01T17:05:49.670690+0000","last_clean_scrub_stamp":"2024-04-01T17:05:49.670690+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:38:15.222029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":6831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'56","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.248454+0000","last_change":"2024-04-01T17:05:42.248514+0000","last_active":"2024-04-01T17:05:42.248454+0000","last_peered":"2024-04-01T17:05:42.248454+0000","last_clean":"2024-04-01T17:05:42.248454+0000","last_became_active":"2024-04-01T16:34:34.081796+0000","last_became_peered":"2024-04-01T16:34:34.081796+0000","last_unstale":"2024-04-01T17:05:42.248454+0000","last_undegraded":"2024-04-01T17:05:42.248454+0000","last_fullsized":"2024-04-01T17:05:42.248454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'56","last_scrub_stamp":"2024-04-01T17:05:42.248253+0000","last_deep_scrub":"27'56","last_deep_scrub_stamp":"2024-04-01T17:05:42.248253+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.248253+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:20:00.675803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:59.708026+0000","last_change":"2024-04-01T17:05:59.708026+0000","last_active":"2024-04-01T17:05:59.708026+0000","last_peered":"2024-04-01T17:05:59.708026+0000","last_clean":"2024-04-01T17:05:59.708026+0000","last_became_active":"2024-04-01T16:34:34.082761+0000","last_became_peered":"2024-04-01T16:34:34.082761+0000","last_unstale":"2024-04-01T17:05:59.708026+0000","last_undegraded":"2024-04-01T17:05:59.708026+0000","last_fullsized":"2024-04-01T17:05:59.708026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T17:05:59.707782+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T17:05:59.707782+0000","last_clean_scrub_stamp":"2024-04-01T17:05:59.707782+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:03:04.115663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":2798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"27'66","reported_seq":110,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:48.086878+0000","last_change":"2024-04-01T17:05:48.086878+0000","last_active":"2024-04-01T17:05:48.086878+0000","last_peered":"2024-04-01T17:05:48.086878+0000","last_clean":"2024-04-01T17:05:48.086878+0000","last_became_active":"2024-04-01T16:34:34.033724+0000","last_became_peered":"2024-04-01T16:34:34.033724+0000","last_unstale":"2024-04-01T17:05:48.086878+0000","last_undegraded":"2024-04-01T17:05:48.086878+0000","last_fullsized":"2024-04-01T17:05:48.086878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2024-04-01T17:05:48.086548+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2024-04-01T17:05:48.086548+0000","last_clean_scrub_stamp":"2024-04-01T17:05:48.086548+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:05:47.297346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"27'53","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.118919+0000","last_change":"2024-04-01T17:05:40.118919+0000","last_active":"2024-04-01T17:05:40.118919+0000","last_peered":"2024-04-01T17:05:40.118919+0000","last_clean":"2024-04-01T17:05:40.118919+0000","last_became_active":"2024-04-01T16:34:34.067668+0000","last_became_peered":"2024-04-01T16:34:34.067668+0000","last_unstale":"2024-04-01T17:05:40.118919+0000","last_undegraded":"2024-04-01T17:05:40.118919+0000","last_fullsized":"2024-04-01T17:05:40.118919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-04-01T17:05:40.118570+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-04-01T17:05:40.118570+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.118570+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:44:54.364433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"27'41","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:48.658728+0000","last_change":"2024-04-01T17:05:48.658728+0000","last_active":"2024-04-01T17:05:48.658728+0000","last_peered":"2024-04-01T17:05:48.658728+0000","last_clean":"2024-04-01T17:05:48.658728+0000","last_became_active":"2024-04-01T16:34:34.031183+0000","last_became_peered":"2024-04-01T16:34:34.031183+0000","last_unstale":"2024-04-01T17:05:48.658728+0000","last_undegraded":"2024-04-01T17:05:48.658728+0000","last_fullsized":"2024-04-01T17:05:48.658728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-01T17:05:48.658450+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-01T17:05:48.658450+0000","last_clean_scrub_stamp":"2024-04-01T17:05:48.658450+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:37:00.600052+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'56","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.983054+0000","last_change":"2024-04-01T17:05:46.983054+0000","last_active":"2024-04-01T17:05:46.983054+0000","last_peered":"2024-04-01T17:05:46.983054+0000","last_clean":"2024-04-01T17:05:46.983054+0000","last_became_active":"2024-04-01T16:34:34.089996+0000","last_became_peered":"2024-04-01T16:34:34.089996+0000","last_unstale":"2024-04-01T17:05:46.983054+0000","last_undegraded":"2024-04-01T17:05:46.983054+0000","last_fullsized":"2024-04-01T17:05:46.983054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'56","last_scrub_stamp":"2024-04-01T17:05:46.982790+0000","last_deep_scrub":"27'56","last_deep_scrub_stamp":"2024-04-01T17:05:46.982790+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.982790+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:55:15.850838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":6379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'42","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:53.711797+0000","last_change":"2024-04-01T17:05:53.711839+0000","last_active":"2024-04-01T17:05:53.711797+0000","last_peered":"2024-04-01T17:05:53.711797+0000","last_clean":"2024-04-01T17:05:53.711797+0000","last_became_active":"2024-04-01T16:34:34.083155+0000","last_became_peered":"2024-04-01T16:34:34.083155+0000","last_unstale":"2024-04-01T17:05:53.711797+0000","last_undegraded":"2024-04-01T17:05:53.711797+0000","last_fullsized":"2024-04-01T17:05:53.711797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-01T17:05:53.711662+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-01T17:05:53.711662+0000","last_clean_scrub_stamp":"2024-04-01T17:05:53.711662+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:38:16.835654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"27'33","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:48.008212+0000","last_change":"2024-04-01T17:05:48.008275+0000","last_active":"2024-04-01T17:05:48.008212+0000","last_peered":"2024-04-01T17:05:48.008212+0000","last_clean":"2024-04-01T17:05:48.008212+0000","last_became_active":"2024-04-01T16:34:34.090343+0000","last_became_peered":"2024-04-01T16:34:34.090343+0000","last_unstale":"2024-04-01T17:05:48.008212+0000","last_undegraded":"2024-04-01T17:05:48.008212+0000","last_fullsized":"2024-04-01T17:05:48.008212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-04-01T17:05:48.008011+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-04-01T17:05:48.008011+0000","last_clean_scrub_stamp":"2024-04-01T17:05:48.008011+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:37:38.542838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"27'56","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:54.140041+0000","last_change":"2024-04-01T17:05:54.140105+0000","last_active":"2024-04-01T17:05:54.140041+0000","last_peered":"2024-04-01T17:05:54.140041+0000","last_clean":"2024-04-01T17:05:54.140041+0000","last_became_active":"2024-04-01T16:34:54.510173+0000","last_became_peered":"2024-04-01T16:34:54.510173+0000","last_unstale":"2024-04-01T17:05:54.140041+0000","last_undegraded":"2024-04-01T17:05:54.140041+0000","last_fullsized":"2024-04-01T17:05:54.140041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'56","last_scrub_stamp":"2024-04-01T17:05:54.139843+0000","last_deep_scrub":"27'56","last_deep_scrub_stamp":"2024-04-01T17:05:54.139843+0000","last_clean_scrub_stamp":"2024-04-01T17:05:54.139843+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:51:53.320967+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'40","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:47.548353+0000","last_change":"2024-04-01T17:05:47.548443+0000","last_active":"2024-04-01T17:05:47.548353+0000","last_peered":"2024-04-01T17:05:47.548353+0000","last_clean":"2024-04-01T17:05:47.548353+0000","last_became_active":"2024-04-01T16:34:34.091607+0000","last_became_peered":"2024-04-01T16:34:34.091607+0000","last_unstale":"2024-04-01T17:05:47.548353+0000","last_undegraded":"2024-04-01T17:05:47.548353+0000","last_fullsized":"2024-04-01T17:05:47.548353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-01T17:05:47.548124+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-01T17:05:47.548124+0000","last_clean_scrub_stamp":"2024-04-01T17:05:47.548124+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:55:16.416172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":2488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"27'25","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:49.946670+0000","last_change":"2024-04-01T17:05:49.946730+0000","last_active":"2024-04-01T17:05:49.946670+0000","last_peered":"2024-04-01T17:05:49.946670+0000","last_clean":"2024-04-01T17:05:49.946670+0000","last_became_active":"2024-04-01T16:34:34.091267+0000","last_became_peered":"2024-04-01T16:34:34.091267+0000","last_unstale":"2024-04-01T17:05:49.946670+0000","last_undegraded":"2024-04-01T17:05:49.946670+0000","last_fullsized":"2024-04-01T17:05:49.946670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-01T17:05:49.946474+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-01T17:05:49.946474+0000","last_clean_scrub_stamp":"2024-04-01T17:05:49.946474+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:13:40.114037+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'39","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.134239+0000","last_change":"2024-04-01T17:05:46.134239+0000","last_active":"2024-04-01T17:05:46.134239+0000","last_peered":"2024-04-01T17:05:46.134239+0000","last_clean":"2024-04-01T17:05:46.134239+0000","last_became_active":"2024-04-01T16:34:34.087376+0000","last_became_peered":"2024-04-01T16:34:34.087376+0000","last_unstale":"2024-04-01T17:05:46.134239+0000","last_undegraded":"2024-04-01T17:05:46.134239+0000","last_fullsized":"2024-04-01T17:05:46.134239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-01T17:05:46.133803+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-01T17:05:46.133803+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.133803+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:58:01.954412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"27'56","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:54.738005+0000","last_change":"2024-04-01T17:05:54.738059+0000","last_active":"2024-04-01T17:05:54.738005+0000","last_peered":"2024-04-01T17:05:54.738005+0000","last_clean":"2024-04-01T17:05:54.738005+0000","last_became_active":"2024-04-01T16:34:34.083807+0000","last_became_peered":"2024-04-01T16:34:34.083807+0000","last_unstale":"2024-04-01T17:05:54.738005+0000","last_undegraded":"2024-04-01T17:05:54.738005+0000","last_fullsized":"2024-04-01T17:05:54.738005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'56","last_scrub_stamp":"2024-04-01T17:05:54.737826+0000","last_deep_scrub":"27'56","last_deep_scrub_stamp":"2024-04-01T17:05:54.737826+0000","last_clean_scrub_stamp":"2024-04-01T17:05:54.737826+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:17:48.727070+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"27'46","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.293132+0000","last_change":"2024-04-01T17:05:43.293132+0000","last_active":"2024-04-01T17:05:43.293132+0000","last_peered":"2024-04-01T17:05:43.293132+0000","last_clean":"2024-04-01T17:05:43.293132+0000","last_became_active":"2024-04-01T16:34:34.088124+0000","last_became_peered":"2024-04-01T16:34:34.088124+0000","last_unstale":"2024-04-01T17:05:43.293132+0000","last_undegraded":"2024-04-01T17:05:43.293132+0000","last_fullsized":"2024-04-01T17:05:43.293132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-01T17:05:43.293028+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-01T17:05:43.293028+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.293028+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:35:09.777278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"27'56","reported_seq":101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:53.179357+0000","last_change":"2024-04-01T17:05:53.179416+0000","last_active":"2024-04-01T17:05:53.179357+0000","last_peered":"2024-04-01T17:05:53.179357+0000","last_clean":"2024-04-01T17:05:53.179357+0000","last_became_active":"2024-04-01T16:34:34.067974+0000","last_became_peered":"2024-04-01T16:34:34.067974+0000","last_unstale":"2024-04-01T17:05:53.179357+0000","last_undegraded":"2024-04-01T17:05:53.179357+0000","last_fullsized":"2024-04-01T17:05:53.179357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'56","last_scrub_stamp":"2024-04-01T17:05:53.179166+0000","last_deep_scrub":"27'56","last_deep_scrub_stamp":"2024-04-01T17:05:53.179166+0000","last_clean_scrub_stamp":"2024-04-01T17:05:53.179166+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:16:15.944840+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":5837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"27'29","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.357991+0000","last_change":"2024-04-01T17:05:41.358031+0000","last_active":"2024-04-01T17:05:41.357991+0000","last_peered":"2024-04-01T17:05:41.357991+0000","last_clean":"2024-04-01T17:05:41.357991+0000","last_became_active":"2024-04-01T16:34:33.900236+0000","last_became_peered":"2024-04-01T16:34:33.900236+0000","last_unstale":"2024-04-01T17:05:41.357991+0000","last_undegraded":"2024-04-01T17:05:41.357991+0000","last_fullsized":"2024-04-01T17:05:41.357991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-04-01T17:05:41.357871+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-04-01T17:05:41.357871+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.357871+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:28:35.750340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'510","reported_seq":556,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:39.003970+0000","last_change":"2024-04-01T17:05:39.004003+0000","last_active":"2024-04-01T17:05:39.003970+0000","last_peered":"2024-04-01T17:05:39.003970+0000","last_clean":"2024-04-01T17:05:39.003970+0000","last_became_active":"2024-04-01T16:34:31.488626+0000","last_became_peered":"2024-04-01T16:34:31.488626+0000","last_unstale":"2024-04-01T17:05:39.003970+0000","last_undegraded":"2024-04-01T17:05:39.003970+0000","last_fullsized":"2024-04-01T17:05:39.003970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'510","last_scrub_stamp":"2024-04-01T17:05:39.003870+0000","last_deep_scrub":"27'510","last_deep_scrub_stamp":"2024-04-01T17:05:39.003870+0000","last_clean_scrub_stamp":"2024-04-01T17:05:39.003870+0000","objects_scrubbed":1,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:16:47.186005+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'34","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:37.044058+0000","last_change":"2024-04-01T17:05:37.044119+0000","last_active":"2024-04-01T17:05:37.044058+0000","last_peered":"2024-04-01T17:05:37.044058+0000","last_clean":"2024-04-01T17:05:37.044058+0000","last_became_active":"2024-04-01T16:34:34.064651+0000","last_became_peered":"2024-04-01T16:34:34.064651+0000","last_unstale":"2024-04-01T17:05:37.044058+0000","last_undegraded":"2024-04-01T17:05:37.044058+0000","last_fullsized":"2024-04-01T17:05:37.044058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T17:05:37.043862+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T17:05:37.043862+0000","last_clean_scrub_stamp":"2024-04-01T17:05:37.043862+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:47:39.797490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"27'433","reported_seq":479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.081837+0000","last_change":"2024-04-01T17:05:43.081901+0000","last_active":"2024-04-01T17:05:43.081837+0000","last_peered":"2024-04-01T17:05:43.081837+0000","last_clean":"2024-04-01T17:05:43.081837+0000","last_became_active":"2024-04-01T16:34:31.529641+0000","last_became_peered":"2024-04-01T16:34:31.529641+0000","last_unstale":"2024-04-01T17:05:43.081837+0000","last_undegraded":"2024-04-01T17:05:43.081837+0000","last_fullsized":"2024-04-01T17:05:43.081837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'433","last_scrub_stamp":"2024-04-01T17:05:43.081565+0000","last_deep_scrub":"27'433","last_deep_scrub_stamp":"2024-04-01T17:05:43.081565+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.081565+0000","objects_scrubbed":1,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:58.553659+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.034354+0000","last_change":"2024-04-01T17:05:41.034354+0000","last_active":"2024-04-01T17:05:41.034354+0000","last_peered":"2024-04-01T17:05:41.034354+0000","last_clean":"2024-04-01T17:05:41.034354+0000","last_became_active":"2024-04-01T16:34:31.527732+0000","last_became_peered":"2024-04-01T16:34:31.527732+0000","last_unstale":"2024-04-01T17:05:41.034354+0000","last_undegraded":"2024-04-01T17:05:41.034354+0000","last_fullsized":"2024-04-01T17:05:41.034354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-01T17:05:41.034109+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-01T17:05:41.034109+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.034109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:42:03.426829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'57","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:48.980807+0000","last_change":"2024-04-01T17:05:48.980807+0000","last_active":"2024-04-01T17:05:48.980807+0000","last_peered":"2024-04-01T17:05:48.980807+0000","last_clean":"2024-04-01T17:05:48.980807+0000","last_became_active":"2024-04-01T16:34:34.090815+0000","last_became_peered":"2024-04-01T16:34:34.090815+0000","last_unstale":"2024-04-01T17:05:48.980807+0000","last_undegraded":"2024-04-01T17:05:48.980807+0000","last_fullsized":"2024-04-01T17:05:48.980807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2024-04-01T17:05:48.980516+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2024-04-01T17:05:48.980516+0000","last_clean_scrub_stamp":"2024-04-01T17:05:48.980516+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:12:12.167310+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":3573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:43.610593+0000","last_change":"2024-04-01T17:05:43.610593+0000","last_active":"2024-04-01T17:05:43.610593+0000","last_peered":"2024-04-01T17:05:43.610593+0000","last_clean":"2024-04-01T17:05:43.610593+0000","last_became_active":"2024-04-01T16:34:31.567718+0000","last_became_peered":"2024-04-01T16:34:31.567718+0000","last_unstale":"2024-04-01T17:05:43.610593+0000","last_undegraded":"2024-04-01T17:05:43.610593+0000","last_fullsized":"2024-04-01T17:05:43.610593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:43.610338+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:43.610338+0000","last_clean_scrub_stamp":"2024-04-01T17:05:43.610338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:32:07.627534+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'43","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.594546+0000","last_change":"2024-04-01T17:05:46.594546+0000","last_active":"2024-04-01T17:05:46.594546+0000","last_peered":"2024-04-01T17:05:46.594546+0000","last_clean":"2024-04-01T17:05:46.594546+0000","last_became_active":"2024-04-01T16:34:34.086933+0000","last_became_peered":"2024-04-01T16:34:34.086933+0000","last_unstale":"2024-04-01T17:05:46.594546+0000","last_undegraded":"2024-04-01T17:05:46.594546+0000","last_fullsized":"2024-04-01T17:05:46.594546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-01T17:05:46.594276+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-01T17:05:46.594276+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.594276+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:09:04.437161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:47.066908+0000","last_change":"2024-04-01T17:05:47.066908+0000","last_active":"2024-04-01T17:05:47.066908+0000","last_peered":"2024-04-01T17:05:47.066908+0000","last_clean":"2024-04-01T17:05:47.066908+0000","last_became_active":"2024-04-01T16:34:31.566532+0000","last_became_peered":"2024-04-01T16:34:31.566532+0000","last_unstale":"2024-04-01T17:05:47.066908+0000","last_undegraded":"2024-04-01T17:05:47.066908+0000","last_fullsized":"2024-04-01T17:05:47.066908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:47.066770+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:47.066770+0000","last_clean_scrub_stamp":"2024-04-01T17:05:47.066770+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:46:32.450929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'70","reported_seq":113,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:47.616805+0000","last_change":"2024-04-01T17:05:47.616805+0000","last_active":"2024-04-01T17:05:47.616805+0000","last_peered":"2024-04-01T17:05:47.616805+0000","last_clean":"2024-04-01T17:05:47.616805+0000","last_became_active":"2024-04-01T16:34:34.030479+0000","last_became_peered":"2024-04-01T16:34:34.030479+0000","last_unstale":"2024-04-01T17:05:47.616805+0000","last_undegraded":"2024-04-01T17:05:47.616805+0000","last_fullsized":"2024-04-01T17:05:47.616805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'70","last_scrub_stamp":"2024-04-01T17:05:47.616587+0000","last_deep_scrub":"27'70","last_deep_scrub_stamp":"2024-04-01T17:05:47.616587+0000","last_clean_scrub_stamp":"2024-04-01T17:05:47.616587+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:16:00.593595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.588760+0000","last_change":"2024-04-01T17:05:46.588760+0000","last_active":"2024-04-01T17:05:46.588760+0000","last_peered":"2024-04-01T17:05:46.588760+0000","last_clean":"2024-04-01T17:05:46.588760+0000","last_became_active":"2024-04-01T16:34:31.567482+0000","last_became_peered":"2024-04-01T16:34:31.567482+0000","last_unstale":"2024-04-01T17:05:46.588760+0000","last_undegraded":"2024-04-01T17:05:46.588760+0000","last_fullsized":"2024-04-01T17:05:46.588760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-01T17:05:46.588609+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-01T17:05:46.588609+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.588609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:58:02.409218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'48","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.150163+0000","last_change":"2024-04-01T17:05:41.150163+0000","last_active":"2024-04-01T17:05:41.150163+0000","last_peered":"2024-04-01T17:05:41.150163+0000","last_clean":"2024-04-01T17:05:41.150163+0000","last_became_active":"2024-04-01T16:34:34.067949+0000","last_became_peered":"2024-04-01T16:34:34.067949+0000","last_unstale":"2024-04-01T17:05:41.150163+0000","last_undegraded":"2024-04-01T17:05:41.150163+0000","last_fullsized":"2024-04-01T17:05:41.150163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-01T17:05:41.149974+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-01T17:05:41.149974+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.149974+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:45:12.015247+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":5672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"27'310","reported_seq":357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.620536+0000","last_change":"2024-04-01T17:05:41.620536+0000","last_active":"2024-04-01T17:05:41.620536+0000","last_peered":"2024-04-01T17:05:41.620536+0000","last_clean":"2024-04-01T17:05:41.620536+0000","last_became_active":"2024-04-01T16:34:31.561832+0000","last_became_peered":"2024-04-01T16:34:31.561832+0000","last_unstale":"2024-04-01T17:05:41.620536+0000","last_undegraded":"2024-04-01T17:05:41.620536+0000","last_fullsized":"2024-04-01T17:05:41.620536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'310","last_scrub_stamp":"2024-04-01T17:05:41.620340+0000","last_deep_scrub":"27'310","last_deep_scrub_stamp":"2024-04-01T17:05:41.620340+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.620340+0000","objects_scrubbed":2,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:42:04.013060+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'53","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.390611+0000","last_change":"2024-04-01T17:05:42.390774+0000","last_active":"2024-04-01T17:05:42.390611+0000","last_peered":"2024-04-01T17:05:42.390611+0000","last_clean":"2024-04-01T17:05:42.390611+0000","last_became_active":"2024-04-01T16:34:33.915864+0000","last_became_peered":"2024-04-01T16:34:33.915864+0000","last_unstale":"2024-04-01T17:05:42.390611+0000","last_undegraded":"2024-04-01T17:05:42.390611+0000","last_fullsized":"2024-04-01T17:05:42.390611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-04-01T17:05:42.390360+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-04-01T17:05:42.390360+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.390360+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:54:08.699195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":3009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"27'801","reported_seq":848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.051144+0000","last_change":"2024-04-01T17:05:44.051205+0000","last_active":"2024-04-01T17:05:44.051144+0000","last_peered":"2024-04-01T17:05:44.051144+0000","last_clean":"2024-04-01T17:05:44.051144+0000","last_became_active":"2024-04-01T16:34:31.530854+0000","last_became_peered":"2024-04-01T16:34:31.530854+0000","last_unstale":"2024-04-01T17:05:44.051144+0000","last_undegraded":"2024-04-01T17:05:44.051144+0000","last_fullsized":"2024-04-01T17:05:44.051144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'801","last_scrub_stamp":"2024-04-01T17:05:44.051021+0000","last_deep_scrub":"27'801","last_deep_scrub_stamp":"2024-04-01T17:05:44.051021+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.051021+0000","objects_scrubbed":4,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:02:10.812409+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'42","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:06:00.725821+0000","last_change":"2024-04-01T17:06:00.725821+0000","last_active":"2024-04-01T17:06:00.725821+0000","last_peered":"2024-04-01T17:06:00.725821+0000","last_clean":"2024-04-01T17:06:00.725821+0000","last_became_active":"2024-04-01T16:34:34.085115+0000","last_became_peered":"2024-04-01T16:34:34.085115+0000","last_unstale":"2024-04-01T17:06:00.725821+0000","last_undegraded":"2024-04-01T17:06:00.725821+0000","last_fullsized":"2024-04-01T17:06:00.725821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-01T17:06:00.725562+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-01T17:06:00.725562+0000","last_clean_scrub_stamp":"2024-04-01T17:06:00.725562+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:25:42.001493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:36.092993+0000","last_change":"2024-04-01T17:05:36.093056+0000","last_active":"2024-04-01T17:05:36.092993+0000","last_peered":"2024-04-01T17:05:36.092993+0000","last_clean":"2024-04-01T17:05:36.092993+0000","last_became_active":"2024-04-01T16:34:31.443468+0000","last_became_peered":"2024-04-01T16:34:31.443468+0000","last_unstale":"2024-04-01T17:05:36.092993+0000","last_undegraded":"2024-04-01T17:05:36.092993+0000","last_fullsized":"2024-04-01T17:05:36.092993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-01T17:05:36.092790+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-01T17:05:36.092790+0000","last_clean_scrub_stamp":"2024-04-01T17:05:36.092790+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:15:24.776059+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'50","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.150126+0000","last_change":"2024-04-01T17:05:42.150147+0000","last_active":"2024-04-01T17:05:42.150126+0000","last_peered":"2024-04-01T17:05:42.150126+0000","last_clean":"2024-04-01T17:05:42.150126+0000","last_became_active":"2024-04-01T16:34:34.070805+0000","last_became_peered":"2024-04-01T16:34:34.070805+0000","last_unstale":"2024-04-01T17:05:42.150126+0000","last_undegraded":"2024-04-01T17:05:42.150126+0000","last_fullsized":"2024-04-01T17:05:42.150126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-01T17:05:42.150042+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-01T17:05:42.150042+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.150042+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:55:48.004894+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.639883+0000","last_change":"2024-04-01T17:05:42.639945+0000","last_active":"2024-04-01T17:05:42.639883+0000","last_peered":"2024-04-01T17:05:42.639883+0000","last_clean":"2024-04-01T17:05:42.639883+0000","last_became_active":"2024-04-01T16:34:31.565793+0000","last_became_peered":"2024-04-01T16:34:31.565793+0000","last_unstale":"2024-04-01T17:05:42.639883+0000","last_undegraded":"2024-04-01T17:05:42.639883+0000","last_fullsized":"2024-04-01T17:05:42.639883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-01T17:05:42.639651+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-01T17:05:42.639651+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.639651+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:55:48.494503+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'72","reported_seq":115,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.802073+0000","last_change":"2024-04-01T17:05:45.802178+0000","last_active":"2024-04-01T17:05:45.802073+0000","last_peered":"2024-04-01T17:05:45.802073+0000","last_clean":"2024-04-01T17:05:45.802073+0000","last_became_active":"2024-04-01T16:34:33.929548+0000","last_became_peered":"2024-04-01T16:34:33.929548+0000","last_unstale":"2024-04-01T17:05:45.802073+0000","last_undegraded":"2024-04-01T17:05:45.802073+0000","last_fullsized":"2024-04-01T17:05:45.802073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'72","last_scrub_stamp":"2024-04-01T17:05:45.801852+0000","last_deep_scrub":"27'72","last_deep_scrub_stamp":"2024-04-01T17:05:45.801852+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.801852+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:42:38.532431+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":8452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.025331+0000","last_change":"2024-04-01T17:05:46.025389+0000","last_active":"2024-04-01T17:05:46.025331+0000","last_peered":"2024-04-01T17:05:46.025331+0000","last_clean":"2024-04-01T17:05:46.025331+0000","last_became_active":"2024-04-01T16:34:31.532940+0000","last_became_peered":"2024-04-01T16:34:31.532940+0000","last_unstale":"2024-04-01T17:05:46.025331+0000","last_undegraded":"2024-04-01T17:05:46.025331+0000","last_fullsized":"2024-04-01T17:05:46.025331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:46.025173+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:46.025173+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.025173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:26:28.224771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'37","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:52.161844+0000","last_change":"2024-04-01T17:05:52.161902+0000","last_active":"2024-04-01T17:05:52.161844+0000","last_peered":"2024-04-01T17:05:52.161844+0000","last_clean":"2024-04-01T17:05:52.161844+0000","last_became_active":"2024-04-01T16:34:34.067672+0000","last_became_peered":"2024-04-01T16:34:34.067672+0000","last_unstale":"2024-04-01T17:05:52.161844+0000","last_undegraded":"2024-04-01T17:05:52.161844+0000","last_fullsized":"2024-04-01T17:05:52.161844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-04-01T17:05:52.161642+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-04-01T17:05:52.161642+0000","last_clean_scrub_stamp":"2024-04-01T17:05:52.161642+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:24:28.435952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.219567+0000","last_change":"2024-04-01T17:05:40.219633+0000","last_active":"2024-04-01T17:05:40.219567+0000","last_peered":"2024-04-01T17:05:40.219567+0000","last_clean":"2024-04-01T17:05:40.219567+0000","last_became_active":"2024-04-01T16:34:31.514384+0000","last_became_peered":"2024-04-01T16:34:31.514384+0000","last_unstale":"2024-04-01T17:05:40.219567+0000","last_undegraded":"2024-04-01T17:05:40.219567+0000","last_fullsized":"2024-04-01T17:05:40.219567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-01T17:05:40.219401+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-01T17:05:40.219401+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.219401+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:04:46.211962+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:53.682329+0000","last_change":"2024-04-01T17:05:53.682385+0000","last_active":"2024-04-01T17:05:53.682329+0000","last_peered":"2024-04-01T17:05:53.682329+0000","last_clean":"2024-04-01T17:05:53.682329+0000","last_became_active":"2024-04-01T16:34:33.925542+0000","last_became_peered":"2024-04-01T16:34:33.925542+0000","last_unstale":"2024-04-01T17:05:53.682329+0000","last_undegraded":"2024-04-01T17:05:53.682329+0000","last_fullsized":"2024-04-01T17:05:53.682329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-04-01T17:05:53.682094+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-04-01T17:05:53.682094+0000","last_clean_scrub_stamp":"2024-04-01T17:05:53.682094+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:33:31.807910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.355160+0000","last_change":"2024-04-01T17:05:40.355160+0000","last_active":"2024-04-01T17:05:40.355160+0000","last_peered":"2024-04-01T17:05:40.355160+0000","last_clean":"2024-04-01T17:05:40.355160+0000","last_became_active":"2024-04-01T16:34:31.439724+0000","last_became_peered":"2024-04-01T16:34:31.439724+0000","last_unstale":"2024-04-01T17:05:40.355160+0000","last_undegraded":"2024-04-01T17:05:40.355160+0000","last_fullsized":"2024-04-01T17:05:40.355160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T17:05:40.355024+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T17:05:40.355024+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.355024+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:02:14.569947+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'29","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:54.709303+0000","last_change":"2024-04-01T17:05:54.709303+0000","last_active":"2024-04-01T17:05:54.709303+0000","last_peered":"2024-04-01T17:05:54.709303+0000","last_clean":"2024-04-01T17:05:54.709303+0000","last_became_active":"2024-04-01T16:34:33.929638+0000","last_became_peered":"2024-04-01T16:34:33.929638+0000","last_unstale":"2024-04-01T17:05:54.709303+0000","last_undegraded":"2024-04-01T17:05:54.709303+0000","last_fullsized":"2024-04-01T17:05:54.709303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-04-01T17:05:54.709064+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-04-01T17:05:54.709064+0000","last_clean_scrub_stamp":"2024-04-01T17:05:54.709064+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:17:48.698308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:39.217329+0000","last_change":"2024-04-01T17:05:39.217329+0000","last_active":"2024-04-01T17:05:39.217329+0000","last_peered":"2024-04-01T17:05:39.217329+0000","last_clean":"2024-04-01T17:05:39.217329+0000","last_became_active":"2024-04-01T16:34:31.511792+0000","last_became_peered":"2024-04-01T16:34:31.511792+0000","last_unstale":"2024-04-01T17:05:39.217329+0000","last_undegraded":"2024-04-01T17:05:39.217329+0000","last_fullsized":"2024-04-01T17:05:39.217329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:39.217203+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:39.217203+0000","last_clean_scrub_stamp":"2024-04-01T17:05:39.217203+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:26:19.798332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'39","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.849728+0000","last_change":"2024-04-01T17:05:44.849728+0000","last_active":"2024-04-01T17:05:44.849728+0000","last_peered":"2024-04-01T17:05:44.849728+0000","last_clean":"2024-04-01T17:05:44.849728+0000","last_became_active":"2024-04-01T16:34:33.929360+0000","last_became_peered":"2024-04-01T16:34:33.929360+0000","last_unstale":"2024-04-01T17:05:44.849728+0000","last_undegraded":"2024-04-01T17:05:44.849728+0000","last_fullsized":"2024-04-01T17:05:44.849728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-01T17:05:44.849307+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-01T17:05:44.849307+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.849307+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:43:06.604397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:37.543363+0000","last_change":"2024-04-01T17:05:37.543363+0000","last_active":"2024-04-01T17:05:37.543363+0000","last_peered":"2024-04-01T17:05:37.543363+0000","last_clean":"2024-04-01T17:05:37.543363+0000","last_became_active":"2024-04-01T16:34:31.508421+0000","last_became_peered":"2024-04-01T16:34:31.508421+0000","last_unstale":"2024-04-01T17:05:37.543363+0000","last_undegraded":"2024-04-01T17:05:37.543363+0000","last_fullsized":"2024-04-01T17:05:37.543363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T17:05:37.543210+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T17:05:37.543210+0000","last_clean_scrub_stamp":"2024-04-01T17:05:37.543210+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:40:53.015304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'50","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:55.729800+0000","last_change":"2024-04-01T17:05:55.729800+0000","last_active":"2024-04-01T17:05:55.729800+0000","last_peered":"2024-04-01T17:05:55.729800+0000","last_clean":"2024-04-01T17:05:55.729800+0000","last_became_active":"2024-04-01T16:34:34.084011+0000","last_became_peered":"2024-04-01T16:34:34.084011+0000","last_unstale":"2024-04-01T17:05:55.729800+0000","last_undegraded":"2024-04-01T17:05:55.729800+0000","last_fullsized":"2024-04-01T17:05:55.729800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-01T17:05:55.729445+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-01T17:05:55.729445+0000","last_clean_scrub_stamp":"2024-04-01T17:05:55.729445+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:01:32.596110+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"27'1","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:41.211856+0000","last_change":"2024-04-01T17:05:41.211856+0000","last_active":"2024-04-01T17:05:41.211856+0000","last_peered":"2024-04-01T17:05:41.211856+0000","last_clean":"2024-04-01T17:05:41.211856+0000","last_became_active":"2024-04-01T16:34:31.562023+0000","last_became_peered":"2024-04-01T16:34:31.562023+0000","last_unstale":"2024-04-01T17:05:41.211856+0000","last_undegraded":"2024-04-01T17:05:41.211856+0000","last_fullsized":"2024-04-01T17:05:41.211856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-01T17:05:41.211442+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-01T17:05:41.211442+0000","last_clean_scrub_stamp":"2024-04-01T17:05:41.211442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:54:59.880820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'41","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:57.697627+0000","last_change":"2024-04-01T17:05:57.697627+0000","last_active":"2024-04-01T17:05:57.697627+0000","last_peered":"2024-04-01T17:05:57.697627+0000","last_clean":"2024-04-01T17:05:57.697627+0000","last_became_active":"2024-04-01T16:34:34.038817+0000","last_became_peered":"2024-04-01T16:34:34.038817+0000","last_unstale":"2024-04-01T17:05:57.697627+0000","last_undegraded":"2024-04-01T17:05:57.697627+0000","last_fullsized":"2024-04-01T17:05:57.697627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-01T17:05:57.697336+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-01T17:05:57.697336+0000","last_clean_scrub_stamp":"2024-04-01T17:05:57.697336+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:49.613034+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":4631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":207,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:46.804329+0000","last_change":"2024-04-01T17:05:46.804329+0000","last_active":"2024-04-01T17:05:46.804329+0000","last_peered":"2024-04-01T17:05:46.804329+0000","last_clean":"2024-04-01T17:05:46.804329+0000","last_became_active":"2024-04-01T16:34:08.193234+0000","last_became_peered":"2024-04-01T16:34:08.193234+0000","last_unstale":"2024-04-01T17:05:46.804329+0000","last_undegraded":"2024-04-01T17:05:46.804329+0000","last_fullsized":"2024-04-01T17:05:46.804329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-01T17:05:46.804170+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-01T17:05:46.804170+0000","last_clean_scrub_stamp":"2024-04-01T17:05:46.804170+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:58:02.624779+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.558964+0000","last_change":"2024-04-01T17:05:45.559025+0000","last_active":"2024-04-01T17:05:45.558964+0000","last_peered":"2024-04-01T17:05:45.558964+0000","last_clean":"2024-04-01T17:05:45.558964+0000","last_became_active":"2024-04-01T16:34:31.567797+0000","last_became_peered":"2024-04-01T16:34:31.567797+0000","last_unstale":"2024-04-01T17:05:45.558964+0000","last_undegraded":"2024-04-01T17:05:45.558964+0000","last_fullsized":"2024-04-01T17:05:45.558964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T17:05:45.558774+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T17:05:45.558774+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.558774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:59:47.966523+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'39","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.044283+0000","last_change":"2024-04-01T17:05:45.044283+0000","last_active":"2024-04-01T17:05:45.044283+0000","last_peered":"2024-04-01T17:05:45.044283+0000","last_clean":"2024-04-01T17:05:45.044283+0000","last_became_active":"2024-04-01T16:34:34.086959+0000","last_became_peered":"2024-04-01T16:34:34.086959+0000","last_unstale":"2024-04-01T17:05:45.044283+0000","last_undegraded":"2024-04-01T17:05:45.044283+0000","last_fullsized":"2024-04-01T17:05:45.044283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-01T17:05:45.043943+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-01T17:05:45.043943+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.043943+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:41:38.976396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":2353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:50.748033+0000","last_change":"2024-04-01T17:05:50.748071+0000","last_active":"2024-04-01T17:05:50.748033+0000","last_peered":"2024-04-01T17:05:50.748033+0000","last_clean":"2024-04-01T17:05:50.748033+0000","last_became_active":"2024-04-01T16:34:31.508727+0000","last_became_peered":"2024-04-01T16:34:31.508727+0000","last_unstale":"2024-04-01T17:05:50.748033+0000","last_undegraded":"2024-04-01T17:05:50.748033+0000","last_fullsized":"2024-04-01T17:05:50.748033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:50.747922+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:50.747922+0000","last_clean_scrub_stamp":"2024-04-01T17:05:50.747922+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:35.452997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'25","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:39.092125+0000","last_change":"2024-04-01T17:05:39.092125+0000","last_active":"2024-04-01T17:05:39.092125+0000","last_peered":"2024-04-01T17:05:39.092125+0000","last_clean":"2024-04-01T17:05:39.092125+0000","last_became_active":"2024-04-01T16:34:34.067858+0000","last_became_peered":"2024-04-01T16:34:34.067858+0000","last_unstale":"2024-04-01T17:05:39.092125+0000","last_undegraded":"2024-04-01T17:05:39.092125+0000","last_fullsized":"2024-04-01T17:05:39.092125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-01T17:05:39.091867+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-01T17:05:39.091867+0000","last_clean_scrub_stamp":"2024-04-01T17:05:39.091867+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:56:52.638072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"27'432","reported_seq":900,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:38.239306+0000","last_change":"2024-04-01T17:05:38.239306+0000","last_active":"2024-04-01T17:05:38.239306+0000","last_peered":"2024-04-01T17:05:38.239306+0000","last_clean":"2024-04-01T17:05:38.239306+0000","last_became_active":"2024-04-01T16:34:31.511494+0000","last_became_peered":"2024-04-01T16:34:31.511494+0000","last_unstale":"2024-04-01T17:05:38.239306+0000","last_undegraded":"2024-04-01T17:05:38.239306+0000","last_fullsized":"2024-04-01T17:05:38.239306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'432","last_scrub_stamp":"2024-04-01T17:05:38.239062+0000","last_deep_scrub":"27'432","last_deep_scrub_stamp":"2024-04-01T17:05:38.239062+0000","last_clean_scrub_stamp":"2024-04-01T17:05:38.239062+0000","objects_scrubbed":1,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:54:04.547897+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110595,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":419,"num_read_kb":454,"num_write":427,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'53","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.589112+0000","last_change":"2024-04-01T17:05:44.589168+0000","last_active":"2024-04-01T17:05:44.589112+0000","last_peered":"2024-04-01T17:05:44.589112+0000","last_clean":"2024-04-01T17:05:44.589112+0000","last_became_active":"2024-04-01T16:34:34.082875+0000","last_became_peered":"2024-04-01T16:34:34.082875+0000","last_unstale":"2024-04-01T17:05:44.589112+0000","last_undegraded":"2024-04-01T17:05:44.589112+0000","last_fullsized":"2024-04-01T17:05:44.589112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-04-01T17:05:44.588931+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-04-01T17:05:44.588931+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.588931+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:24:15.599579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"27'4","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.571234+0000","last_change":"2024-04-01T17:05:44.571234+0000","last_active":"2024-04-01T17:05:44.571234+0000","last_peered":"2024-04-01T17:05:44.571234+0000","last_clean":"2024-04-01T17:05:44.571234+0000","last_became_active":"2024-04-01T16:34:31.568247+0000","last_became_peered":"2024-04-01T16:34:31.568247+0000","last_unstale":"2024-04-01T17:05:44.571234+0000","last_undegraded":"2024-04-01T17:05:44.571234+0000","last_fullsized":"2024-04-01T17:05:44.571234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:44.570968+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:44.570968+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.570968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:39:35.337619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'26","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.417686+0000","last_change":"2024-04-01T17:05:44.417686+0000","last_active":"2024-04-01T17:05:44.417686+0000","last_peered":"2024-04-01T17:05:44.417686+0000","last_clean":"2024-04-01T17:05:44.417686+0000","last_became_active":"2024-04-01T16:34:34.062943+0000","last_became_peered":"2024-04-01T16:34:34.062943+0000","last_unstale":"2024-04-01T17:05:44.417686+0000","last_undegraded":"2024-04-01T17:05:44.417686+0000","last_fullsized":"2024-04-01T17:05:44.417686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-04-01T17:05:44.417418+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-04-01T17:05:44.417418+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.417418+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:55:03.086795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":2569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'4","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:38.538148+0000","last_change":"2024-04-01T17:05:38.538148+0000","last_active":"2024-04-01T17:05:38.538148+0000","last_peered":"2024-04-01T17:05:38.538148+0000","last_clean":"2024-04-01T17:05:38.538148+0000","last_became_active":"2024-04-01T16:34:31.511921+0000","last_became_peered":"2024-04-01T16:34:31.511921+0000","last_unstale":"2024-04-01T17:05:38.538148+0000","last_undegraded":"2024-04-01T17:05:38.538148+0000","last_fullsized":"2024-04-01T17:05:38.538148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:38.537869+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:38.537869+0000","last_clean_scrub_stamp":"2024-04-01T17:05:38.537869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:02:05.299257+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'34","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.325680+0000","last_change":"2024-04-01T17:05:44.325680+0000","last_active":"2024-04-01T17:05:44.325680+0000","last_peered":"2024-04-01T17:05:44.325680+0000","last_clean":"2024-04-01T17:05:44.325680+0000","last_became_active":"2024-04-01T16:34:54.509976+0000","last_became_peered":"2024-04-01T16:34:54.509976+0000","last_unstale":"2024-04-01T17:05:44.325680+0000","last_undegraded":"2024-04-01T17:05:44.325680+0000","last_fullsized":"2024-04-01T17:05:44.325680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T17:05:44.325410+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T17:05:44.325410+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.325410+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:23:58.469296+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:48.784420+0000","last_change":"2024-04-01T17:05:48.784420+0000","last_active":"2024-04-01T17:05:48.784420+0000","last_peered":"2024-04-01T17:05:48.784420+0000","last_clean":"2024-04-01T17:05:48.784420+0000","last_became_active":"2024-04-01T16:34:31.426015+0000","last_became_peered":"2024-04-01T16:34:31.426015+0000","last_unstale":"2024-04-01T17:05:48.784420+0000","last_undegraded":"2024-04-01T17:05:48.784420+0000","last_fullsized":"2024-04-01T17:05:48.784420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T17:05:48.784259+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T17:05:48.784259+0000","last_clean_scrub_stamp":"2024-04-01T17:05:48.784259+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:37:00.725861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'40","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.610103+0000","last_change":"2024-04-01T17:05:45.610103+0000","last_active":"2024-04-01T17:05:45.610103+0000","last_peered":"2024-04-01T17:05:45.610103+0000","last_clean":"2024-04-01T17:05:45.610103+0000","last_became_active":"2024-04-01T16:34:34.087178+0000","last_became_peered":"2024-04-01T16:34:34.087178+0000","last_unstale":"2024-04-01T17:05:45.610103+0000","last_undegraded":"2024-04-01T17:05:45.610103+0000","last_fullsized":"2024-04-01T17:05:45.610103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-01T17:05:45.609839+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-01T17:05:45.609839+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.609839+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:41:39.542291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":1657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"27'1149","reported_seq":1197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.590920+0000","last_change":"2024-04-01T17:05:40.590944+0000","last_active":"2024-04-01T17:05:40.590920+0000","last_peered":"2024-04-01T17:05:40.590920+0000","last_clean":"2024-04-01T17:05:40.590920+0000","last_became_active":"2024-04-01T16:34:31.527813+0000","last_became_peered":"2024-04-01T16:34:31.527813+0000","last_unstale":"2024-04-01T17:05:40.590920+0000","last_undegraded":"2024-04-01T17:05:40.590920+0000","last_fullsized":"2024-04-01T17:05:40.590920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1149","last_scrub_stamp":"2024-04-01T17:05:40.590838+0000","last_deep_scrub":"27'1149","last_deep_scrub_stamp":"2024-04-01T17:05:40.590838+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.590838+0000","objects_scrubbed":1,"log_size":1149,"log_dups_size":0,"ondisk_log_size":1149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:45:57.078147+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2752,"num_write_kb":935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'33","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:42.050523+0000","last_change":"2024-04-01T17:05:42.050558+0000","last_active":"2024-04-01T17:05:42.050523+0000","last_peered":"2024-04-01T17:05:42.050523+0000","last_clean":"2024-04-01T17:05:42.050523+0000","last_became_active":"2024-04-01T16:34:34.085435+0000","last_became_peered":"2024-04-01T16:34:34.085435+0000","last_unstale":"2024-04-01T17:05:42.050523+0000","last_undegraded":"2024-04-01T17:05:42.050523+0000","last_fullsized":"2024-04-01T17:05:42.050523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-04-01T17:05:42.050400+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-04-01T17:05:42.050400+0000","last_clean_scrub_stamp":"2024-04-01T17:05:42.050400+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:05:41.261198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.992821+0000","last_change":"2024-04-01T17:05:44.992887+0000","last_active":"2024-04-01T17:05:44.992821+0000","last_peered":"2024-04-01T17:05:44.992821+0000","last_clean":"2024-04-01T17:05:44.992821+0000","last_became_active":"2024-04-01T16:34:31.533308+0000","last_became_peered":"2024-04-01T16:34:31.533308+0000","last_unstale":"2024-04-01T17:05:44.992821+0000","last_undegraded":"2024-04-01T17:05:44.992821+0000","last_fullsized":"2024-04-01T17:05:44.992821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-01T17:05:44.992607+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-01T17:05:44.992607+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.992607+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:16:53.174742+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'56","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.156834+0000","last_change":"2024-04-01T17:05:44.156862+0000","last_active":"2024-04-01T17:05:44.156834+0000","last_peered":"2024-04-01T17:05:44.156834+0000","last_clean":"2024-04-01T17:05:44.156834+0000","last_became_active":"2024-04-01T16:34:34.072477+0000","last_became_peered":"2024-04-01T16:34:34.072477+0000","last_unstale":"2024-04-01T17:05:44.156834+0000","last_undegraded":"2024-04-01T17:05:44.156834+0000","last_fullsized":"2024-04-01T17:05:44.156834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'56","last_scrub_stamp":"2024-04-01T17:05:44.156719+0000","last_deep_scrub":"27'56","last_deep_scrub_stamp":"2024-04-01T17:05:44.156719+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.156719+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:39:34.923371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":6288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:47.813061+0000","last_change":"2024-04-01T17:05:47.813102+0000","last_active":"2024-04-01T17:05:47.813061+0000","last_peered":"2024-04-01T17:05:47.813061+0000","last_clean":"2024-04-01T17:05:47.813061+0000","last_became_active":"2024-04-01T16:34:31.422981+0000","last_became_peered":"2024-04-01T16:34:31.422981+0000","last_unstale":"2024-04-01T17:05:47.813061+0000","last_undegraded":"2024-04-01T17:05:47.813061+0000","last_fullsized":"2024-04-01T17:05:47.813061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-01T17:05:47.812910+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-01T17:05:47.812910+0000","last_clean_scrub_stamp":"2024-04-01T17:05:47.812910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:16:00.789918+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'38","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.433897+0000","last_change":"2024-04-01T17:05:45.433936+0000","last_active":"2024-04-01T17:05:45.433897+0000","last_peered":"2024-04-01T17:05:45.433897+0000","last_clean":"2024-04-01T17:05:45.433897+0000","last_became_active":"2024-04-01T16:34:34.084546+0000","last_became_peered":"2024-04-01T16:34:34.084546+0000","last_unstale":"2024-04-01T17:05:45.433897+0000","last_undegraded":"2024-04-01T17:05:45.433897+0000","last_fullsized":"2024-04-01T17:05:45.433897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-04-01T17:05:45.433794+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-04-01T17:05:45.433794+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.433794+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:14:16.118091+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:36.507430+0000","last_change":"2024-04-01T17:05:36.507464+0000","last_active":"2024-04-01T17:05:36.507430+0000","last_peered":"2024-04-01T17:05:36.507430+0000","last_clean":"2024-04-01T17:05:36.507430+0000","last_became_active":"2024-04-01T16:34:31.508557+0000","last_became_peered":"2024-04-01T16:34:31.508557+0000","last_unstale":"2024-04-01T17:05:36.507430+0000","last_undegraded":"2024-04-01T17:05:36.507430+0000","last_fullsized":"2024-04-01T17:05:36.507430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T17:05:36.507322+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T17:05:36.507322+0000","last_clean_scrub_stamp":"2024-04-01T17:05:36.507322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:43:12.680568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'43","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:50.965908+0000","last_change":"2024-04-01T17:05:50.965971+0000","last_active":"2024-04-01T17:05:50.965908+0000","last_peered":"2024-04-01T17:05:50.965908+0000","last_clean":"2024-04-01T17:05:50.965908+0000","last_became_active":"2024-04-01T16:34:34.091661+0000","last_became_peered":"2024-04-01T16:34:34.091661+0000","last_unstale":"2024-04-01T17:05:50.965908+0000","last_undegraded":"2024-04-01T17:05:50.965908+0000","last_fullsized":"2024-04-01T17:05:50.965908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-01T17:05:50.965695+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-01T17:05:50.965695+0000","last_clean_scrub_stamp":"2024-04-01T17:05:50.965695+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:04:41.792139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:39.578374+0000","last_change":"2024-04-01T17:05:39.578429+0000","last_active":"2024-04-01T17:05:39.578374+0000","last_peered":"2024-04-01T17:05:39.578374+0000","last_clean":"2024-04-01T17:05:39.578374+0000","last_became_active":"2024-04-01T16:34:31.516852+0000","last_became_peered":"2024-04-01T16:34:31.516852+0000","last_unstale":"2024-04-01T17:05:39.578374+0000","last_undegraded":"2024-04-01T17:05:39.578374+0000","last_fullsized":"2024-04-01T17:05:39.578374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-01T17:05:39.578178+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-01T17:05:39.578178+0000","last_clean_scrub_stamp":"2024-04-01T17:05:39.578178+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T22:16:47.760313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'58","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:48.565297+0000","last_change":"2024-04-01T17:05:48.565365+0000","last_active":"2024-04-01T17:05:48.565297+0000","last_peered":"2024-04-01T17:05:48.565297+0000","last_clean":"2024-04-01T17:05:48.565297+0000","last_became_active":"2024-04-01T16:34:55.003987+0000","last_became_peered":"2024-04-01T16:34:55.003987+0000","last_unstale":"2024-04-01T17:05:48.565297+0000","last_undegraded":"2024-04-01T17:05:48.565297+0000","last_fullsized":"2024-04-01T17:05:48.565297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-01T17:05:48.565102+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-01T17:05:48.565102+0000","last_clean_scrub_stamp":"2024-04-01T17:05:48.565102+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:37:39.099929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"27'624","reported_seq":672,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:49.819576+0000","last_change":"2024-04-01T17:05:49.819576+0000","last_active":"2024-04-01T17:05:49.819576+0000","last_peered":"2024-04-01T17:05:49.819576+0000","last_clean":"2024-04-01T17:05:49.819576+0000","last_became_active":"2024-04-01T16:34:31.443655+0000","last_became_peered":"2024-04-01T16:34:31.443655+0000","last_unstale":"2024-04-01T17:05:49.819576+0000","last_undegraded":"2024-04-01T17:05:49.819576+0000","last_fullsized":"2024-04-01T17:05:49.819576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'624","last_scrub_stamp":"2024-04-01T17:05:49.819409+0000","last_deep_scrub":"27'624","last_deep_scrub_stamp":"2024-04-01T17:05:49.819409+0000","last_clean_scrub_stamp":"2024-04-01T17:05:49.819409+0000","objects_scrubbed":2,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:08:03.790368+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'50","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:49.135935+0000","last_change":"2024-04-01T17:05:49.135997+0000","last_active":"2024-04-01T17:05:49.135935+0000","last_peered":"2024-04-01T17:05:49.135935+0000","last_clean":"2024-04-01T17:05:49.135935+0000","last_became_active":"2024-04-01T16:34:34.033736+0000","last_became_peered":"2024-04-01T16:34:34.033736+0000","last_unstale":"2024-04-01T17:05:49.135935+0000","last_undegraded":"2024-04-01T17:05:49.135935+0000","last_fullsized":"2024-04-01T17:05:49.135935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-01T17:05:49.135731+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-01T17:05:49.135731+0000","last_clean_scrub_stamp":"2024-04-01T17:05:49.135731+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:00:40.401431+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"27'54","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:45.309795+0000","last_change":"2024-04-01T17:05:45.309859+0000","last_active":"2024-04-01T17:05:45.309795+0000","last_peered":"2024-04-01T17:05:45.309795+0000","last_clean":"2024-04-01T17:05:45.309795+0000","last_became_active":"2024-04-01T16:34:55.011400+0000","last_became_peered":"2024-04-01T16:34:55.011400+0000","last_unstale":"2024-04-01T17:05:45.309795+0000","last_undegraded":"2024-04-01T17:05:45.309795+0000","last_fullsized":"2024-04-01T17:05:45.309795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-04-01T17:05:45.309567+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-04-01T17:05:45.309567+0000","last_clean_scrub_stamp":"2024-04-01T17:05:45.309567+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:48:54.828805+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":3157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:52.712774+0000","last_change":"2024-04-01T17:05:52.712814+0000","last_active":"2024-04-01T17:05:52.712774+0000","last_peered":"2024-04-01T17:05:52.712774+0000","last_clean":"2024-04-01T17:05:52.712774+0000","last_became_active":"2024-04-01T16:34:31.562051+0000","last_became_peered":"2024-04-01T16:34:31.562051+0000","last_unstale":"2024-04-01T17:05:52.712774+0000","last_undegraded":"2024-04-01T17:05:52.712774+0000","last_fullsized":"2024-04-01T17:05:52.712774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-01T17:05:52.712684+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-01T17:05:52.712684+0000","last_clean_scrub_stamp":"2024-04-01T17:05:52.712684+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:10:36.539002+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'35","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:50.644402+0000","last_change":"2024-04-01T17:05:50.644466+0000","last_active":"2024-04-01T17:05:50.644402+0000","last_peered":"2024-04-01T17:05:50.644402+0000","last_clean":"2024-04-01T17:05:50.644402+0000","last_became_active":"2024-04-01T16:34:34.034609+0000","last_became_peered":"2024-04-01T16:34:34.034609+0000","last_unstale":"2024-04-01T17:05:50.644402+0000","last_undegraded":"2024-04-01T17:05:50.644402+0000","last_fullsized":"2024-04-01T17:05:50.644402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-01T17:05:50.644212+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-01T17:05:50.644212+0000","last_clean_scrub_stamp":"2024-04-01T17:05:50.644212+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:06:35.349287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"27'11","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:51.742822+0000","last_change":"2024-04-01T17:05:51.742888+0000","last_active":"2024-04-01T17:05:51.742822+0000","last_peered":"2024-04-01T17:05:51.742822+0000","last_clean":"2024-04-01T17:05:51.742822+0000","last_became_active":"2024-04-01T16:34:31.529498+0000","last_became_peered":"2024-04-01T16:34:31.529498+0000","last_unstale":"2024-04-01T17:05:51.742822+0000","last_undegraded":"2024-04-01T17:05:51.742822+0000","last_fullsized":"2024-04-01T17:05:51.742822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-01T17:05:51.742622+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-01T17:05:51.742622+0000","last_clean_scrub_stamp":"2024-04-01T17:05:51.742622+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:57:49.993902+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"27'50","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:38.055147+0000","last_change":"2024-04-01T17:05:38.055147+0000","last_active":"2024-04-01T17:05:38.055147+0000","last_peered":"2024-04-01T17:05:38.055147+0000","last_clean":"2024-04-01T17:05:38.055147+0000","last_became_active":"2024-04-01T16:34:34.064033+0000","last_became_peered":"2024-04-01T16:34:34.064033+0000","last_unstale":"2024-04-01T17:05:38.055147+0000","last_undegraded":"2024-04-01T17:05:38.055147+0000","last_fullsized":"2024-04-01T17:05:38.055147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-01T17:05:38.055022+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-01T17:05:38.055022+0000","last_clean_scrub_stamp":"2024-04-01T17:05:38.055022+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:33:14.299302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":6181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"27'145","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:40.029202+0000","last_change":"2024-04-01T17:05:40.029324+0000","last_active":"2024-04-01T17:05:40.029202+0000","last_peered":"2024-04-01T17:05:40.029202+0000","last_clean":"2024-04-01T17:05:40.029202+0000","last_became_active":"2024-04-01T16:34:31.489829+0000","last_became_peered":"2024-04-01T16:34:31.489829+0000","last_unstale":"2024-04-01T17:05:40.029202+0000","last_undegraded":"2024-04-01T17:05:40.029202+0000","last_fullsized":"2024-04-01T17:05:40.029202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'145","last_scrub_stamp":"2024-04-01T17:05:40.028905+0000","last_deep_scrub":"27'145","last_deep_scrub_stamp":"2024-04-01T17:05:40.028905+0000","last_clean_scrub_stamp":"2024-04-01T17:05:40.028905+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T21:45:56.516215+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507300,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:44.065794+0000","last_change":"2024-04-01T17:05:44.065854+0000","last_active":"2024-04-01T17:05:44.065794+0000","last_peered":"2024-04-01T17:05:44.065794+0000","last_clean":"2024-04-01T17:05:44.065794+0000","last_became_active":"2024-04-01T16:34:34.086798+0000","last_became_peered":"2024-04-01T16:34:34.086798+0000","last_unstale":"2024-04-01T17:05:44.065794+0000","last_undegraded":"2024-04-01T17:05:44.065794+0000","last_fullsized":"2024-04-01T17:05:44.065794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-01T17:05:44.065591+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-01T17:05:44.065591+0000","last_clean_scrub_stamp":"2024-04-01T17:05:44.065591+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T19:24:15.076239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'624","reported_seq":673,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T17:05:35.131515+0000","last_change":"2024-04-01T17:05:35.131515+0000","last_active":"2024-04-01T17:05:35.131515+0000","last_peered":"2024-04-01T17:05:35.131515+0000","last_clean":"2024-04-01T17:05:35.131515+0000","last_became_active":"2024-04-01T16:34:31.420104+0000","last_became_peered":"2024-04-01T16:34:31.420104+0000","last_unstale":"2024-04-01T17:05:35.131515+0000","last_undegraded":"2024-04-01T17:05:35.131515+0000","last_fullsized":"2024-04-01T17:05:35.131515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'624","last_scrub_stamp":"2024-04-01T17:05:35.131096+0000","last_deep_scrub":"27'624","last_deep_scrub_stamp":"2024-04-01T17:05:35.131096+0000","last_clean_scrub_stamp":"2024-04-01T17:05:35.131096+0000","objects_scrubbed":3,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:23:24.577710+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2204,"num_write_kb":251439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2871,"ondisk_log_size":2871,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22590885,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":419,"num_read_kb":454,"num_write":6618,"num_write_kb":25341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45244416,"data_stored":45181770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5146,"ondisk_log_size":5146,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509831,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52644,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319196,"statfs":{"total":96636764160,"available":96582856704,"internally_reserved":0,"allocated":13463552,"data_stored":13280752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509833,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":397312,"data_stored":217485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509829,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41772,"kb_used_data":6436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330068,"statfs":{"total":96636764160,"available":96593989632,"internally_reserved":0,"allocated":6590464,"data_stored":6399500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509830,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":106980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509831,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43816,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328024,"statfs":{"total":96636764160,"available":96591896576,"internally_reserved":0,"allocated":8683520,"data_stored":8495624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542536,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47972,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323868,"statfs":{"total":96636764160,"available":96587640832,"internally_reserved":0,"allocated":8679424,"data_stored":8496170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542534,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49556,"kb_used_data":10060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322284,"statfs":{"total":96636764160,"available":96586018816,"internally_reserved":0,"allocated":10301440,"data_stored":10114065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542537,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35620,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336220,"statfs":{"total":96636764160,"available":96600289280,"internally_reserved":0,"allocated":290816,"data_stored":107050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5713920,"data_stored":5702242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":110595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10018816,"data_stored":10007175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8389280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T17:06:26.645 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-01T17:06:26.883 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.883+0000 7f7dd5a00640 1 Processor -- start 2024-04-01T17:06:26.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.884+0000 7f7dd5a00640 1 -- start start 2024-04-01T17:06:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.885+0000 7f7dd5a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7dd0154a60 0x7f7dd0071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.885+0000 7f7dd5a00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f7dd0072aa0 0x7f7dd006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.885+0000 7f7dd5a00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd0072570 con 0x7f7dd00c6d50 2024-04-01T17:06:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.885+0000 7f7dd5a00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd00c2080 con 0x7f7dd0072aa0 2024-04-01T17:06:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.885+0000 7f7dd5a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd00c2360 con 0x7f7dd0154a60 2024-04-01T17:06:26.886 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.886+0000 7f7dc6000640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f7dd00c6d50 0x7f7dd0073210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:52292/0 (socket says 172.21.15.163:52292) 2024-04-01T17:06:26.886 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.886+0000 7f7dc6000640 1 -- 172.21.15.163:0/3791262857 learned_addr learned my addr 172.21.15.163:0/3791262857 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:06:26.886 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.887+0000 7f7dcea00640 1 --2- 172.21.15.163:0/3791262857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7dd0154a60 0x7f7dd0071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:26.886 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.887+0000 7f7dcf400640 1 --2- 172.21.15.163:0/3791262857 >> v2:172.21.15.189:3300/0 conn(0x7f7dd0072aa0 0x7f7dd006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:26.889 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.889+0000 7f7dce000640 1 -- 172.21.15.163:0/3791262857 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299663701 0 0) 0x7f7dd0072570 con 0x7f7dd00c6d50 2024-04-01T17:06:26.889 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.889+0000 7f7dce000640 1 -- 172.21.15.163:0/3791262857 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7db4003520 con 0x7f7dd00c6d50 2024-04-01T17:06:26.890 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.891+0000 7f7dcea00640 1 -- 172.21.15.163:0/3791262857 >> v2:172.21.15.189:3300/0 conn(0x7f7dd0072aa0 msgr2=0x7f7dd006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:26.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.891+0000 7f7dcea00640 1 --2- 172.21.15.163:0/3791262857 >> v2:172.21.15.189:3300/0 conn(0x7f7dd0072aa0 0x7f7dd006dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.891+0000 7f7dcea00640 1 -- 172.21.15.163:0/3791262857 >> v1:172.21.15.163:6789/0 conn(0x7f7dd00c6d50 legacy=0x7f7dd0073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:26.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.891+0000 7f7dcea00640 1 -- 172.21.15.163:0/3791262857 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd00c2640 con 0x7f7dd0154a60 2024-04-01T17:06:26.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.896+0000 7f7dcea00640 1 --2- 172.21.15.163:0/3791262857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7dd0154a60 0x7f7dd0071ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00097a0 tx=0x7f7dc002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5430e15e5975ddc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:26.902 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.903+0000 7f7dce000640 1 -- 172.21.15.163:0/3791262857 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0034070 con 0x7f7dd0154a60 2024-04-01T17:06:26.902 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.903+0000 7f7dce000640 1 -- 172.21.15.163:0/3791262857 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc0030800 con 0x7f7dd0154a60 2024-04-01T17:06:26.902 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.903+0000 7f7dce000640 1 -- 172.21.15.163:0/3791262857 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0030bd0 con 0x7f7dd0154a60 2024-04-01T17:06:26.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.903+0000 7f7dd5a00640 1 -- 172.21.15.163:0/3791262857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7dd0154a60 msgr2=0x7f7dd0071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:26.903 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.903+0000 7f7dd5a00640 1 --2- 172.21.15.163:0/3791262857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7dd0154a60 0x7f7dd0071ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00097a0 tx=0x7f7dc002b940 comp rx=0 tx=0).stop 2024-04-01T17:06:26.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.904+0000 7f7dd5a00640 1 -- 172.21.15.163:0/3791262857 shutdown_connections 2024-04-01T17:06:26.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.904+0000 7f7dd5a00640 1 --2- 172.21.15.163:0/3791262857 >> v2:172.21.15.189:3300/0 conn(0x7f7dd0072aa0 0x7f7dd006dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.904+0000 7f7dd5a00640 1 --2- 172.21.15.163:0/3791262857 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7dd0154a60 0x7f7dd0071ee0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.904+0000 7f7dd5a00640 1 -- 172.21.15.163:0/3791262857 >> 172.21.15.163:0/3791262857 conn(0x7f7dd00cbe20 msgr2=0x7f7dd00cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:26.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.904+0000 7f7dd5a00640 1 -- 172.21.15.163:0/3791262857 shutdown_connections 2024-04-01T17:06:26.904 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.904+0000 7f7dd5a00640 1 -- 172.21.15.163:0/3791262857 wait complete. 2024-04-01T17:06:26.905 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.906+0000 7f7dd5a00640 1 Processor -- start 2024-04-01T17:06:26.905 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.906+0000 7f7dd5a00640 1 -- start start 2024-04-01T17:06:26.907 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.907+0000 7f7dd5a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd0072aa0 0x7f7dd014fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:26.907 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.907+0000 7f7dd5a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dd00c6d50 0x7f7dd0145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:26.907 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.907+0000 7f7dd5a00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7dd0154a60 0x7f7dd01464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:26.907 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.907+0000 7f7dd5a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd0073920 con 0x7f7dd0072aa0 2024-04-01T17:06:26.907 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.907+0000 7f7dd5a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd00c1d80 con 0x7f7dd00c6d50 2024-04-01T17:06:26.907 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.907+0000 7f7dd5a00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd0073aa0 con 0x7f7dd0154a60 2024-04-01T17:06:26.908 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.908+0000 7f7dcea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd0072aa0 0x7f7dd014fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:26.908 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.909+0000 7f7dcea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd0072aa0 0x7f7dd014fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55688/0 (socket says 172.21.15.163:55688) 2024-04-01T17:06:26.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.909+0000 7f7dcea00640 1 -- 172.21.15.163:0/4154666500 learned_addr learned my addr 172.21.15.163:0/4154666500 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:06:26.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.909+0000 7f7dc6000640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dd00c6d50 0x7f7dd0145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:26.909 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.909+0000 7f7dcf400640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7dd0154a60 0x7f7dd01464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:26.914 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.915+0000 7f7dcea00640 1 -- 172.21.15.163:0/4154666500 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7dd0154a60 msgr2=0x7f7dd01464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:26.914 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.915+0000 7f7dcea00640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7dd0154a60 0x7f7dd01464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.914 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.915+0000 7f7dcea00640 1 -- 172.21.15.163:0/4154666500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dd00c6d50 msgr2=0x7f7dd0145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:26.914 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.915+0000 7f7dcea00640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dd00c6d50 0x7f7dd0145f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:26.915 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.915+0000 7f7dcea00640 1 -- 172.21.15.163:0/4154666500 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd0150290 con 0x7f7dd0072aa0 2024-04-01T17:06:26.918 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.919+0000 7f7dcea00640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd0072aa0 0x7f7dd014fd50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00098c0 tx=0x7f7dc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:26.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.924+0000 7f7dc7400640 1 -- 172.21.15.163:0/4154666500 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0034040 con 0x7f7dd0072aa0 2024-04-01T17:06:26.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.925+0000 7f7dc7400640 1 -- 172.21.15.163:0/4154666500 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc003ad20 con 0x7f7dd0072aa0 2024-04-01T17:06:26.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.925+0000 7f7dc7400640 1 -- 172.21.15.163:0/4154666500 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0044630 con 0x7f7dd0072aa0 2024-04-01T17:06:26.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.925+0000 7f7dd5a00640 1 -- 172.21.15.163:0/4154666500 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd0158df0 con 0x7f7dd0072aa0 2024-04-01T17:06:26.924 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.925+0000 7f7dd5a00640 1 -- 172.21.15.163:0/4154666500 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd0159090 con 0x7f7dd0072aa0 2024-04-01T17:06:26.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.926+0000 7f7dd5a00640 1 -- 172.21.15.163:0/4154666500 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd00756d0 con 0x7f7dd0072aa0 2024-04-01T17:06:26.948 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.949+0000 7f7dc7400640 1 -- 172.21.15.163:0/4154666500 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7dc0037070 con 0x7f7dd0072aa0 2024-04-01T17:06:26.949 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.950+0000 7f7dc7400640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f7dac06c940 0x7f7dac06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:26.949 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.950+0000 7f7dc6000640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f7dac06c940 0x7f7dac06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:26.950 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.951+0000 7f7dc6000640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f7dac06c940 0x7f7dac06ee00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00b1b90 tx=0x7f7db8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:26.952 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:26.953+0000 7f7dc7400640 1 -- 172.21.15.163:0/4154666500 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f7dc007a3d0 con 0x7f7dd0072aa0 2024-04-01T17:06:27.278 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.279+0000 7f7dc7400640 1 -- 172.21.15.163:0/4154666500 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7dc003f070 con 0x7f7dd0072aa0 2024-04-01T17:06:27.494 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.494+0000 7f7dd5a00640 1 -- 172.21.15.163:0/4154666500 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f7dd0152500 con 0x7f7dd0072aa0 2024-04-01T17:06:27.685 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.685+0000 7f7dc7400640 1 -- 172.21.15.163:0/4154666500 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f7dc007c330 con 0x7f7dd0072aa0 2024-04-01T17:06:27.685 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.685+0000 7f7dc7400640 1 -- 172.21.15.163:0/4154666500 <== mon.0 v2:172.21.15.163:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7dc0030800 con 0x7f7dd0072aa0 2024-04-01T17:06:27.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.689+0000 7f7dd5a00640 1 -- 172.21.15.163:0/4154666500 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f7dac06c940 msgr2=0x7f7dac06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:27.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.689+0000 7f7dd5a00640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f7dac06c940 0x7f7dac06ee00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00b1b90 tx=0x7f7db8009040 comp rx=0 tx=0).stop 2024-04-01T17:06:27.689 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.689+0000 7f7dd5a00640 1 -- 172.21.15.163:0/4154666500 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd0072aa0 msgr2=0x7f7dd014fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:27.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.689+0000 7f7dd5a00640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd0072aa0 0x7f7dd014fd50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00098c0 tx=0x7f7dc00046c0 comp rx=0 tx=0).stop 2024-04-01T17:06:27.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.689+0000 7f7dd5a00640 1 -- 172.21.15.163:0/4154666500 shutdown_connections 2024-04-01T17:06:27.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.689+0000 7f7dd5a00640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f7dac06c940 0x7f7dac06ee00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:27.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.689+0000 7f7dd5a00640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f7dd0154a60 0x7f7dd01464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:27.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.689+0000 7f7dd5a00640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7dd00c6d50 0x7f7dd0145f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:27.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.689+0000 7f7dd5a00640 1 --2- 172.21.15.163:0/4154666500 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd0072aa0 0x7f7dd014fd50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:27.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.689+0000 7f7dd5a00640 1 -- 172.21.15.163:0/4154666500 >> 172.21.15.163:0/4154666500 conn(0x7f7dd00cbe20 msgr2=0x7f7dd014a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:27.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.690+0000 7f7dd5a00640 1 -- 172.21.15.163:0/4154666500 shutdown_connections 2024-04-01T17:06:27.690 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.690+0000 7f7dd5a00640 1 -- 172.21.15.163:0/4154666500 wait complete. 2024-04-01T17:06:27.712 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-01T17:06:27.712 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T17:06:27.920 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.921+0000 7f8548c00640 1 Processor -- start 2024-04-01T17:06:27.921 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.921+0000 7f8548c00640 1 -- start start 2024-04-01T17:06:27.922 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.922+0000 7f8548c00640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7f8544152830 0x7f8544072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:27.922 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.922+0000 7f8548c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85440737f0 con 0x7f85440c6b30 2024-04-01T17:06:27.922 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.922+0000 7f8548c00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85440c72d0 con 0x7f854415c160 2024-04-01T17:06:27.922 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.922+0000 7f8548c00640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7f8544152c10 con 0x7f8544152830 2024-04-01T17:06:27.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.923+0000 7f8539400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f85440c6b30 0x7f854415ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:52308/0 (socket says 172.21.15.163:52308) 2024-04-01T17:06:27.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.923+0000 7f8539400640 1 -- 172.21.15.163:0/4205765479 learned_addr learned my addr 172.21.15.163:0/4205765479 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:06:27.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.923+0000 7f8541e00640 1 --2- 172.21.15.163:0/4205765479 >> v2:172.21.15.189:3300/0 conn(0x7f8544152830 0x7f8544072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:27.925 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.926+0000 7f8541400640 1 -- 172.21.15.163:0/4205765479 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3658677250 0 0) 0x7f85440737f0 con 0x7f85440c6b30 2024-04-01T17:06:27.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.926+0000 7f8541400640 1 -- 172.21.15.163:0/4205765479 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8528003520 con 0x7f85440c6b30 2024-04-01T17:06:27.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.927+0000 7f8541e00640 1 -- 172.21.15.163:0/4205765479 >> v1:172.21.15.189:6789/0 conn(0x7f854415c160 legacy=0x7f8544162de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:27.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.927+0000 7f8541e00640 1 -- 172.21.15.163:0/4205765479 >> v1:172.21.15.163:6789/0 conn(0x7f85440c6b30 legacy=0x7f854415ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:27.926 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.927+0000 7f8541e00640 1 -- 172.21.15.163:0/4205765479 --> v2:172.21.15.189:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85440c75b0 con 0x7f8544152830 2024-04-01T17:06:27.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.930+0000 7f8541e00640 1 --2- 172.21.15.163:0/4205765479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8544152830 0x7f8544072900 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f85340097a0 tx=0x7f853402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=311a244d9222dc91 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:27.940 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.940+0000 7f8541400640 1 -- 172.21.15.163:0/4205765479 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534035020 con 0x7f8544152830 2024-04-01T17:06:27.940 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.940+0000 7f8541400640 1 -- 172.21.15.163:0/4205765479 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8534031830 con 0x7f8544152830 2024-04-01T17:06:27.940 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.940+0000 7f8541400640 1 -- 172.21.15.163:0/4205765479 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534031c20 con 0x7f8544152830 2024-04-01T17:06:27.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.941+0000 7f8548c00640 1 -- 172.21.15.163:0/4205765479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8544152830 msgr2=0x7f8544072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:27.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.941+0000 7f8548c00640 1 --2- 172.21.15.163:0/4205765479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8544152830 0x7f8544072900 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f85340097a0 tx=0x7f853402b8d0 comp rx=0 tx=0).stop 2024-04-01T17:06:27.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.941+0000 7f8548c00640 1 -- 172.21.15.163:0/4205765479 shutdown_connections 2024-04-01T17:06:27.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.941+0000 7f8548c00640 1 --2- 172.21.15.163:0/4205765479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8544152830 0x7f8544072900 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:27.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.941+0000 7f8548c00640 1 -- 172.21.15.163:0/4205765479 >> 172.21.15.163:0/4205765479 conn(0x7f85440cbe20 msgr2=0x7f85440cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:27.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.941+0000 7f8548c00640 1 -- 172.21.15.163:0/4205765479 shutdown_connections 2024-04-01T17:06:27.941 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.941+0000 7f8548c00640 1 -- 172.21.15.163:0/4205765479 wait complete. 2024-04-01T17:06:27.942 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.943+0000 7f8548c00640 1 Processor -- start 2024-04-01T17:06:27.943 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.943+0000 7f8548c00640 1 -- start start 2024-04-01T17:06:27.943 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.944+0000 7f8548c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85440c6b30 0x7f85441ec230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:27.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.944+0000 7f8548c00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8544152830 0x7f85440c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:27.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.944+0000 7f8548c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85440c2060 0x7f8544150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:27.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.944+0000 7f8548c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8544073a90 con 0x7f85440c6b30 2024-04-01T17:06:27.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.944+0000 7f8548c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f85440c7b70 con 0x7f85440c2060 2024-04-01T17:06:27.944 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.944+0000 7f8548c00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f85440707f0 con 0x7f8544152830 2024-04-01T17:06:27.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.945+0000 7f8542800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85440c2060 0x7f8544150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:27.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.945+0000 7f8541e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85440c6b30 0x7f85441ec230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:27.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.945+0000 7f8539400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8544152830 0x7f85440c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:27.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.945+0000 7f8542800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85440c2060 0x7f8544150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:51062/0 (socket says 172.21.15.163:51062) 2024-04-01T17:06:27.945 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.945+0000 7f8542800640 1 -- 172.21.15.163:0/3847647910 learned_addr learned my addr 172.21.15.163:0/3847647910 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:06:27.949 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.950+0000 7f8541e00640 1 -- 172.21.15.163:0/3847647910 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8544152830 msgr2=0x7f85440c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:27.949 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.950+0000 7f8541e00640 1 --2- 172.21.15.163:0/3847647910 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8544152830 0x7f85440c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:27.949 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.950+0000 7f8541e00640 1 -- 172.21.15.163:0/3847647910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85440c2060 msgr2=0x7f8544150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:27.949 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.950+0000 7f8541e00640 1 --2- 172.21.15.163:0/3847647910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85440c2060 0x7f8544150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:27.949 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.950+0000 7f8541e00640 1 -- 172.21.15.163:0/3847647910 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854415be90 con 0x7f85440c6b30 2024-04-01T17:06:27.952 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.953+0000 7f8541e00640 1 --2- 172.21.15.163:0/3847647910 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85440c6b30 0x7f85441ec230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f85440739c0 tx=0x7f85340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:27.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.958+0000 7f853aa00640 1 -- 172.21.15.163:0/3847647910 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534041070 con 0x7f85440c6b30 2024-04-01T17:06:27.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.958+0000 7f853aa00640 1 -- 172.21.15.163:0/3847647910 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f853403a990 con 0x7f85440c6b30 2024-04-01T17:06:27.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.958+0000 7f853aa00640 1 -- 172.21.15.163:0/3847647910 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534035040 con 0x7f85440c6b30 2024-04-01T17:06:27.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.958+0000 7f8548c00640 1 -- 172.21.15.163:0/3847647910 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85440c8e40 con 0x7f85440c6b30 2024-04-01T17:06:27.958 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.958+0000 7f8548c00640 1 -- 172.21.15.163:0/3847647910 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85440c9400 con 0x7f85440c6b30 2024-04-01T17:06:27.958 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:27.959+0000 7f8548c00640 1 -- 172.21.15.163:0/3847647910 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8544150490 con 0x7f85440c6b30 2024-04-01T17:06:28.267 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.268+0000 7f853aa00640 1 -- 172.21.15.163:0/3847647910 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f853404c060 con 0x7f85440c6b30 2024-04-01T17:06:28.270 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.270+0000 7f853aa00640 1 --2- 172.21.15.163:0/3847647910 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f852006c970 0x7f852006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:28.270 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.271+0000 7f8539400640 1 --2- 172.21.15.163:0/3847647910 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f852006c970 0x7f852006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:28.272 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.272+0000 7f8539400640 1 --2- 172.21.15.163:0/3847647910 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f852006c970 0x7f852006ee30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8544152220 tx=0x7f852c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:28.302 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.303+0000 7f853aa00640 1 -- 172.21.15.163:0/3847647910 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f85340317c0 con 0x7f85440c6b30 2024-04-01T17:06:28.303 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.304+0000 7f853aa00640 1 -- 172.21.15.163:0/3847647910 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f853407b520 con 0x7f85440c6b30 2024-04-01T17:06:28.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.561+0000 7f8548c00640 1 -- 172.21.15.163:0/3847647910 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85440756d0 con 0x7f85440c6b30 2024-04-01T17:06:28.588 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.588+0000 7f853aa00640 1 -- 172.21.15.163:0/3847647910 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6839 (secure 0 0 0) 0x7f853407f820 con 0x7f85440c6b30 2024-04-01T17:06:28.588 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T17:06:28.589 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/220229466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":220229466},{"type":"v1","addr":"172.21.15.189:6834","nonce":220229466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/1149566111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1149566111},{"type":"v1","addr":"172.21.15.163:6839","nonce":1149566111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2556471418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2556471418},{"type":"v1","addr":"172.21.15.163:6835","nonce":2556471418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1010688449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1010688449},{"type":"v1","addr":"172.21.15.163:6837","nonce":1010688449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1685366427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1685366427},{"type":"v1","addr":"172.21.15.189:6837","nonce":1685366427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T16:34:34.157633+0000","modified":"2024-04-01T16:34:41.924119+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.189:6835/2672478403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2672478403},{"type":"v1","addr":"172.21.15.189:6835","nonce":2672478403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-04-01T17:06:28.589 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 8 2024-04-01T17:06:28.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.591+0000 7f8548c00640 1 -- 172.21.15.163:0/3847647910 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f852006c970 msgr2=0x7f852006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:28.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.591+0000 7f8548c00640 1 --2- 172.21.15.163:0/3847647910 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f852006c970 0x7f852006ee30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8544152220 tx=0x7f852c009040 comp rx=0 tx=0).stop 2024-04-01T17:06:28.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.591+0000 7f8548c00640 1 -- 172.21.15.163:0/3847647910 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85440c6b30 msgr2=0x7f85441ec230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:28.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.591+0000 7f8548c00640 1 --2- 172.21.15.163:0/3847647910 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85440c6b30 0x7f85441ec230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f85440739c0 tx=0x7f85340046c0 comp rx=0 tx=0).stop 2024-04-01T17:06:28.591 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.591+0000 7f8548c00640 1 -- 172.21.15.163:0/3847647910 shutdown_connections 2024-04-01T17:06:28.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.591+0000 7f8548c00640 1 --2- 172.21.15.163:0/3847647910 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f852006c970 0x7f852006ee30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:28.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.591+0000 7f8548c00640 1 --2- 172.21.15.163:0/3847647910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85440c2060 0x7f8544150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:28.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.591+0000 7f8548c00640 1 --2- 172.21.15.163:0/3847647910 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f8544152830 0x7f85440c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:28.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.591+0000 7f8548c00640 1 --2- 172.21.15.163:0/3847647910 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85440c6b30 0x7f85441ec230 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:28.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.591+0000 7f8548c00640 1 -- 172.21.15.163:0/3847647910 >> 172.21.15.163:0/3847647910 conn(0x7f85440cbe20 msgr2=0x7f85441488c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:28.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.591+0000 7f8548c00640 1 -- 172.21.15.163:0/3847647910 shutdown_connections 2024-04-01T17:06:28.592 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.592+0000 7f8548c00640 1 -- 172.21.15.163:0/3847647910 wait complete. 2024-04-01T17:06:28.610 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T17:06:28.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.811+0000 7f2c6d000640 1 Processor -- start 2024-04-01T17:06:28.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.811+0000 7f2c6d000640 1 -- start start 2024-04-01T17:06:28.813 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.813+0000 7f2c6d000640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2c68152830 0x7f2c68072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:28.813 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.814+0000 7f2c6d000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c6815c160 0x7f2c68072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:28.813 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.814+0000 7f2c6d000640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c680737f0 con 0x7f2c680c6b30 2024-04-01T17:06:28.813 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.814+0000 7f2c6d000640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f2c68152c10 con 0x7f2c68152830 2024-04-01T17:06:28.813 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.814+0000 7f2c6d000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2c680c72d0 con 0x7f2c6815c160 2024-04-01T17:06:28.814 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.815+0000 7f2c5d400640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f2c680c6b30 0x7f2c6815ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:57630/0 (socket says 172.21.15.163:57630) 2024-04-01T17:06:28.815 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.815+0000 7f2c5d400640 1 -- 172.21.15.163:0/2143565569 learned_addr learned my addr 172.21.15.163:0/2143565569 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:06:28.815 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.816+0000 7f2c66800640 1 --2- 172.21.15.163:0/2143565569 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c6815c160 0x7f2c68072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:28.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.816+0000 7f2c65e00640 1 --2- 172.21.15.163:0/2143565569 >> v2:172.21.15.163:3300/0 conn(0x7f2c68152830 0x7f2c68072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:28.820 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.820+0000 7f2c66800640 1 -- 172.21.15.163:0/2143565569 >> v2:172.21.15.163:3300/0 conn(0x7f2c68152830 msgr2=0x7f2c68072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:28.820 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.820+0000 7f2c66800640 1 --2- 172.21.15.163:0/2143565569 >> v2:172.21.15.163:3300/0 conn(0x7f2c68152830 0x7f2c68072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:28.820 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.820+0000 7f2c66800640 1 -- 172.21.15.163:0/2143565569 >> v1:172.21.15.189:6789/0 conn(0x7f2c680c6b30 legacy=0x7f2c6815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:28.820 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.820+0000 7f2c66800640 1 -- 172.21.15.163:0/2143565569 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c680c75b0 con 0x7f2c6815c160 2024-04-01T17:06:28.820 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.820+0000 7f2c65e00640 1 --2- 172.21.15.163:0/2143565569 >> v2:172.21.15.163:3300/0 conn(0x7f2c68152830 0x7f2c68072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T17:06:28.825 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.826+0000 7f2c66800640 1 --2- 172.21.15.163:0/2143565569 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c6815c160 0x7f2c68072e40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009d90 tx=0x7f2c6002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93a992f1f538b2f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:28.841 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.842+0000 7f2c65400640 1 -- 172.21.15.163:0/2143565569 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60039070 con 0x7f2c6815c160 2024-04-01T17:06:28.841 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.842+0000 7f2c65400640 1 -- 172.21.15.163:0/2143565569 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2c6002cc50 con 0x7f2c6815c160 2024-04-01T17:06:28.841 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.842+0000 7f2c65400640 1 -- 172.21.15.163:0/2143565569 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60034440 con 0x7f2c6815c160 2024-04-01T17:06:28.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.843+0000 7f2c6d000640 1 -- 172.21.15.163:0/2143565569 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c6815c160 msgr2=0x7f2c68072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:28.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.843+0000 7f2c6d000640 1 --2- 172.21.15.163:0/2143565569 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c6815c160 0x7f2c68072e40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009d90 tx=0x7f2c6002bea0 comp rx=0 tx=0).stop 2024-04-01T17:06:28.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.843+0000 7f2c6d000640 1 -- 172.21.15.163:0/2143565569 shutdown_connections 2024-04-01T17:06:28.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.843+0000 7f2c6d000640 1 --2- 172.21.15.163:0/2143565569 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c6815c160 0x7f2c68072e40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:28.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.843+0000 7f2c6d000640 1 --2- 172.21.15.163:0/2143565569 >> v2:172.21.15.163:3300/0 conn(0x7f2c68152830 0x7f2c68072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:28.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.843+0000 7f2c6d000640 1 -- 172.21.15.163:0/2143565569 >> 172.21.15.163:0/2143565569 conn(0x7f2c680cbe20 msgr2=0x7f2c680cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:28.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.843+0000 7f2c6d000640 1 -- 172.21.15.163:0/2143565569 shutdown_connections 2024-04-01T17:06:28.843 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.843+0000 7f2c6d000640 1 -- 172.21.15.163:0/2143565569 wait complete. 2024-04-01T17:06:28.845 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.846+0000 7f2c6d000640 1 Processor -- start 2024-04-01T17:06:28.845 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.846+0000 7f2c6d000640 1 -- start start 2024-04-01T17:06:28.847 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.847+0000 7f2c6d000640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c680c6b30 0x7f2c681597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:28.847 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.847+0000 7f2c6d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c68152830 0x7f2c6815b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:28.847 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.847+0000 7f2c6d000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2c6814d910 0x7f2c6814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:28.847 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.847+0000 7f2c6d000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2c68073a90 con 0x7f2c6814d910 2024-04-01T17:06:28.847 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.847+0000 7f2c6d000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2c680c7b70 con 0x7f2c68152830 2024-04-01T17:06:28.847 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.847+0000 7f2c6d000640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f2c680707f0 con 0x7f2c680c6b30 2024-04-01T17:06:28.848 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.849+0000 7f2c5d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c68152830 0x7f2c6815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:28.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.849+0000 7f2c65e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c680c6b30 0x7f2c681597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:28.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.850+0000 7f2c5d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c68152830 0x7f2c6815b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.163:51068/0 (socket says 172.21.15.163:51068) 2024-04-01T17:06:28.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.850+0000 7f2c5d400640 1 -- 172.21.15.163:0/1931047543 learned_addr learned my addr 172.21.15.163:0/1931047543 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:06:28.855 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.855+0000 7f2c66800640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2c6814d910 0x7f2c6814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:28.860 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.860+0000 7f2c65e00640 1 -- 172.21.15.163:0/1931047543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c68152830 msgr2=0x7f2c6815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:28.860 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.860+0000 7f2c65e00640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c68152830 0x7f2c6815b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:28.860 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.860+0000 7f2c65e00640 1 -- 172.21.15.163:0/1931047543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2c6814d910 msgr2=0x7f2c6814ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:28.860 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.860+0000 7f2c65e00640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2c6814d910 0x7f2c6814ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:28.860 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.861+0000 7f2c65e00640 1 -- 172.21.15.163:0/1931047543 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c680c27f0 con 0x7f2c680c6b30 2024-04-01T17:06:28.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.871+0000 7f2c65e00640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c680c6b30 0x7f2c681597a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800e7e0 tx=0x7f2c5800eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:28.979 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.979+0000 7f2c5ea00640 1 -- 172.21.15.163:0/1931047543 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5800f040 con 0x7f2c680c6b30 2024-04-01T17:06:28.979 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.979+0000 7f2c5ea00640 1 -- 172.21.15.163:0/1931047543 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2c58004030 con 0x7f2c680c6b30 2024-04-01T17:06:28.979 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.979+0000 7f2c5ea00640 1 -- 172.21.15.163:0/1931047543 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58004440 con 0x7f2c680c6b30 2024-04-01T17:06:28.979 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.979+0000 7f2c6d000640 1 -- 172.21.15.163:0/1931047543 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c680cbb60 con 0x7f2c680c6b30 2024-04-01T17:06:28.979 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.979+0000 7f2c6d000640 1 -- 172.21.15.163:0/1931047543 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c681f05d0 con 0x7f2c680c6b30 2024-04-01T17:06:28.980 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:28.981+0000 7f2c6d000640 1 -- 172.21.15.163:0/1931047543 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6814b3c0 con 0x7f2c680c6b30 2024-04-01T17:06:29.314 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.314+0000 7f2c5ea00640 1 -- 172.21.15.163:0/1931047543 <== mon.2 v2:172.21.15.189:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c5800c670 con 0x7f2c680c6b30 2024-04-01T17:06:29.315 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.316+0000 7f2c5ea00640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2c4406c8f0 0x7f2c4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:29.316 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.317+0000 7f2c5d400640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2c4406c8f0 0x7f2c4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:29.318 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.319+0000 7f2c5d400640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2c4406c8f0 0x7f2c4406edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c6814ea60 tx=0x7f2c50007f10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:29.327 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.327+0000 7f2c5ea00640 1 -- 172.21.15.163:0/1931047543 <== mon.2 v2:172.21.15.189:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f2c58057c00 con 0x7f2c680c6b30 2024-04-01T17:06:29.359 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.359+0000 7f2c5ea00640 1 -- 172.21.15.163:0/1931047543 <== mon.2 v2:172.21.15.189:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2c6814b3c0 con 0x7f2c680c6b30 2024-04-01T17:06:29.621 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.622+0000 7f2c6d000640 1 -- 172.21.15.163:0/1931047543 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c680c54b0 con 0x7f2c680c6b30 2024-04-01T17:06:29.651 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.651+0000 7f2c5ea00640 1 -- 172.21.15.163:0/1931047543 <== mon.2 v2:172.21.15.189:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6839 (secure 0 0 0) 0x7f2c680c54b0 con 0x7f2c680c6b30 2024-04-01T17:06:29.652 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T17:06:29.652 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6834/220229466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":220229466},{"type":"v1","addr":"172.21.15.189:6834","nonce":220229466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/1149566111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1149566111},{"type":"v1","addr":"172.21.15.163:6839","nonce":1149566111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2556471418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2556471418},{"type":"v1","addr":"172.21.15.163:6835","nonce":2556471418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1010688449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1010688449},{"type":"v1","addr":"172.21.15.163:6837","nonce":1010688449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4256,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1685366427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1685366427},{"type":"v1","addr":"172.21.15.189:6837","nonce":1685366427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T16:34:34.157633+0000","modified":"2024-04-01T16:34:41.924119+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.189:6835/2672478403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6833","nonce":2672478403},{"type":"v1","addr":"172.21.15.189:6835","nonce":2672478403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4270,"qdb_cluster":[4270]},"id":1}]} 2024-04-01T17:06:29.652 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 8 2024-04-01T17:06:29.654 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.654+0000 7f2c6d000640 1 -- 172.21.15.163:0/1931047543 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2c4406c8f0 msgr2=0x7f2c4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:29.654 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.654+0000 7f2c6d000640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2c4406c8f0 0x7f2c4406edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c6814ea60 tx=0x7f2c50007f10 comp rx=0 tx=0).stop 2024-04-01T17:06:29.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.655+0000 7f2c6d000640 1 -- 172.21.15.163:0/1931047543 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c680c6b30 msgr2=0x7f2c681597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:29.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.655+0000 7f2c6d000640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c680c6b30 0x7f2c681597a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800e7e0 tx=0x7f2c5800eca0 comp rx=0 tx=0).stop 2024-04-01T17:06:29.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.655+0000 7f2c6d000640 1 -- 172.21.15.163:0/1931047543 shutdown_connections 2024-04-01T17:06:29.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.655+0000 7f2c6d000640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f2c4406c8f0 0x7f2c4406edb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:29.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.655+0000 7f2c6d000640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2c6814d910 0x7f2c6814ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:29.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.655+0000 7f2c6d000640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c68152830 0x7f2c6815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:29.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.655+0000 7f2c6d000640 1 --2- 172.21.15.163:0/1931047543 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f2c680c6b30 0x7f2c681597a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:29.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.655+0000 7f2c6d000640 1 -- 172.21.15.163:0/1931047543 >> 172.21.15.163:0/1931047543 conn(0x7f2c680cbe20 msgr2=0x7f2c680cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:29.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.655+0000 7f2c6d000640 1 -- 172.21.15.163:0/1931047543 shutdown_connections 2024-04-01T17:06:29.655 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.655+0000 7f2c6d000640 1 -- 172.21.15.163:0/1931047543 wait complete. 2024-04-01T17:06:29.675 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T17:06:29.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.888+0000 7f8393e00640 1 Processor -- start 2024-04-01T17:06:29.888 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.888+0000 7f8393e00640 1 -- start start 2024-04-01T17:06:29.889 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.890+0000 7f8393e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83940ca760 0x7f83940ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:29.889 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.890+0000 7f8393e00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83940cad10 con 0x7f839415bac0 2024-04-01T17:06:29.890 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.890+0000 7f8393e00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839406ca80 con 0x7f83940cc7f0 2024-04-01T17:06:29.890 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.890+0000 7f8393e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f839415d9c0 con 0x7f83940ca760 2024-04-01T17:06:29.890 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.891+0000 7f8392000640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f839415bac0 0x7f8394162ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:52310/0 (socket says 172.21.15.163:52310) 2024-04-01T17:06:29.890 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.891+0000 7f8392000640 1 -- 172.21.15.163:0/1417138938 learned_addr learned my addr 172.21.15.163:0/1417138938 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:06:29.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.892+0000 7f8393400640 1 --2- 172.21.15.163:0/1417138938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83940ca760 0x7f83940ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:29.893 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.894+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097802092 0 0) 0x7f83940cad10 con 0x7f839415bac0 2024-04-01T17:06:29.893 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.894+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8378003520 con 0x7f839415bac0 2024-04-01T17:06:29.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 823543138 0 0) 0x7f8378003520 con 0x7f839415bac0 2024-04-01T17:06:29.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83940ca760 msgr2=0x7f83940ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:29.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 --2- 172.21.15.163:0/1417138938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83940ca760 0x7f83940ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:29.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 >> v1:172.21.15.189:6789/0 conn(0x7f83940cc7f0 legacy=0x7f839406d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:29.898 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839406cd60 con 0x7f839415bac0 2024-04-01T17:06:29.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7f8380001670 con 0x7f839415bac0 2024-04-01T17:06:29.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 >> v1:172.21.15.163:6789/0 conn(0x7f839415bac0 legacy=0x7f8394162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:29.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 --2- 172.21.15.163:0/1417138938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83940ca760 0x7f83780039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:29.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 --2- 172.21.15.163:0/1417138938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8378003fb0 0x7f8378004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:29.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 --2- 172.21.15.163:0/1417138938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8378004d40 0x7f83780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:29.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f837800bb80 con 0x7f8378004d40 2024-04-01T17:06:29.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f837800bd30 con 0x7f8378003fb0 2024-04-01T17:06:29.899 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.898+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f837800bf30 con 0x7f83940ca760 2024-04-01T17:06:29.901 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.902+0000 7f8393400640 1 --2- 172.21.15.163:0/1417138938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8378004d40 0x7f83780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:29.905 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.905+0000 7f8393400640 1 -- 172.21.15.163:0/1417138938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83940ca760 msgr2=0x7f83780039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:29.905 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.905+0000 7f8393400640 1 --2- 172.21.15.163:0/1417138938 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83940ca760 0x7f83780039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:29.905 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.905+0000 7f8393400640 1 -- 172.21.15.163:0/1417138938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8378003fb0 msgr2=0x7f8378004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:29.905 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.905+0000 7f8393400640 1 --2- 172.21.15.163:0/1417138938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8378003fb0 0x7f8378004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:29.905 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.905+0000 7f8393400640 1 -- 172.21.15.163:0/1417138938 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8378003520 con 0x7f8378004d40 2024-04-01T17:06:29.907 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.908+0000 7f8393400640 1 --2- 172.21.15.163:0/1417138938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8378004d40 0x7f83780051c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f838c009fc0 tx=0x7f8378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23057d9ceede0bf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:29.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.912+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c039070 con 0x7f8378004d40 2024-04-01T17:06:29.911 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.912+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f838c02cc60 con 0x7f8378004d40 2024-04-01T17:06:29.912 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.912+0000 7f8391600640 1 -- 172.21.15.163:0/1417138938 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c009c10 con 0x7f8378004d40 2024-04-01T17:06:29.912 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.913+0000 7f8393e00640 1 -- 172.21.15.163:0/1417138938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8378004d40 msgr2=0x7f83780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:29.913 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.913+0000 7f8393e00640 1 --2- 172.21.15.163:0/1417138938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8378004d40 0x7f83780051c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f838c009fc0 tx=0x7f8378005830 comp rx=0 tx=0).stop 2024-04-01T17:06:29.913 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.913+0000 7f8393400640 1 -- 172.21.15.163:0/1417138938 reap_dead start 2024-04-01T17:06:29.913 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.913+0000 7f8393e00640 1 -- 172.21.15.163:0/1417138938 shutdown_connections 2024-04-01T17:06:29.913 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.913+0000 7f8393e00640 1 -- 172.21.15.163:0/1417138938 >> 172.21.15.163:0/1417138938 conn(0x7f83940b1910 msgr2=0x7f83940b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:29.913 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.913+0000 7f8393e00640 1 -- 172.21.15.163:0/1417138938 shutdown_connections 2024-04-01T17:06:29.913 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.913+0000 7f8393e00640 1 -- 172.21.15.163:0/1417138938 wait complete. 2024-04-01T17:06:29.915 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.915+0000 7f8393e00640 1 Processor -- start 2024-04-01T17:06:29.915 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.915+0000 7f8393e00640 1 -- start start 2024-04-01T17:06:29.916 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.916+0000 7f8393e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8378004d40 0x7f83941f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:29.916 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.916+0000 7f8393e00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83940c4d20 0x7f83940b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:29.916 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.916+0000 7f8393e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83940c3910 0x7f8394153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:29.916 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.916+0000 7f8393e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f839406d320 con 0x7f83940c3910 2024-04-01T17:06:29.916 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.916+0000 7f8393e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f83940caff0 con 0x7f8378004d40 2024-04-01T17:06:29.916 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.916+0000 7f8393e00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f839406e070 con 0x7f83940c4d20 2024-04-01T17:06:29.917 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.917+0000 7f8393400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83940c3910 0x7f8394153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:29.917 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.917+0000 7f8393400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83940c3910 0x7f8394153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55742/0 (socket says 172.21.15.163:55742) 2024-04-01T17:06:29.917 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.917+0000 7f8393400640 1 -- 172.21.15.163:0/711690195 learned_addr learned my addr 172.21.15.163:0/711690195 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:06:29.917 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.918+0000 7f8392a00640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8378004d40 0x7f83941f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:29.918 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.918+0000 7f8392000640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83940c4d20 0x7f83940b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:29.921 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.921+0000 7f8393400640 1 -- 172.21.15.163:0/711690195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83940c4d20 msgr2=0x7f83940b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:29.921 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.921+0000 7f8393400640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83940c4d20 0x7f83940b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:29.921 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.921+0000 7f8393400640 1 -- 172.21.15.163:0/711690195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8378004d40 msgr2=0x7f83941f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:29.921 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.921+0000 7f8393400640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8378004d40 0x7f83941f05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:29.921 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.921+0000 7f8393400640 1 -- 172.21.15.163:0/711690195 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83940c4210 con 0x7f83940c3910 2024-04-01T17:06:29.923 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.924+0000 7f8393400640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83940c3910 0x7f8394153050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f838c02c6d0 tx=0x7f838c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:29.928 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.928+0000 7f838aa00640 1 -- 172.21.15.163:0/711690195 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c039040 con 0x7f83940c3910 2024-04-01T17:06:29.928 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.929+0000 7f838aa00640 1 -- 172.21.15.163:0/711690195 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f838c02ca60 con 0x7f83940c3910 2024-04-01T17:06:29.928 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.929+0000 7f838aa00640 1 -- 172.21.15.163:0/711690195 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c003990 con 0x7f83940c3910 2024-04-01T17:06:29.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.929+0000 7f8393e00640 1 -- 172.21.15.163:0/711690195 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83940c44f0 con 0x7f83940c3910 2024-04-01T17:06:29.929 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.929+0000 7f8393e00640 1 -- 172.21.15.163:0/711690195 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83940b3700 con 0x7f83940c3910 2024-04-01T17:06:29.930 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.930+0000 7f8393e00640 1 -- 172.21.15.163:0/711690195 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83940756d0 con 0x7f83940c3910 2024-04-01T17:06:29.955 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.956+0000 7f838aa00640 1 -- 172.21.15.163:0/711690195 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f838c047030 con 0x7f83940c3910 2024-04-01T17:06:29.956 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.957+0000 7f838aa00640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f837406c940 0x7f837406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:29.957 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.957+0000 7f8392a00640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f837406c940 0x7f837406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:29.958 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:29.958+0000 7f8392a00640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f837406c940 0x7f837406ee00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83840017e0 tx=0x7f8384009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:30.252 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.252+0000 7f838aa00640 1 -- 172.21.15.163:0/711690195 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7f838c07a9e0 con 0x7f83940c3910 2024-04-01T17:06:30.252 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.253+0000 7f838aa00640 1 -- 172.21.15.163:0/711690195 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f838c04e020 con 0x7f83940c3910 2024-04-01T17:06:30.473 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.473+0000 7f8393e00640 1 -- 172.21.15.163:0/711690195 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83940af810 con 0x7f83940c3910 2024-04-01T17:06:30.563 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.563+0000 7f838aa00640 1 -- 172.21.15.163:0/711690195 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+16901 (secure 0 0 0) 0x7f838c07c940 con 0x7f83940c3910 2024-04-01T17:06:30.563 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-01T17:06:30.564 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":27,"fsid":"0870cdfa-3f81-4bb7-98e8-9588fec4cf05","created":"2024-04-01T16:33:41.754840+0000","modified":"2024-04-01T16:34:53.160271+0000","last_up_change":"2024-04-01T16:34:04.196541+0000","last_in_change":"2024-04-01T16:33:54.255861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T16:34:05.291874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T16:34:29.028272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T16:34:31.534879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fca53e4-23ef-42eb-9b59-43e6d0ec307e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6811","nonce":3625964404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6813","nonce":3625964404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6821","nonce":3625964404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":3625964404},{"type":"v1","addr":"172.21.15.163:6815","nonce":3625964404}]},"public_addr":"172.21.15.163:6811/3625964404","cluster_addr":"172.21.15.163:6813/3625964404","heartbeat_back_addr":"172.21.15.163:6821/3625964404","heartbeat_front_addr":"172.21.15.163:6815/3625964404","state":["exists","up"]},{"osd":1,"uuid":"60336f20-a3e0-44c9-a468-83dbaedb2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6817","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6820","nonce":1379211103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6823","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6824","nonce":1379211103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6829","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6831","nonce":1379211103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":1379211103},{"type":"v1","addr":"172.21.15.163:6827","nonce":1379211103}]},"public_addr":"172.21.15.163:6820/1379211103","cluster_addr":"172.21.15.163:6824/1379211103","heartbeat_back_addr":"172.21.15.163:6831/1379211103","heartbeat_front_addr":"172.21.15.163:6827/1379211103","state":["exists","up"]},{"osd":2,"uuid":"86fa2618-f73f-4dda-b349-5abd65228c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6803","nonce":239774303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6805","nonce":239774303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6809","nonce":239774303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":239774303},{"type":"v1","addr":"172.21.15.163:6807","nonce":239774303}]},"public_addr":"172.21.15.163:6803/239774303","cluster_addr":"172.21.15.163:6805/239774303","heartbeat_back_addr":"172.21.15.163:6809/239774303","heartbeat_front_addr":"172.21.15.163:6807/239774303","state":["exists","up"]},{"osd":3,"uuid":"1c6dbffe-3cb9-4ad3-86a3-fdfb213a16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6819","nonce":3700943422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6825","nonce":3700943422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6833","nonce":3700943422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3700943422},{"type":"v1","addr":"172.21.15.163:6830","nonce":3700943422}]},"public_addr":"172.21.15.163:6819/3700943422","cluster_addr":"172.21.15.163:6825/3700943422","heartbeat_back_addr":"172.21.15.163:6833/3700943422","heartbeat_front_addr":"172.21.15.163:6830/3700943422","state":["exists","up"]},{"osd":4,"uuid":"83a46f56-4f0b-4276-8e71-938adf325a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6817","nonce":4109894803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6823","nonce":4109894803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6831","nonce":4109894803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6825","nonce":4109894803},{"type":"v1","addr":"172.21.15.189:6827","nonce":4109894803}]},"public_addr":"172.21.15.189:6817/4109894803","cluster_addr":"172.21.15.189:6823/4109894803","heartbeat_back_addr":"172.21.15.189:6831/4109894803","heartbeat_front_addr":"172.21.15.189:6827/4109894803","state":["exists","up"]},{"osd":5,"uuid":"46dba586-59d2-469e-8ce0-5e123e2dec72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6801","nonce":1777830067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6803","nonce":1777830067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6807","nonce":1777830067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1777830067},{"type":"v1","addr":"172.21.15.189:6805","nonce":1777830067}]},"public_addr":"172.21.15.189:6801/1777830067","cluster_addr":"172.21.15.189:6803/1777830067","heartbeat_back_addr":"172.21.15.189:6807/1777830067","heartbeat_front_addr":"172.21.15.189:6805/1777830067","state":["exists","up"]},{"osd":6,"uuid":"7b1b4401-c302-489f-a20f-a4e51455c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6809","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6811","nonce":4014790814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6813","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6816","nonce":4014790814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6829","nonce":4014790814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6819","nonce":4014790814},{"type":"v1","addr":"172.21.15.189:6822","nonce":4014790814}]},"public_addr":"172.21.15.189:6811/4014790814","cluster_addr":"172.21.15.189:6816/4014790814","heartbeat_back_addr":"172.21.15.189:6829/4014790814","heartbeat_front_addr":"172.21.15.189:6822/4014790814","state":["exists","up"]},{"osd":7,"uuid":"02292040-b6f3-47b0-b872-d9a1ee3b0173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6810","nonce":2925885107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6815","nonce":2925885107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6828","nonce":2925885107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2925885107},{"type":"v1","addr":"172.21.15.189:6821","nonce":2925885107}]},"public_addr":"172.21.15.189:6810/2925885107","cluster_addr":"172.21.15.189:6815/2925885107","heartbeat_back_addr":"172.21.15.189:6828/2925885107","heartbeat_front_addr":"172.21.15.189:6821/2925885107","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.202881+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.029907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.137104+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.988413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.179201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.134988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:33:59.969145+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T16:34:00.228736+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T17:06:30.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.566+0000 7f8393e00640 1 -- 172.21.15.163:0/711690195 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f837406c940 msgr2=0x7f837406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:30.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.566+0000 7f8393e00640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f837406c940 0x7f837406ee00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83840017e0 tx=0x7f8384009040 comp rx=0 tx=0).stop 2024-04-01T17:06:30.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.566+0000 7f8393e00640 1 -- 172.21.15.163:0/711690195 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83940c3910 msgr2=0x7f8394153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:30.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.566+0000 7f8393e00640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83940c3910 0x7f8394153050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f838c02c6d0 tx=0x7f838c009750 comp rx=0 tx=0).stop 2024-04-01T17:06:30.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.567+0000 7f8393e00640 1 -- 172.21.15.163:0/711690195 shutdown_connections 2024-04-01T17:06:30.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.567+0000 7f8393e00640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f837406c940 0x7f837406ee00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:30.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.567+0000 7f8393e00640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83940c3910 0x7f8394153050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:30.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.567+0000 7f8393e00640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f83940c4d20 0x7f83940b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:30.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.567+0000 7f8393e00640 1 --2- 172.21.15.163:0/711690195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8378004d40 0x7f83941f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:30.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.567+0000 7f8393e00640 1 -- 172.21.15.163:0/711690195 >> 172.21.15.163:0/711690195 conn(0x7f83940b1910 msgr2=0x7f83940cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:30.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.567+0000 7f8393e00640 1 -- 172.21.15.163:0/711690195 shutdown_connections 2024-04-01T17:06:30.568 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.567+0000 7f8393e00640 1 -- 172.21.15.163:0/711690195 wait complete. 2024-04-01T17:06:30.589 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-01T17:06:30.794 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.794+0000 7ff1d0200640 1 Processor -- start 2024-04-01T17:06:30.794 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.794+0000 7ff1d0200640 1 -- start start 2024-04-01T17:06:30.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.795+0000 7ff1d0200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7ff1c8152830 0x7ff1c8072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:30.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.796+0000 7ff1d0200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff1c815c160 0x7ff1c8072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:30.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.796+0000 7ff1d0200640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c80737f0 con 0x7ff1c80c6b30 2024-04-01T17:06:30.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.796+0000 7ff1d0200640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c8152c10 con 0x7ff1c815c160 2024-04-01T17:06:30.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.796+0000 7ff1d0200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c80c72d0 con 0x7ff1c8152830 2024-04-01T17:06:30.797 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.797+0000 7ff1ce200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff1c815c160 0x7ff1c8072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:30.797 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.797+0000 7ff1ce200640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff1c815c160 0x7ff1c8072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55754/0 (socket says 172.21.15.163:55754) 2024-04-01T17:06:30.797 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.797+0000 7ff1ce200640 1 -- 172.21.15.163:0/2249759942 learned_addr learned my addr 172.21.15.163:0/2249759942 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:06:30.798 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.798+0000 7ff1cd800640 1 --2- 172.21.15.163:0/2249759942 >> v2:172.21.15.189:3300/0 conn(0x7ff1c8152830 0x7ff1c8072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:30.800 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.800+0000 7ff1ce200640 1 -- 172.21.15.163:0/2249759942 >> v2:172.21.15.189:3300/0 conn(0x7ff1c8152830 msgr2=0x7ff1c8072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:30.800 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.800+0000 7ff1ce200640 1 --2- 172.21.15.163:0/2249759942 >> v2:172.21.15.189:3300/0 conn(0x7ff1c8152830 0x7ff1c8072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:30.800 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.800+0000 7ff1ce200640 1 -- 172.21.15.163:0/2249759942 >> v1:172.21.15.189:6789/0 conn(0x7ff1c80c6b30 legacy=0x7ff1c815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:30.801 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.800+0000 7ff1ce200640 1 -- 172.21.15.163:0/2249759942 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c80c75b0 con 0x7ff1c815c160 2024-04-01T17:06:30.802 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.803+0000 7ff1ce200640 1 --2- 172.21.15.163:0/2249759942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1c815c160 0x7ff1c8072e40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8070680 tx=0x7ff1c002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cf451f884c7606 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:30.807 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.807+0000 7ff1c7e00640 1 -- 172.21.15.163:0/2249759942 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c002cb20 con 0x7ff1c815c160 2024-04-01T17:06:30.807 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.807+0000 7ff1c7e00640 1 -- 172.21.15.163:0/2249759942 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff1c002ccc0 con 0x7ff1c815c160 2024-04-01T17:06:30.807 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.807+0000 7ff1c7e00640 1 -- 172.21.15.163:0/2249759942 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0034630 con 0x7ff1c815c160 2024-04-01T17:06:30.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.808+0000 7ff1d0200640 1 -- 172.21.15.163:0/2249759942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1c815c160 msgr2=0x7ff1c8072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:30.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.808+0000 7ff1d0200640 1 --2- 172.21.15.163:0/2249759942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1c815c160 0x7ff1c8072e40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8070680 tx=0x7ff1c002bf80 comp rx=0 tx=0).stop 2024-04-01T17:06:30.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.808+0000 7ff1d0200640 1 -- 172.21.15.163:0/2249759942 shutdown_connections 2024-04-01T17:06:30.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.808+0000 7ff1d0200640 1 --2- 172.21.15.163:0/2249759942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1c815c160 0x7ff1c8072e40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:30.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.808+0000 7ff1d0200640 1 --2- 172.21.15.163:0/2249759942 >> v2:172.21.15.189:3300/0 conn(0x7ff1c8152830 0x7ff1c8072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:30.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.808+0000 7ff1d0200640 1 -- 172.21.15.163:0/2249759942 >> 172.21.15.163:0/2249759942 conn(0x7ff1c80cbe20 msgr2=0x7ff1c80cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:30.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.808+0000 7ff1d0200640 1 -- 172.21.15.163:0/2249759942 shutdown_connections 2024-04-01T17:06:30.808 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.808+0000 7ff1d0200640 1 -- 172.21.15.163:0/2249759942 wait complete. 2024-04-01T17:06:30.809 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.810+0000 7ff1d0200640 1 Processor -- start 2024-04-01T17:06:30.810 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.810+0000 7ff1d0200640 1 -- start start 2024-04-01T17:06:30.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.811+0000 7ff1d0200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c80c6b30 0x7ff1c80c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:30.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.811+0000 7ff1d0200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1c8152830 0x7ff1c80c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:30.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.811+0000 7ff1d0200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c8159620 0x7ff1c81f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:30.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.811+0000 7ff1d0200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c8073a90 con 0x7ff1c8152830 2024-04-01T17:06:30.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.811+0000 7ff1d0200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c80c7b70 con 0x7ff1c8159620 2024-04-01T17:06:30.811 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.811+0000 7ff1d0200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c80707f0 con 0x7ff1c80c6b30 2024-04-01T17:06:30.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.812+0000 7ff1cce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1c8152830 0x7ff1c80c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:30.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.812+0000 7ff1cce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1c8152830 0x7ff1c80c24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55768/0 (socket says 172.21.15.163:55768) 2024-04-01T17:06:30.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.812+0000 7ff1cce00640 1 -- 172.21.15.163:0/2797650083 learned_addr learned my addr 172.21.15.163:0/2797650083 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:06:30.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.813+0000 7ff1cd800640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c80c6b30 0x7ff1c80c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:30.812 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.813+0000 7ff1ce200640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c8159620 0x7ff1c81f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:30.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.816+0000 7ff1cce00640 1 -- 172.21.15.163:0/2797650083 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c80c6b30 msgr2=0x7ff1c80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:30.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.816+0000 7ff1cce00640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c80c6b30 0x7ff1c80c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:30.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.816+0000 7ff1cce00640 1 -- 172.21.15.163:0/2797650083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c8159620 msgr2=0x7ff1c81f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:30.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.816+0000 7ff1cce00640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c8159620 0x7ff1c81f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:30.816 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.816+0000 7ff1cce00640 1 -- 172.21.15.163:0/2797650083 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c81f0930 con 0x7ff1c8152830 2024-04-01T17:06:30.818 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.818+0000 7ff1cce00640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1c8152830 0x7ff1c80c24c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400c430 tx=0x7ff1b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:30.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.822+0000 7ff1c5600640 1 -- 172.21.15.163:0/2797650083 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40052d0 con 0x7ff1c8152830 2024-04-01T17:06:30.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.823+0000 7ff1c5600640 1 -- 172.21.15.163:0/2797650083 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff1b4005490 con 0x7ff1c8152830 2024-04-01T17:06:30.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.823+0000 7ff1c5600640 1 -- 172.21.15.163:0/2797650083 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4007280 con 0x7ff1c8152830 2024-04-01T17:06:30.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.823+0000 7ff1d0200640 1 -- 172.21.15.163:0/2797650083 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c81f0c10 con 0x7ff1c8152830 2024-04-01T17:06:30.822 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.823+0000 7ff1d0200640 1 -- 172.21.15.163:0/2797650083 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c81f11d0 con 0x7ff1c8152830 2024-04-01T17:06:30.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.824+0000 7ff1d0200640 1 -- 172.21.15.163:0/2797650083 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c80756d0 con 0x7ff1c8152830 2024-04-01T17:06:30.845 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.846+0000 7ff1c5600640 1 -- 172.21.15.163:0/2797650083 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff1b4007420 con 0x7ff1c8152830 2024-04-01T17:06:30.846 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.847+0000 7ff1c5600640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff1a806c970 0x7ff1a806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:30.846 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.847+0000 7ff1cd800640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff1a806c970 0x7ff1a806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:30.848 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:30.849+0000 7ff1cd800640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff1a806c970 0x7ff1a806ee30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc006fd0 tx=0x7ff1bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:31.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.154+0000 7ff1c5600640 1 -- 172.21.15.163:0/2797650083 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5825+0+0 (secure 0 0 0) 0x7ff1b4057360 con 0x7ff1c8152830 2024-04-01T17:06:31.155 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.156+0000 7ff1c5600640 1 -- 172.21.15.163:0/2797650083 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff1b40592c0 con 0x7ff1c8152830 2024-04-01T17:06:31.407 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.407+0000 7ff1d0200640 1 -- 172.21.15.163:0/2797650083 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff1c814ea20 con 0x7ff1c8152830 2024-04-01T17:06:31.891 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.891+0000 7ff1c5600640 1 -- 172.21.15.163:0/2797650083 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7ff1b405d5c0 con 0x7ff1c8152830 2024-04-01T17:06:31.891 INFO:teuthology.orchestra.run.smithi163.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-01T17:06:31.895 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.895+0000 7ff1d0200640 1 -- 172.21.15.163:0/2797650083 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff1a806c970 msgr2=0x7ff1a806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:31.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.895+0000 7ff1d0200640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff1a806c970 0x7ff1a806ee30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc006fd0 tx=0x7ff1bc008040 comp rx=0 tx=0).stop 2024-04-01T17:06:31.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.895+0000 7ff1d0200640 1 -- 172.21.15.163:0/2797650083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1c8152830 msgr2=0x7ff1c80c24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:31.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.895+0000 7ff1d0200640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1c8152830 0x7ff1c80c24c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400c430 tx=0x7ff1b400c8f0 comp rx=0 tx=0).stop 2024-04-01T17:06:31.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.896+0000 7ff1d0200640 1 -- 172.21.15.163:0/2797650083 shutdown_connections 2024-04-01T17:06:31.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.896+0000 7ff1d0200640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7ff1a806c970 0x7ff1a806ee30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:31.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.896+0000 7ff1d0200640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c8159620 0x7ff1c81f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:31.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.896+0000 7ff1d0200640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1c8152830 0x7ff1c80c24c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:31.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.896+0000 7ff1d0200640 1 --2- 172.21.15.163:0/2797650083 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7ff1c80c6b30 0x7ff1c80c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:31.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.896+0000 7ff1d0200640 1 -- 172.21.15.163:0/2797650083 >> 172.21.15.163:0/2797650083 conn(0x7ff1c80cbe20 msgr2=0x7ff1c80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:31.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.896+0000 7ff1d0200640 1 -- 172.21.15.163:0/2797650083 shutdown_connections 2024-04-01T17:06:31.896 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:31.896+0000 7ff1d0200640 1 -- 172.21.15.163:0/2797650083 wait complete. 2024-04-01T17:06:31.923 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-01T17:06:32.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.138+0000 7fb277c00640 1 Processor -- start 2024-04-01T17:06:32.138 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.138+0000 7fb277c00640 1 -- start start 2024-04-01T17:06:32.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.139+0000 7fb277c00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb27006eec0 0x7fb270158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:32.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.139+0000 7fb277c00640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2700c7620 con 0x7fb270158bb0 2024-04-01T17:06:32.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.139+0000 7fb277c00640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb270152df0 con 0x7fb270152a10 2024-04-01T17:06:32.139 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.139+0000 7fb277c00640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb27006f350 con 0x7fb27006eec0 2024-04-01T17:06:32.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.140+0000 7fb26fe00640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb27006eec0 0x7fb270158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:32.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.141+0000 7fb275200640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb270152a10 0x7fb2700c4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.163:55328/0 (socket says 172.21.15.163:55328) 2024-04-01T17:06:32.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.141+0000 7fb275200640 1 -- 172.21.15.163:0/3294025306 learned_addr learned my addr 172.21.15.163:0/3294025306 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:06:32.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.141+0000 7fb275c00640 1 --1- 172.21.15.163:0/3294025306 >> v1:172.21.15.163:6789/0 conn(0x7fb270158bb0 0x7fb270162f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:55464/0 (socket says 172.21.15.163:55464) 2024-04-01T17:06:32.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.144+0000 7fb26fe00640 1 -- 172.21.15.163:0/3294025306 >> v1:172.21.15.189:6789/0 conn(0x7fb270152a10 legacy=0x7fb2700c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:32.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.144+0000 7fb26fe00640 1 -- 172.21.15.163:0/3294025306 >> v1:172.21.15.163:6789/0 conn(0x7fb270158bb0 legacy=0x7fb270162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:32.143 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.144+0000 7fb26fe00640 1 -- 172.21.15.163:0/3294025306 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27006ead0 con 0x7fb27006eec0 2024-04-01T17:06:32.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.147+0000 7fb26fe00640 1 --2- 172.21.15.163:0/3294025306 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb27006eec0 0x7fb270158670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0097a0 tx=0x7fb25c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4dd212bf0195fa server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:32.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.153+0000 7fb26f400640 1 -- 172.21.15.163:0/3294025306 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c034070 con 0x7fb27006eec0 2024-04-01T17:06:32.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.153+0000 7fb26f400640 1 -- 172.21.15.163:0/3294025306 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb25c030610 con 0x7fb27006eec0 2024-04-01T17:06:32.153 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.153+0000 7fb26f400640 1 -- 172.21.15.163:0/3294025306 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c030a00 con 0x7fb27006eec0 2024-04-01T17:06:32.153 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.153+0000 7fb277c00640 1 -- 172.21.15.163:0/3294025306 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb27006eec0 msgr2=0x7fb270158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:32.153 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.153+0000 7fb277c00640 1 --2- 172.21.15.163:0/3294025306 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb27006eec0 0x7fb270158670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0097a0 tx=0x7fb25c02b960 comp rx=0 tx=0).stop 2024-04-01T17:06:32.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.154+0000 7fb277c00640 1 -- 172.21.15.163:0/3294025306 shutdown_connections 2024-04-01T17:06:32.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.154+0000 7fb277c00640 1 --2- 172.21.15.163:0/3294025306 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb27006eec0 0x7fb270158670 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:32.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.154+0000 7fb277c00640 1 -- 172.21.15.163:0/3294025306 >> 172.21.15.163:0/3294025306 conn(0x7fb2700c8a00 msgr2=0x7fb2700c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:32.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.154+0000 7fb277c00640 1 -- 172.21.15.163:0/3294025306 shutdown_connections 2024-04-01T17:06:32.154 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.154+0000 7fb277c00640 1 -- 172.21.15.163:0/3294025306 wait complete. 2024-04-01T17:06:32.155 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.155+0000 7fb277c00640 1 Processor -- start 2024-04-01T17:06:32.155 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.156+0000 7fb277c00640 1 -- start start 2024-04-01T17:06:32.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.157+0000 7fb277c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb27006eec0 0x7fb2701582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:32.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.157+0000 7fb277c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb270152a10 0x7fb270153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:32.156 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.157+0000 7fb277c00640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb270158bb0 0x7fb270153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:32.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.157+0000 7fb277c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb2700c7e50 con 0x7fb27006eec0 2024-04-01T17:06:32.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.157+0000 7fb277c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb2700c7b70 con 0x7fb270152a10 2024-04-01T17:06:32.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.157+0000 7fb277c00640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fb2700c8130 con 0x7fb270158bb0 2024-04-01T17:06:32.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.157+0000 7fb275200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb27006eec0 0x7fb2701582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:32.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.158+0000 7fb275200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb27006eec0 0x7fb2701582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37538/0 (socket says 172.21.15.163:37538) 2024-04-01T17:06:32.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.158+0000 7fb275200640 1 -- 172.21.15.163:0/2969874867 learned_addr learned my addr 172.21.15.163:0/2969874867 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:06:32.157 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.158+0000 7fb275c00640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb270158bb0 0x7fb270153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:32.158 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.158+0000 7fb26fe00640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb270152a10 0x7fb270153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:32.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.161+0000 7fb275200640 1 -- 172.21.15.163:0/2969874867 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb270158bb0 msgr2=0x7fb270153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:32.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.161+0000 7fb275200640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb270158bb0 0x7fb270153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:32.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.161+0000 7fb275200640 1 -- 172.21.15.163:0/2969874867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb270152a10 msgr2=0x7fb270153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:32.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.161+0000 7fb275200640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb270152a10 0x7fb270153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:32.161 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.161+0000 7fb275200640 1 -- 172.21.15.163:0/2969874867 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2701efeb0 con 0x7fb27006eec0 2024-04-01T17:06:32.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.164+0000 7fb275200640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb27006eec0 0x7fb2701582f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb26400c4d0 tx=0x7fb26400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:32.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.168+0000 7fb26cc00640 1 -- 172.21.15.163:0/2969874867 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264017070 con 0x7fb27006eec0 2024-04-01T17:06:32.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.168+0000 7fb26cc00640 1 -- 172.21.15.163:0/2969874867 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb264005ce0 con 0x7fb27006eec0 2024-04-01T17:06:32.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.168+0000 7fb277c00640 1 -- 172.21.15.163:0/2969874867 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2701f0150 con 0x7fb27006eec0 2024-04-01T17:06:32.167 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.168+0000 7fb26cc00640 1 -- 172.21.15.163:0/2969874867 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264007290 con 0x7fb27006eec0 2024-04-01T17:06:32.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.168+0000 7fb277c00640 1 -- 172.21.15.163:0/2969874867 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb270157810 con 0x7fb27006eec0 2024-04-01T17:06:32.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.169+0000 7fb277c00640 1 -- 172.21.15.163:0/2969874867 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2700756d0 con 0x7fb27006eec0 2024-04-01T17:06:32.438 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.439+0000 7fb26cc00640 1 -- 172.21.15.163:0/2969874867 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb26401a070 con 0x7fb27006eec0 2024-04-01T17:06:32.439 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.440+0000 7fb26cc00640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb25006c940 0x7fb25006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:32.440 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.441+0000 7fb26fe00640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb25006c940 0x7fb25006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:32.442 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.442+0000 7fb26fe00640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb25006c940 0x7fb25006ee00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb25c036000 tx=0x7fb25c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:32.485 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.486+0000 7fb26cc00640 1 -- 172.21.15.163:0/2969874867 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5911+0+0 (secure 0 0 0) 0x7fb264057170 con 0x7fb27006eec0 2024-04-01T17:06:32.486 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.486+0000 7fb26cc00640 1 -- 172.21.15.163:0/2969874867 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb264021020 con 0x7fb27006eec0 2024-04-01T17:06:32.795 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:32.795+0000 7fb277c00640 1 -- 172.21.15.163:0/2969874867 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb2700c63d0 con 0x7fb27006eec0 2024-04-01T17:06:33.429 INFO:tasks.ceph.mds.b.smithi189.stderr:==00:00:32:19.301 41980== 2024-04-01T17:06:33.429 INFO:tasks.ceph.mds.b.smithi189.stderr:==00:00:32:19.301 41980== Exit program on first error (--exit-on-first-error=yes) 2024-04-01T17:06:33.557 INFO:tasks.ceph.mds.b.smithi189.stderr:daemon-helper: command failed with exit status 42 2024-04-01T17:06:33.819 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.819+0000 7fb26cc00640 1 -- 172.21.15.163:0/2969874867 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fb2640590d0 con 0x7fb27006eec0 2024-04-01T17:06:33.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.823+0000 7fb277c00640 1 -- 172.21.15.163:0/2969874867 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb25006c940 msgr2=0x7fb25006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:33.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.823+0000 7fb277c00640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb25006c940 0x7fb25006ee00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb25c036000 tx=0x7fb25c03b040 comp rx=0 tx=0).stop 2024-04-01T17:06:33.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.823+0000 7fb277c00640 1 -- 172.21.15.163:0/2969874867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb27006eec0 msgr2=0x7fb2701582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:33.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.823+0000 7fb277c00640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb27006eec0 0x7fb2701582f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb26400c4d0 tx=0x7fb26400c990 comp rx=0 tx=0).stop 2024-04-01T17:06:33.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.823+0000 7fb277c00640 1 -- 172.21.15.163:0/2969874867 shutdown_connections 2024-04-01T17:06:33.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.823+0000 7fb277c00640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fb25006c940 0x7fb25006ee00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:33.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.823+0000 7fb277c00640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fb270158bb0 0x7fb270153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:33.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.823+0000 7fb277c00640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb270152a10 0x7fb270153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:33.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.823+0000 7fb277c00640 1 --2- 172.21.15.163:0/2969874867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb27006eec0 0x7fb2701582f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:33.823 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.823+0000 7fb277c00640 1 -- 172.21.15.163:0/2969874867 >> 172.21.15.163:0/2969874867 conn(0x7fb2700c8a00 msgr2=0x7fb2700cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:33.824 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.823+0000 7fb277c00640 1 -- 172.21.15.163:0/2969874867 shutdown_connections 2024-04-01T17:06:33.824 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:33.823+0000 7fb277c00640 1 -- 172.21.15.163:0/2969874867 wait complete. 2024-04-01T17:06:33.847 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-01T17:06:34.056 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.057+0000 7f4296600640 1 Processor -- start 2024-04-01T17:06:34.057 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.057+0000 7f4296600640 1 -- start start 2024-04-01T17:06:34.058 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.058+0000 7f4296600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290152a10 0x7f429006eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:34.058 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.058+0000 7f4296600640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42900c7620 con 0x7f4290158d80 2024-04-01T17:06:34.058 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.059+0000 7f4296600640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4290152df0 con 0x7f42900c4800 2024-04-01T17:06:34.058 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.059+0000 7f4296600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f429006ead0 con 0x7f4290152a10 2024-04-01T17:06:34.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.101+0000 7f428f400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290152a10 0x7f429006eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:34.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.102+0000 7f428f400640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290152a10 0x7f429006eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3301/0 says I am v2:172.21.15.163:56806/0 (socket says 172.21.15.163:56806) 2024-04-01T17:06:34.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.102+0000 7f428f400640 1 -- 172.21.15.163:0/1324389211 learned_addr learned my addr 172.21.15.163:0/1324389211 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:06:34.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.108+0000 7f428f400640 1 -- 172.21.15.163:0/1324389211 >> v1:172.21.15.189:6789/0 conn(0x7f42900c4800 legacy=0x7f4290158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:34.108 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.108+0000 7f428f400640 1 -- 172.21.15.163:0/1324389211 >> v1:172.21.15.163:6789/0 conn(0x7f4290158d80 legacy=0x7f4290162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:34.108 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.108+0000 7f428f400640 1 -- 172.21.15.163:0/1324389211 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42900c7890 con 0x7f4290152a10 2024-04-01T17:06:34.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.118+0000 7f428f400640 1 --2- 172.21.15.163:0/1324389211 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290152a10 0x7f429006eec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42800098a0 tx=0x7f428002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6059cf154eef4625 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:34.125 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.125+0000 7f428ea00640 1 -- 172.21.15.163:0/1324389211 <== mon.2 v2:172.21.15.189:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280035020 con 0x7f4290152a10 2024-04-01T17:06:34.125 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.126+0000 7f428ea00640 1 -- 172.21.15.163:0/1324389211 <== mon.2 v2:172.21.15.189:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4280031640 con 0x7f4290152a10 2024-04-01T17:06:34.125 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.126+0000 7f428ea00640 1 -- 172.21.15.163:0/1324389211 <== mon.2 v2:172.21.15.189:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428002d040 con 0x7f4290152a10 2024-04-01T17:06:34.126 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.127+0000 7f4296600640 1 -- 172.21.15.163:0/1324389211 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290152a10 msgr2=0x7f429006eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:34.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.127+0000 7f4296600640 1 --2- 172.21.15.163:0/1324389211 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290152a10 0x7f429006eec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42800098a0 tx=0x7f428002b8f0 comp rx=0 tx=0).stop 2024-04-01T17:06:34.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.127+0000 7f4296600640 1 -- 172.21.15.163:0/1324389211 shutdown_connections 2024-04-01T17:06:34.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.127+0000 7f4296600640 1 --2- 172.21.15.163:0/1324389211 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f4290152a10 0x7f429006eec0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:34.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.127+0000 7f4296600640 1 -- 172.21.15.163:0/1324389211 >> 172.21.15.163:0/1324389211 conn(0x7f42900c8a00 msgr2=0x7f42900c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:34.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.127+0000 7f4296600640 1 -- 172.21.15.163:0/1324389211 shutdown_connections 2024-04-01T17:06:34.127 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.127+0000 7f4296600640 1 -- 172.21.15.163:0/1324389211 wait complete. 2024-04-01T17:06:34.129 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.130+0000 7f4296600640 1 Processor -- start 2024-04-01T17:06:34.129 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.130+0000 7f4296600640 1 -- start start 2024-04-01T17:06:34.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.131+0000 7f4296600640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42900c4800 0x7f42901447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:34.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.131+0000 7f4296600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4290152a10 0x7f4290144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:34.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.131+0000 7f4296600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4290158d80 0x7f42900c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:34.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.131+0000 7f4296600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f42900c8130 con 0x7f4290152a10 2024-04-01T17:06:34.131 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.131+0000 7f4296600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f42900c7e50 con 0x7f4290158d80 2024-04-01T17:06:34.132 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.131+0000 7f4296600640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7f429006e6b0 con 0x7f42900c4800 2024-04-01T17:06:34.132 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.132+0000 7f4287e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4290152a10 0x7f4290144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:34.132 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.133+0000 7f4287e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4290152a10 0x7f4290144d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37540/0 (socket says 172.21.15.163:37540) 2024-04-01T17:06:34.132 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.133+0000 7f4287e00640 1 -- 172.21.15.163:0/3164492858 learned_addr learned my addr 172.21.15.163:0/3164492858 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:06:34.133 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.133+0000 7f428f400640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42900c4800 0x7f42901447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:34.136 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.137+0000 7f4287e00640 1 -- 172.21.15.163:0/3164492858 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42900c4800 msgr2=0x7f42901447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:34.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.137+0000 7f4287e00640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42900c4800 0x7f42901447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:34.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.137+0000 7f4287e00640 1 -- 172.21.15.163:0/3164492858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4290158d80 msgr2=0x7f42900c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:34.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.137+0000 7f4287e00640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4290158d80 0x7f42900c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:34.137 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.137+0000 7f4287e00640 1 -- 172.21.15.163:0/3164492858 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42901f0b70 con 0x7f4290152a10 2024-04-01T17:06:34.140 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.140+0000 7f4287e00640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4290152a10 0x7f4290144d00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f427800c410 tx=0x7f427800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:34.145 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.145+0000 7f4287400640 1 -- 172.21.15.163:0/3164492858 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278017070 con 0x7f4290152a10 2024-04-01T17:06:34.145 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.145+0000 7f4287400640 1 -- 172.21.15.163:0/3164492858 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f42780035f0 con 0x7f4290152a10 2024-04-01T17:06:34.145 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.145+0000 7f4287400640 1 -- 172.21.15.163:0/3164492858 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278003a40 con 0x7f4290152a10 2024-04-01T17:06:34.145 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.145+0000 7f4296600640 1 -- 172.21.15.163:0/3164492858 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42901516a0 con 0x7f4290152a10 2024-04-01T17:06:34.145 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.146+0000 7f4296600640 1 -- 172.21.15.163:0/3164492858 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4290155b80 con 0x7f4290152a10 2024-04-01T17:06:34.147 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.147+0000 7f4296600640 1 -- 172.21.15.163:0/3164492858 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42900756d0 con 0x7f4290152a10 2024-04-01T17:06:34.494 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.495+0000 7f4287400640 1 -- 172.21.15.163:0/3164492858 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f427801a070 con 0x7f4290152a10 2024-04-01T17:06:34.498 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.499+0000 7f4287400640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f426c06c940 0x7f426c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:34.499 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.499+0000 7f428f400640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f426c06c940 0x7f426c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:34.500 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.501+0000 7f428f400640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f426c06c940 0x7f426c06ee00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4280036000 tx=0x7f428003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:34.534 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.535+0000 7f4287400640 1 -- 172.21.15.163:0/3164492858 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5911+0+0 (secure 0 0 0) 0x7f4278057270 con 0x7f4290152a10 2024-04-01T17:06:34.536 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.537+0000 7f4287400640 1 -- 172.21.15.163:0/3164492858 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4278021020 con 0x7f4290152a10 2024-04-01T17:06:34.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:34.767+0000 7f4296600640 1 -- 172.21.15.163:0/3164492858 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42900b2010 con 0x7f4290152a10 2024-04-01T17:06:35.236 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.236+0000 7f4287400640 1 -- 172.21.15.163:0/3164492858 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f42780010c0 con 0x7f4290152a10 2024-04-01T17:06:35.236 INFO:teuthology.orchestra.run.smithi163.stderr:pool 'cephfs_metadata' removed 2024-04-01T17:06:35.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.239+0000 7f4296600640 1 -- 172.21.15.163:0/3164492858 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f426c06c940 msgr2=0x7f426c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:35.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.239+0000 7f4296600640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f426c06c940 0x7f426c06ee00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4280036000 tx=0x7f428003c040 comp rx=0 tx=0).stop 2024-04-01T17:06:35.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.239+0000 7f4296600640 1 -- 172.21.15.163:0/3164492858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4290152a10 msgr2=0x7f4290144d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:35.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.239+0000 7f4296600640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4290152a10 0x7f4290144d00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f427800c410 tx=0x7f427800c8d0 comp rx=0 tx=0).stop 2024-04-01T17:06:35.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.240+0000 7f4296600640 1 -- 172.21.15.163:0/3164492858 shutdown_connections 2024-04-01T17:06:35.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.240+0000 7f4296600640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7f426c06c940 0x7f426c06ee00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:35.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.240+0000 7f4296600640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4290158d80 0x7f42900c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:35.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.240+0000 7f4296600640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4290152a10 0x7f4290144d00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:35.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.240+0000 7f4296600640 1 --2- 172.21.15.163:0/3164492858 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7f42900c4800 0x7f42901447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:35.240 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.240+0000 7f4296600640 1 -- 172.21.15.163:0/3164492858 >> 172.21.15.163:0/3164492858 conn(0x7f42900c8a00 msgr2=0x7f42901584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:35.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.240+0000 7f4296600640 1 -- 172.21.15.163:0/3164492858 shutdown_connections 2024-04-01T17:06:35.241 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.240+0000 7f4296600640 1 -- 172.21.15.163:0/3164492858 wait complete. 2024-04-01T17:06:35.267 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-01T17:06:35.470 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.471+0000 7fa327200640 1 Processor -- start 2024-04-01T17:06:35.471 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.471+0000 7fa327200640 1 -- start start 2024-04-01T17:06:35.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.473+0000 7fa327200640 1 --2- >> v2:172.21.15.189:3300/0 conn(0x7fa328072150 0x7fa328072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:35.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.473+0000 7fa327200640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32815bd30 con 0x7fa328158f00 2024-04-01T17:06:35.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.473+0000 7fa327200640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32815bfd0 con 0x7fa328152310 2024-04-01T17:06:35.472 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.473+0000 7fa327200640 1 -- --> v2:172.21.15.189:3300/0 -- mon_getmap magic: 0 -- 0x7fa328071cc0 con 0x7fa328072150 2024-04-01T17:06:35.473 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.474+0000 7fa325400640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fa328158f00 0x7fa3280c5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:55490/0 (socket says 172.21.15.163:55490) 2024-04-01T17:06:35.473 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.474+0000 7fa325400640 1 -- 172.21.15.163:0/1523599853 learned_addr learned my addr 172.21.15.163:0/1523599853 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-04-01T17:06:35.474 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.475+0000 7fa326800640 1 --2- 172.21.15.163:0/1523599853 >> v2:172.21.15.189:3300/0 conn(0x7fa328072150 0x7fa328072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:35.476 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.476+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 <== mon.0 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148288934 0 0) 0x7fa32815bd30 con 0x7fa328158f00 2024-04-01T17:06:35.476 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.476+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa30c003520 con 0x7fa328158f00 2024-04-01T17:06:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 <== mon.0 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2970623991 0 0) 0x7fa30c003520 con 0x7fa328158f00 2024-04-01T17:06:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 >> v2:172.21.15.189:3300/0 conn(0x7fa328072150 msgr2=0x7fa328072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 --2- 172.21.15.163:0/1523599853 >> v2:172.21.15.189:3300/0 conn(0x7fa328072150 0x7fa328072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 >> v1:172.21.15.189:6789/0 conn(0x7fa328152310 legacy=0x7fa32806bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32815c2b0 con 0x7fa328158f00 2024-04-01T17:06:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 <== mon.0 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3054003388 0 0) 0x7fa314001690 con 0x7fa328158f00 2024-04-01T17:06:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 >> v1:172.21.15.163:6789/0 conn(0x7fa328158f00 legacy=0x7fa3280c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:35.481 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 --2- 172.21.15.163:0/1523599853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa30c003a00 0x7fa30c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:35.481 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 --2- 172.21.15.163:0/1523599853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c004800 0x7fa30c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:35.481 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 --2- 172.21.15.163:0/1523599853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa30c0051c0 0x7fa30c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:35.481 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa328071cc0 con 0x7fa30c003a00 2024-04-01T17:06:35.481 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c00c0a0 con 0x7fa30c004800 2024-04-01T17:06:35.481 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.480+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa30c00c2a0 con 0x7fa30c0051c0 2024-04-01T17:06:35.482 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.483+0000 7fa326800640 1 --2- 172.21.15.163:0/1523599853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa30c0051c0 0x7fa30c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:35.483 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.483+0000 7fa325e00640 1 --2- 172.21.15.163:0/1523599853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa30c003a00 0x7fa30c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:35.487 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.487+0000 7fa325e00640 1 -- 172.21.15.163:0/1523599853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa30c0051c0 msgr2=0x7fa30c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:35.487 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.487+0000 7fa325e00640 1 --2- 172.21.15.163:0/1523599853 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa30c0051c0 0x7fa30c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:35.488 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.487+0000 7fa325e00640 1 -- 172.21.15.163:0/1523599853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c004800 msgr2=0x7fa30c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T17:06:35.488 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.487+0000 7fa325e00640 1 --2- 172.21.15.163:0/1523599853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c004800 0x7fa30c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:35.488 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.487+0000 7fa325e00640 1 -- 172.21.15.163:0/1523599853 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30c003520 con 0x7fa30c003a00 2024-04-01T17:06:35.488 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.487+0000 7fa326800640 1 -- 172.21.15.163:0/1523599853 reap_dead start 2024-04-01T17:06:35.490 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.490+0000 7fa325e00640 1 --2- 172.21.15.163:0/1523599853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa30c003a00 0x7fa30c003e20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa318001750 tx=0x7fa30c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4c13d40626fcd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:35.494 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.495+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318001370 con 0x7fa30c003a00 2024-04-01T17:06:35.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.495+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa3180052d0 con 0x7fa30c003a00 2024-04-01T17:06:35.495 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.495+0000 7fa324a00640 1 -- 172.21.15.163:0/1523599853 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318003850 con 0x7fa30c003a00 2024-04-01T17:06:35.496 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.496+0000 7fa327200640 1 -- 172.21.15.163:0/1523599853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa30c003a00 msgr2=0x7fa30c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:35.496 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.496+0000 7fa327200640 1 --2- 172.21.15.163:0/1523599853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa30c003a00 0x7fa30c003e20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa318001750 tx=0x7fa30c005830 comp rx=0 tx=0).stop 2024-04-01T17:06:35.496 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.496+0000 7fa327200640 1 -- 172.21.15.163:0/1523599853 shutdown_connections 2024-04-01T17:06:35.496 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.496+0000 7fa327200640 1 --2- 172.21.15.163:0/1523599853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa30c003a00 0x7fa30c003e20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:35.497 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.496+0000 7fa327200640 1 -- 172.21.15.163:0/1523599853 >> 172.21.15.163:0/1523599853 conn(0x7fa32806f750 msgr2=0x7fa32806fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:35.497 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.496+0000 7fa327200640 1 -- 172.21.15.163:0/1523599853 shutdown_connections 2024-04-01T17:06:35.497 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.496+0000 7fa327200640 1 -- 172.21.15.163:0/1523599853 wait complete. 2024-04-01T17:06:35.498 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.498+0000 7fa327200640 1 Processor -- start 2024-04-01T17:06:35.498 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.498+0000 7fa327200640 1 -- start start 2024-04-01T17:06:35.499 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.499+0000 7fa327200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c003a00 0x7fa328148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:35.499 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.499+0000 7fa327200640 1 --2- >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32814b7c0 0x7fa3280c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:35.499 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.499+0000 7fa327200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3281f1100 0x7fa3281f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:35.499 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.499+0000 7fa327200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa32815c870 con 0x7fa3281f1100 2024-04-01T17:06:35.500 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.499+0000 7fa327200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa328159370 con 0x7fa30c003a00 2024-04-01T17:06:35.500 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.500+0000 7fa327200640 1 -- --> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] -- mon_getmap magic: 0 -- 0x7fa32815b9f0 con 0x7fa32814b7c0 2024-04-01T17:06:35.500 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.500+0000 7fa326800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3281f1100 0x7fa3281f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:35.500 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.501+0000 7fa326800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3281f1100 0x7fa3281f1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:37566/0 (socket says 172.21.15.163:37566) 2024-04-01T17:06:35.500 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.501+0000 7fa326800640 1 -- 172.21.15.163:0/2719395151 learned_addr learned my addr 172.21.15.163:0/2719395151 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-01T17:06:35.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.505+0000 7fa326800640 1 -- 172.21.15.163:0/2719395151 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32814b7c0 msgr2=0x7fa3280c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:35.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.505+0000 7fa326800640 1 --2- 172.21.15.163:0/2719395151 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32814b7c0 0x7fa3280c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:35.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.505+0000 7fa326800640 1 -- 172.21.15.163:0/2719395151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c003a00 msgr2=0x7fa328148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:35.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.505+0000 7fa326800640 1 --2- 172.21.15.163:0/2719395151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c003a00 0x7fa328148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:35.504 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.505+0000 7fa326800640 1 -- 172.21.15.163:0/2719395151 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3281f1ac0 con 0x7fa3281f1100 2024-04-01T17:06:35.507 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.508+0000 7fa326800640 1 --2- 172.21.15.163:0/2719395151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3281f1100 0x7fa3281f1580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa32806bed0 tx=0x7fa32000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:35.515 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.515+0000 7fa31e000640 1 -- 172.21.15.163:0/2719395151 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32000fe10 con 0x7fa3281f1100 2024-04-01T17:06:35.515 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.516+0000 7fa31e000640 1 -- 172.21.15.163:0/2719395151 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa32001d070 con 0x7fa3281f1100 2024-04-01T17:06:35.515 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.516+0000 7fa31e000640 1 -- 172.21.15.163:0/2719395151 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320015690 con 0x7fa3281f1100 2024-04-01T17:06:35.515 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.516+0000 7fa327200640 1 -- 172.21.15.163:0/2719395151 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa328149540 con 0x7fa3281f1100 2024-04-01T17:06:35.516 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.516+0000 7fa327200640 1 -- 172.21.15.163:0/2719395151 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa328152e90 con 0x7fa3281f1100 2024-04-01T17:06:35.517 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.517+0000 7fa327200640 1 -- 172.21.15.163:0/2719395151 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3280756d0 con 0x7fa3281f1100 2024-04-01T17:06:35.571 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.572+0000 7fa31e000640 1 -- 172.21.15.163:0/2719395151 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa320005d10 con 0x7fa3281f1100 2024-04-01T17:06:35.573 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.574+0000 7fa31e000640 1 --2- 172.21.15.163:0/2719395151 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa30806c940 0x7fa30806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T17:06:35.574 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.575+0000 7fa325e00640 1 --2- 172.21.15.163:0/2719395151 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa30806c940 0x7fa30806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T17:06:35.576 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.576+0000 7fa325e00640 1 --2- 172.21.15.163:0/2719395151 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa30806c940 0x7fa30806ee00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa318033000 tx=0x7fa31802f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T17:06:35.578 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.578+0000 7fa31e000640 1 -- 172.21.15.163:0/2719395151 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5473+0+0 (secure 0 0 0) 0x7fa320058d40 con 0x7fa3281f1100 2024-04-01T17:06:35.884 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:35.885+0000 7fa31e000640 1 -- 172.21.15.163:0/2719395151 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa3281f1ac0 con 0x7fa3281f1100 2024-04-01T17:06:36.111 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.111+0000 7fa327200640 1 -- 172.21.15.163:0/2719395151 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa3281504a0 con 0x7fa3281f1100 2024-04-01T17:06:36.425 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.425+0000 7fa31e000640 1 -- 172.21.15.163:0/2719395151 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7fa320010040 con 0x7fa3281f1100 2024-04-01T17:06:36.426 INFO:teuthology.orchestra.run.smithi163.stderr:pool 'cephfs_data' removed 2024-04-01T17:06:36.429 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.429+0000 7fa327200640 1 -- 172.21.15.163:0/2719395151 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa30806c940 msgr2=0x7fa30806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:36.429 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.429+0000 7fa327200640 1 --2- 172.21.15.163:0/2719395151 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa30806c940 0x7fa30806ee00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa318033000 tx=0x7fa31802f000 comp rx=0 tx=0).stop 2024-04-01T17:06:36.429 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.429+0000 7fa327200640 1 -- 172.21.15.163:0/2719395151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3281f1100 msgr2=0x7fa3281f1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T17:06:36.429 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.429+0000 7fa327200640 1 --2- 172.21.15.163:0/2719395151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3281f1100 0x7fa3281f1580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa32806bed0 tx=0x7fa32000f580 comp rx=0 tx=0).stop 2024-04-01T17:06:36.429 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.429+0000 7fa327200640 1 -- 172.21.15.163:0/2719395151 shutdown_connections 2024-04-01T17:06:36.429 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.429+0000 7fa327200640 1 --2- 172.21.15.163:0/2719395151 >> [v2:172.21.15.163:6800/4133086793,v1:172.21.15.163:6801/4133086793] conn(0x7fa30806c940 0x7fa30806ee00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:36.429 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.429+0000 7fa327200640 1 --2- 172.21.15.163:0/2719395151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3281f1100 0x7fa3281f1580 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:36.429 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.429+0000 7fa327200640 1 --2- 172.21.15.163:0/2719395151 >> [v2:172.21.15.189:3301/0,v1:172.21.15.189:6790/0] conn(0x7fa32814b7c0 0x7fa3280c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:36.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.429+0000 7fa327200640 1 --2- 172.21.15.163:0/2719395151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c003a00 0x7fa328148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T17:06:36.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.429+0000 7fa327200640 1 -- 172.21.15.163:0/2719395151 >> 172.21.15.163:0/2719395151 conn(0x7fa32806f750 msgr2=0x7fa328151450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T17:06:36.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.429+0000 7fa327200640 1 -- 172.21.15.163:0/2719395151 shutdown_connections 2024-04-01T17:06:36.430 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-01T17:06:36.429+0000 7fa327200640 1 -- 172.21.15.163:0/2719395151 wait complete. 2024-04-01T17:06:36.454 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-01T17:06:36.455 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-01T17:06:36.455 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:06:36.498 INFO:tasks.ceph.mds.a.smithi163.stderr:2024-04-01T17:06:36.468+0000 b5f1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 41428) UID: 0 2024-04-01T17:06:36.500 INFO:tasks.ceph.mds.a.smithi163.stderr:2024-04-01T17:06:36.473+0000 b5f1640 -1 mds.a *** got signal Terminated *** 2024-04-01T17:06:36.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-01T17:06:42.556 INFO:tasks.ceph.mds.a:Stopped 2024-04-01T17:06:42.556 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-01T17:06:42.556 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:06:42.598 INFO:tasks.ceph.mds.c.smithi163.stderr:2024-04-01T17:06:42.567+0000 b5f1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 41426) UID: 0 2024-04-01T17:06:42.599 INFO:tasks.ceph.mds.c.smithi163.stderr:2024-04-01T17:06:42.572+0000 b5f1640 -1 mds.c *** got signal Terminated *** 2024-04-01T17:06:43.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2024-04-01T17:06:48.658 INFO:tasks.ceph.mds.c:Stopped 2024-04-01T17:06:48.659 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-01T17:06:48.659 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:06:48.700 INFO:tasks.ceph.mds.e.smithi163.stderr:2024-04-01T17:06:48.670+0000 b5f1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 41430) UID: 0 2024-04-01T17:06:48.701 INFO:tasks.ceph.mds.e.smithi163.stderr:2024-04-01T17:06:48.675+0000 b5f1640 -1 mds.e *** got signal Terminated *** 2024-04-01T17:06:50.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~14s 2024-04-01T17:06:53.753 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:06:53.761 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:06:54.760 INFO:tasks.ceph.mds.e:Stopped 2024-04-01T17:06:54.760 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-01T17:06:54.760 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:06:54.760 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-01T17:06:54.760 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi189 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b" 2024-04-01T17:06:54.761 INFO:tasks.ceph.mds.b:Stopped 2024-04-01T17:06:54.762 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-01T17:06:54.762 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:06:54.806 INFO:tasks.ceph.mds.d.smithi189.stderr:2024-04-01T17:06:54.773+0000 b5f1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 41961) UID: 0 2024-04-01T17:06:54.808 INFO:tasks.ceph.mds.d.smithi189.stderr:2024-04-01T17:06:54.778+0000 b5f1640 -1 mds.d *** got signal Terminated *** 2024-04-01T17:06:56.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-01T17:07:00.862 INFO:tasks.ceph.mds.d:Stopped 2024-04-01T17:07:00.863 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-01T17:07:00.863 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:07:00.905 INFO:tasks.ceph.mds.f.smithi189.stderr:2024-04-01T17:07:00.873+0000 b5f1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 41964) UID: 0 2024-04-01T17:07:00.907 INFO:tasks.ceph.mds.f.smithi189.stderr:2024-04-01T17:07:00.878+0000 b5f1640 -1 mds.f *** got signal Terminated *** 2024-04-01T17:07:06.964 INFO:tasks.ceph.mds.f:Stopped 2024-04-01T17:07:06.965 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-01T17:07:06.965 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-01T17:07:06.965 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:07:06.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2024-04-01T17:07:06.967+0000 7f9a9a400640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 37149) UID: 0 2024-04-01T17:07:06.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2024-04-01T17:07:06.967+0000 7f9a9a400640 -1 osd.0 35 *** Got signal Terminated *** 2024-04-01T17:07:13.066 INFO:tasks.ceph.osd.0:Stopped 2024-04-01T17:07:13.067 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-01T17:07:13.067 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:07:13.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-04-01T17:07:13.068+0000 7f91fb200640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 37153) UID: 0 2024-04-01T17:07:13.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-04-01T17:07:13.068+0000 7f91fb200640 -1 osd.1 37 *** Got signal Terminated *** 2024-04-01T17:07:19.169 INFO:tasks.ceph.osd.1:Stopped 2024-04-01T17:07:19.170 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-01T17:07:19.170 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:07:19.171 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-04-01T17:07:19.172+0000 7fc2f4e00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 37150) UID: 0 2024-04-01T17:07:19.172 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-04-01T17:07:19.172+0000 7fc2f4e00640 -1 osd.2 38 *** Got signal Terminated *** 2024-04-01T17:07:21.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-01T17:07:23.894 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:07:23.902 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:07:25.271 INFO:tasks.ceph.osd.2:Stopped 2024-04-01T17:07:25.272 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-01T17:07:25.272 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:07:25.274 INFO:tasks.ceph.osd.3.smithi163.stderr:2024-04-01T17:07:25.274+0000 7f5553200640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 37152) UID: 0 2024-04-01T17:07:25.274 INFO:tasks.ceph.osd.3.smithi163.stderr:2024-04-01T17:07:25.274+0000 7f5553200640 -1 osd.3 39 *** Got signal Terminated *** 2024-04-01T17:07:27.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-01T17:07:27.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-01T17:07:31.373 INFO:tasks.ceph.osd.3:Stopped 2024-04-01T17:07:31.373 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-01T17:07:31.373 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:07:31.375 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-04-01T17:07:31.376+0000 7f0cb9800640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 37429) UID: 0 2024-04-01T17:07:31.375 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-04-01T17:07:31.376+0000 7f0cb9800640 -1 osd.4 40 *** Got signal Terminated *** 2024-04-01T17:07:33.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-01T17:07:33.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-01T17:07:37.476 INFO:tasks.ceph.osd.4:Stopped 2024-04-01T17:07:37.476 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-01T17:07:37.476 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:07:37.478 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-04-01T17:07:37.478+0000 7f8884a00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 37428) UID: 0 2024-04-01T17:07:37.478 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-04-01T17:07:37.478+0000 7f8884a00640 -1 osd.5 41 *** Got signal Terminated *** 2024-04-01T17:07:39.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-01T17:07:43.579 INFO:tasks.ceph.osd.5:Stopped 2024-04-01T17:07:43.579 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-01T17:07:43.579 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:07:43.581 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-04-01T17:07:43.580+0000 7f3915000640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 37432) UID: 0 2024-04-01T17:07:43.581 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-04-01T17:07:43.580+0000 7f3915000640 -1 osd.6 42 *** Got signal Terminated *** 2024-04-01T17:07:45.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-01T17:07:49.681 INFO:tasks.ceph.osd.6:Stopped 2024-04-01T17:07:49.682 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-01T17:07:49.682 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:07:49.683 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-04-01T17:07:49.683+0000 7fbd31000640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 37433) UID: 0 2024-04-01T17:07:49.683 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-04-01T17:07:49.683+0000 7fbd31000640 -1 osd.7 42 *** Got signal Terminated *** 2024-04-01T17:07:50.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-01T17:07:54.032 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:07:54.041 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:07:55.783 INFO:tasks.ceph.osd.7:Stopped 2024-04-01T17:07:55.784 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-01T17:07:55.784 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-01T17:07:55.784 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:07:55.786 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T17:07:55.786+0000 7fa749a00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 36796) UID: 0 2024-04-01T17:07:55.786 INFO:tasks.ceph.mgr.y.smithi163.stderr:2024-04-01T17:07:55.786+0000 7fa749a00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-01T17:07:55.871 INFO:tasks.ceph.mgr.y:Stopped 2024-04-01T17:07:55.871 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-01T17:07:55.871 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:07:55.963 INFO:tasks.ceph.mgr.x:Stopped 2024-04-01T17:07:55.963 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-01T17:07:55.964 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-01T17:07:55.964 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:07:55.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-01T17:07:55.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-04-01T17:07:56.013 INFO:tasks.ceph.mon.a.smithi163.stderr:2024-04-01T17:07:55.975+0000 9f9a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 36793) UID: 0 2024-04-01T17:07:56.014 INFO:tasks.ceph.mon.a.smithi163.stderr:2024-04-01T17:07:55.979+0000 9f9a640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-01T17:07:56.897 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:34:28.580 36799== 2024-04-01T17:07:56.897 INFO:tasks.ceph.mon.a.smithi163.stderr:==00:00:34:28.580 36799== Exit program on first error (--exit-on-first-error=yes) 2024-04-01T17:07:56.947 INFO:tasks.ceph.mon.a.smithi163.stderr:daemon-helper: command failed with exit status 42 2024-04-01T17:08:01.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-01T17:08:01.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-01T17:08:01.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-04-01T17:08:02.065 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-01T17:08:02.065 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi163 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-04-01T17:08:02.066 INFO:tasks.ceph.mon.a:Stopped 2024-04-01T17:08:02.066 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-01T17:08:02.066 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:08:02.110 INFO:tasks.ceph.mon.b.smithi189.stderr:2024-04-01T17:08:02.077+0000 9f9a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 36830) UID: 0 2024-04-01T17:08:02.112 INFO:tasks.ceph.mon.b.smithi189.stderr:2024-04-01T17:08:02.081+0000 9f9a640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-01T17:08:02.882 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:34:34.549 36836== 2024-04-01T17:08:02.882 INFO:tasks.ceph.mon.b.smithi189.stderr:==00:00:34:34.549 36836== Exit program on first error (--exit-on-first-error=yes) 2024-04-01T17:08:02.926 INFO:tasks.ceph.mon.b.smithi189.stderr:daemon-helper: command failed with exit status 42 2024-04-01T17:08:06.267 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-01T17:08:06.267 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-01T17:08:08.168 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-01T17:08:08.168 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi189 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-04-01T17:08:08.168 INFO:tasks.ceph.mon.b:Stopped 2024-04-01T17:08:08.168 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-01T17:08:08.169 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T17:08:08.213 INFO:tasks.ceph.mon.c.smithi189.stderr:2024-04-01T17:08:08.180+0000 9f9a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 36831) UID: 0 2024-04-01T17:08:08.215 INFO:tasks.ceph.mon.c.smithi189.stderr:2024-04-01T17:08:08.185+0000 9f9a640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-04-01T17:08:09.056 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:34:40.723 36837== 2024-04-01T17:08:09.056 INFO:tasks.ceph.mon.c.smithi189.stderr:==00:00:34:40.723 36837== Exit program on first error (--exit-on-first-error=yes) 2024-04-01T17:08:09.100 INFO:tasks.ceph.mon.c.smithi189.stderr:daemon-helper: command failed with exit status 42 2024-04-01T17:08:11.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-01T17:08:11.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-01T17:08:14.270 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-01T17:08:14.271 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi189 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-04-01T17:08:14.271 INFO:tasks.ceph.mon.c:Stopped 2024-04-01T17:08:14.271 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-01T17:08:14.271 DEBUG:teuthology.orchestra.run.smithi163:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-04-01T17:08:14.385 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-01T17:08:14.385 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-01T17:08:14.609 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-01T17:08:14.609 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-01T17:08:14.757 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-01T17:08:14.758 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-01T17:08:14.912 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-01T17:08:14.913 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-01T17:08:15.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-01T17:08:15.058 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-01T17:08:15.258 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-01T17:08:15.259 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-01T17:08:15.403 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-01T17:08:15.403 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-01T17:08:15.543 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi189.front.sepia.ceph.com 2024-04-01T17:08:15.544 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-01T17:08:15.686 INFO:tasks.ceph:Archiving mon data... 2024-04-01T17:08:15.688 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958/data/mon.a.tgz 2024-04-01T17:08:15.688 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-04-01T17:08:15.745 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.JnwZl0yFkQ 2024-04-01T17:08:15.745 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JnwZl0yFkQ 2024-04-01T17:08:15.935 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.JnwZl0yFkQ 2024-04-01T17:08:16.083 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.JnwZl0yFkQ is 345KB 2024-04-01T17:08:16.192 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.JnwZl0yFkQ 2024-04-01T17:08:16.248 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958/data/mon.b.tgz 2024-04-01T17:08:16.248 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-04-01T17:08:16.270 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-01T17:08:16.303 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.6vhiBftVQq 2024-04-01T17:08:16.303 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6vhiBftVQq 2024-04-01T17:08:16.491 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.6vhiBftVQq 2024-04-01T17:08:16.645 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.6vhiBftVQq is 362KB 2024-04-01T17:08:16.752 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.6vhiBftVQq 2024-04-01T17:08:16.808 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958/data/mon.c.tgz 2024-04-01T17:08:16.808 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-04-01T17:08:16.857 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.ME6T0fv8Sr 2024-04-01T17:08:16.857 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ME6T0fv8Sr 2024-04-01T17:08:17.025 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.ME6T0fv8Sr 2024-04-01T17:08:17.173 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.ME6T0fv8Sr is 362KB 2024-04-01T17:08:17.280 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.ME6T0fv8Sr 2024-04-01T17:08:17.337 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-01T17:08:17.337 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-01T17:08:17.345 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-01T17:08:17.781 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-01T17:08:18.119 INFO:tasks.ceph:Archiving crash dumps... 2024-04-01T17:08:18.121 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958/remote/smithi163/crash 2024-04-01T17:08:18.122 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-01T17:08:18.218 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958/remote/smithi189/crash 2024-04-01T17:08:18.219 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-01T17:08:18.311 INFO:tasks.ceph:Shutting down logrotate 2024-04-01T17:08:18.311 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:08:18.319 DEBUG:teuthology.orchestra.run.smithi189:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T17:08:18.447 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-01T17:08:18.544 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-01T17:08:18.644 INFO:tasks.ceph:Compressing logs... 2024-04-01T17:08:18.645 DEBUG:teuthology.orchestra.run.smithi163:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T17:08:18.652 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T17:08:18.737 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41723.log 2024-04-01T17:08:18.738 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47234.log 2024-04-01T17:08:18.739 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44219.log 2024-04-01T17:08:18.740 INFO:teuthology.orchestra.run.smithi163.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41723.log.gz 2024-04-01T17:08:18.741 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47234.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-01T17:08:18.741 INFO:teuthology.orchestra.run.smithi163.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47234.log.gz 2024-04-01T17:08:18.742 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43925.log 2024-04-01T17:08:18.742 INFO:teuthology.orchestra.run.smithi163.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44219.log.gz 2024-04-01T17:08:18.743 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47843.log 2024-04-01T17:08:18.744 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41765.log 2024-04-01T17:08:18.744 INFO:teuthology.orchestra.run.smithi163.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43925.log.gz 2024-04-01T17:08:18.745 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-01T17:08:18.745 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43647.log 2024-04-01T17:08:18.745 INFO:teuthology.orchestra.run.smithi163.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47843.log.gz 2024-04-01T17:08:18.746 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37177.log 2024-04-01T17:08:18.747 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-04-01T17:08:18.747 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44093.log 2024-04-01T17:08:18.747 INFO:teuthology.orchestra.run.smithi163.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41765.log.gz 2024-04-01T17:08:18.748 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43647.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43647.log.gz 2024-04-01T17:08:18.748 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37279.log 2024-04-01T17:08:18.748 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.37177.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-04-01T17:08:18.749 INFO:teuthology.orchestra.run.smithi189.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37177.log.gz 2024-04-01T17:08:18.750 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48055.log 2024-04-01T17:08:18.750 INFO:teuthology.orchestra.run.smithi163.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44093.log.gz 2024-04-01T17:08:18.750 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.37279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41975.log 2024-04-01T17:08:18.750 INFO:teuthology.orchestra.run.smithi163.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37279.log.gz 2024-04-01T17:08:18.751 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-04-01T17:08:18.751 INFO:teuthology.orchestra.run.smithi189.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-04-01T17:08:18.751 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/valgrind/mds.f.log: 57.2% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-04-01T17:08:18.751 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-04-01T17:08:18.753 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47633.log 2024-04-01T17:08:18.753 INFO:teuthology.orchestra.run.smithi163.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48055.log.gz 2024-04-01T17:08:18.753 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41975.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41975.log.gz 2024-04-01T17:08:18.753 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43461.log 2024-04-01T17:08:18.753 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-04-01T17:08:18.753 INFO:teuthology.orchestra.run.smithi189.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-04-01T17:08:18.753 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/valgrind/mon.b.log: 69.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-04-01T17:08:18.753 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37257.log 2024-04-01T17:08:18.755 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41849.log 2024-04-01T17:08:18.755 INFO:teuthology.orchestra.run.smithi163.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47633.log.gz 2024-04-01T17:08:18.755 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44303.log 2024-04-01T17:08:18.755 INFO:teuthology.orchestra.run.smithi163.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43461.log.gz 2024-04-01T17:08:18.755 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/valgrind/mds.d.log: 57.2% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-04-01T17:08:18.756 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37126.log 2024-04-01T17:08:18.756 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.37257.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-01T17:08:18.756 INFO:teuthology.orchestra.run.smithi189.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37257.log.gz 2024-04-01T17:08:18.758 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.37126.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37126.log.gz 2024-04-01T17:08:18.758 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-01T17:08:18.758 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37217.log 2024-04-01T17:08:18.758 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-01T17:08:18.759 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43051.log 2024-04-01T17:08:18.759 INFO:teuthology.orchestra.run.smithi163.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41849.log.gz 2024-04-01T17:08:18.759 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48013.log 2024-04-01T17:08:18.759 INFO:teuthology.orchestra.run.smithi163.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44303.log.gz 2024-04-01T17:08:18.759 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44387.log 2024-04-01T17:08:18.759 INFO:teuthology.orchestra.run.smithi163.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43051.log.gz 2024-04-01T17:08:18.759 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41891.log 2024-04-01T17:08:18.760 INFO:teuthology.orchestra.run.smithi163.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48013.log.gz 2024-04-01T17:08:18.761 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.37217.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-01T17:08:18.761 INFO:teuthology.orchestra.run.smithi189.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37217.log.gz 2024-04-01T17:08:18.761 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37337.log 2024-04-01T17:08:18.761 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-01T17:08:18.762 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41933.log 2024-04-01T17:08:18.762 INFO:teuthology.orchestra.run.smithi163.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44387.log.gz 2024-04-01T17:08:18.762 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41891.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-04-01T17:08:18.762 INFO:teuthology.orchestra.run.smithi163.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41891.log.gz 2024-04-01T17:08:18.762 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41933.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-04-01T17:08:18.762 INFO:teuthology.orchestra.run.smithi163.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41933.log.gz 2024-04-01T17:08:18.763 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/valgrind/mds.c.log: 57.4% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-04-01T17:08:18.763 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-04-01T17:08:18.764 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.37337.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-01T17:08:18.764 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37337.log.gz 2024-04-01T17:08:18.764 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37297.log 2024-04-01T17:08:18.765 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-01T17:08:18.765 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/valgrind/mds.a.log: 57.4% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-04-01T17:08:18.765 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-04-01T17:08:18.766 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/valgrind/client.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-04-01T17:08:18.766 INFO:teuthology.orchestra.run.smithi163.stderr: 76.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-04-01T17:08:18.766 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/valgrind/mon.a.log: 69.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-04-01T17:08:18.767 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42676.log 2024-04-01T17:08:18.767 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.37297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37046.log 2024-04-01T17:08:18.767 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37297.log.gz 2024-04-01T17:08:18.767 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/valgrind/mds.e.log: 57.4% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-04-01T17:08:18.768 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42977.log 2024-04-01T17:08:18.768 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-01T17:08:18.769 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42661.log 2024-04-01T17:08:18.769 INFO:teuthology.orchestra.run.smithi163.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42676.log.gz 2024-04-01T17:08:18.770 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.37046.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37046.log.gz 2024-04-01T17:08:18.770 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41807.log 2024-04-01T17:08:18.771 INFO:teuthology.orchestra.run.smithi163.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42977.log.gz 2024-04-01T17:08:18.771 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42661.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42661.log.gz 2024-04-01T17:08:18.771 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48224.log 2024-04-01T17:08:18.771 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43227.log 2024-04-01T17:08:18.772 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-01T17:08:18.772 INFO:teuthology.orchestra.run.smithi163.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41807.log.gz 2024-04-01T17:08:18.773 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44345.log 2024-04-01T17:08:18.773 INFO:teuthology.orchestra.run.smithi163.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48224.log.gz 2024-04-01T17:08:18.773 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42999.log 2024-04-01T17:08:18.775 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37086.log 2024-04-01T17:08:18.775 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-01T17:08:18.776 INFO:teuthology.orchestra.run.smithi163.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43227.log.gz 2024-04-01T17:08:18.776 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42371.log 2024-04-01T17:08:18.776 INFO:teuthology.orchestra.run.smithi163.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44345.log.gz 2024-04-01T17:08:18.776 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48930.log 2024-04-01T17:08:18.776 INFO:teuthology.orchestra.run.smithi163.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42999.log.gz 2024-04-01T17:08:18.776 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.37086.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-01T17:08:18.776 INFO:teuthology.orchestra.run.smithi189.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37086.log.gz 2024-04-01T17:08:18.777 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42943.log 2024-04-01T17:08:18.777 INFO:teuthology.orchestra.run.smithi163.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42371.log.gz 2024-04-01T17:08:18.778 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-01T17:08:18.778 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47717.log 2024-04-01T17:08:18.778 INFO:teuthology.orchestra.run.smithi163.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48930.log.gz 2024-04-01T17:08:18.779 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44531.log 2024-04-01T17:08:18.779 INFO:teuthology.orchestra.run.smithi163.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42943.log.gz 2024-04-01T17:08:18.779 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-01T17:08:18.780 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42957.log 2024-04-01T17:08:18.780 INFO:teuthology.orchestra.run.smithi163.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47717.log.gz 2024-04-01T17:08:18.781 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44531.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44531.log.gz 2024-04-01T17:08:18.781 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48846.log 2024-04-01T17:08:18.782 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mon.b.log: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-01T17:08:18.783 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44009.log 2024-04-01T17:08:18.783 INFO:teuthology.orchestra.run.smithi163.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42957.log.gz 2024-04-01T17:08:18.784 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48182.log 2024-04-01T17:08:18.784 INFO:teuthology.orchestra.run.smithi163.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48846.log.gz 2024-04-01T17:08:18.785 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42497.log 2024-04-01T17:08:18.785 INFO:teuthology.orchestra.run.smithi163.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44009.log.gz 2024-04-01T17:08:18.786 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48182.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-01T17:08:18.786 INFO:teuthology.orchestra.run.smithi163.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48182.log.gz 2024-04-01T17:08:18.787 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48139.log 2024-04-01T17:08:18.787 INFO:teuthology.orchestra.run.smithi163.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42497.log.gz 2024-04-01T17:08:18.788 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48097.log 2024-04-01T17:08:18.789 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42017.log 2024-04-01T17:08:18.789 INFO:teuthology.orchestra.run.smithi163.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48139.log.gz 2024-04-01T17:08:18.790 INFO:teuthology.orchestra.run.smithi163.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-01T17:08:18.790 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48097.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48097.log.gz 2024-04-01T17:08:18.790 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47336.log 2024-04-01T17:08:18.791 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47294.log 2024-04-01T17:08:18.791 INFO:teuthology.orchestra.run.smithi163.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42017.log.gz 2024-04-01T17:08:18.792 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43313.log 2024-04-01T17:08:18.792 INFO:teuthology.orchestra.run.smithi163.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47336.log.gz 2024-04-01T17:08:18.793 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48636.log 2024-04-01T17:08:18.793 INFO:teuthology.orchestra.run.smithi163.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47294.log.gz 2024-04-01T17:08:18.794 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47066.log 2024-04-01T17:08:18.794 INFO:teuthology.orchestra.run.smithi163.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43313.log.gz 2024-04-01T17:08:18.795 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44615.log 2024-04-01T17:08:18.795 INFO:teuthology.orchestra.run.smithi163.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48636.log.gz 2024-04-01T17:08:18.796 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48804.log 2024-04-01T17:08:18.797 INFO:teuthology.orchestra.run.smithi163.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47066.log.gz 2024-04-01T17:08:18.797 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48720.log 2024-04-01T17:08:18.797 INFO:teuthology.orchestra.run.smithi163.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44615.log.gz 2024-04-01T17:08:18.799 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43322.log 2024-04-01T17:08:18.799 INFO:teuthology.orchestra.run.smithi163.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48804.log.gz 2024-04-01T17:08:18.800 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42413.log 2024-04-01T17:08:18.800 INFO:teuthology.orchestra.run.smithi163.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48720.log.gz 2024-04-01T17:08:18.801 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44177.log 2024-04-01T17:08:18.801 INFO:teuthology.orchestra.run.smithi163.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43322.log.gz 2024-04-01T17:08:18.802 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-01T17:08:18.802 INFO:teuthology.orchestra.run.smithi189.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-01T17:08:18.802 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42413.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.42413.log.gz --verbose 2024-04-01T17:08:18.802 INFO:teuthology.orchestra.run.smithi163.stderr: -- /var/log/ceph/ceph-client.admin.47192.log 2024-04-01T17:08:18.803 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44177.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44177.log.gz 2024-04-01T17:08:18.803 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-01T17:08:18.804 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42852.log 2024-04-01T17:08:18.804 INFO:teuthology.orchestra.run.smithi163.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47192.log.gz 2024-04-01T17:08:18.805 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43391.log 2024-04-01T17:08:18.806 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42852.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42852.log.gz 2024-04-01T17:08:18.806 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47108.log 2024-04-01T17:08:18.807 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44471.log 2024-04-01T17:08:18.808 INFO:teuthology.orchestra.run.smithi163.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43391.log.gz 2024-04-01T17:08:18.809 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47108.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47108.log.gz 2024-04-01T17:08:18.809 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43231.log 2024-04-01T17:08:18.810 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42227.log 2024-04-01T17:08:18.810 INFO:teuthology.orchestra.run.smithi163.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44471.log.gz 2024-04-01T17:08:18.811 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43231.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43231.log.gz 2024-04-01T17:08:18.811 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43547.log 2024-04-01T17:08:18.812 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48536.log 2024-04-01T17:08:18.812 INFO:teuthology.orchestra.run.smithi163.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42227.log.gz 2024-04-01T17:08:18.813 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43547.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43547.log.gz 2024-04-01T17:08:18.813 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48762.log 2024-04-01T17:08:18.814 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42672.log 2024-04-01T17:08:18.814 INFO:teuthology.orchestra.run.smithi163.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48536.log.gz 2024-04-01T17:08:18.815 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48762.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48762.log.gz 2024-04-01T17:08:18.815 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36798.log 2024-04-01T17:08:18.816 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47150.log 2024-04-01T17:08:18.816 INFO:teuthology.orchestra.run.smithi163.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42672.log.gz 2024-04-01T17:08:18.817 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.36798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42669.log 2024-04-01T17:08:18.817 INFO:teuthology.orchestra.run.smithi163.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.36798.log.gz 2024-04-01T17:08:18.818 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47929.log 2024-04-01T17:08:18.818 INFO:teuthology.orchestra.run.smithi163.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47150.log.gz 2024-04-01T17:08:18.819 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42669.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42669.log.gz 2024-04-01T17:08:18.819 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42677.log 2024-04-01T17:08:18.820 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47929.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-01T17:08:18.820 INFO:teuthology.orchestra.run.smithi163.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47929.log.gz 2024-04-01T17:08:18.821 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42677.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42677.log.gz 2024-04-01T17:08:18.821 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48596.log 2024-04-01T17:08:18.822 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30771.log 2024-04-01T17:08:18.824 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48596.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48596.log.gz 2024-04-01T17:08:18.824 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44051.log 2024-04-01T17:08:18.825 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph.tmp-client.admin.30771.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30771.log.gz 2024-04-01T17:08:18.825 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43331.log 2024-04-01T17:08:18.826 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44051.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44051.log.gz 2024-04-01T17:08:18.826 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42059.log 2024-04-01T17:08:18.828 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48266.log 2024-04-01T17:08:18.828 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43331.log: /var/log/ceph/ceph-client.admin.42059.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43331.log.gz 2024-04-01T17:08:18.829 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42101.log 2024-04-01T17:08:18.829 INFO:teuthology.orchestra.run.smithi163.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42059.log.gz 2024-04-01T17:08:18.830 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48266.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48266.log.gz 2024-04-01T17:08:18.830 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44135.log 2024-04-01T17:08:18.831 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42455.log 2024-04-01T17:08:18.832 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44135.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42101.log.gz 2024-04-01T17:08:18.832 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43967.log 2024-04-01T17:08:18.833 INFO:teuthology.orchestra.run.smithi163.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44135.log.gz 2024-04-01T17:08:18.833 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42679.log 2024-04-01T17:08:18.834 INFO:teuthology.orchestra.run.smithi163.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42455.log.gz 2024-04-01T17:08:18.835 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42329.log 2024-04-01T17:08:18.835 INFO:teuthology.orchestra.run.smithi163.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43967.log.gz 2024-04-01T17:08:18.836 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48476.log 2024-04-01T17:08:18.836 INFO:teuthology.orchestra.run.smithi163.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42679.log.gz 2024-04-01T17:08:18.837 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41582.log 2024-04-01T17:08:18.837 INFO:teuthology.orchestra.run.smithi163.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42329.log.gz 2024-04-01T17:08:18.838 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47801.log 2024-04-01T17:08:18.839 INFO:teuthology.orchestra.run.smithi163.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48476.log.gz 2024-04-01T17:08:18.840 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41582.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41582.log.gz 2024-04-01T17:08:18.840 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48308.log 2024-04-01T17:08:18.841 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47801.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-01T17:08:18.841 INFO:teuthology.orchestra.run.smithi163.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47801.log.gz 2024-04-01T17:08:18.842 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42269.log 2024-04-01T17:08:18.842 INFO:teuthology.orchestra.run.smithi163.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48308.log.gz 2024-04-01T17:08:18.843 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43883.log 2024-04-01T17:08:18.845 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47971.log 2024-04-01T17:08:18.845 INFO:teuthology.orchestra.run.smithi163.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42269.log.gz 2024-04-01T17:08:18.846 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43883.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-01T17:08:18.846 INFO:teuthology.orchestra.run.smithi163.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43883.log.gz 2024-04-01T17:08:18.847 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43419.log 2024-04-01T17:08:18.847 INFO:teuthology.orchestra.run.smithi163.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47971.log.gz 2024-04-01T17:08:18.849 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43741.log 2024-04-01T17:08:18.850 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44657.log 2024-04-01T17:08:18.850 INFO:teuthology.orchestra.run.smithi163.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43419.log.gz 2024-04-01T17:08:18.851 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48392.log 2024-04-01T17:08:18.851 INFO:teuthology.orchestra.run.smithi163.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43741.log.gz 2024-04-01T17:08:18.851 INFO:teuthology.orchestra.run.smithi163.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-01T17:08:18.852 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44261.log 2024-04-01T17:08:18.853 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48392.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.44657.log.gz 2024-04-01T17:08:18.853 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41234.log 2024-04-01T17:08:18.854 INFO:teuthology.orchestra.run.smithi163.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48392.log.gz 2024-04-01T17:08:18.855 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42143.log 2024-04-01T17:08:18.855 INFO:teuthology.orchestra.run.smithi163.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44261.log.gz 2024-04-01T17:08:18.856 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43708.log 2024-04-01T17:08:18.856 INFO:teuthology.orchestra.run.smithi163.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41234.log.gz 2024-04-01T17:08:18.858 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45195.log 2024-04-01T17:08:18.858 INFO:teuthology.orchestra.run.smithi163.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42143.log.gz 2024-04-01T17:08:18.859 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43587.log 2024-04-01T17:08:18.859 INFO:teuthology.orchestra.run.smithi163.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43708.log.gz 2024-04-01T17:08:18.860 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.0.45195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41435.log 2024-04-01T17:08:18.862 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48678.log 2024-04-01T17:08:18.862 INFO:teuthology.orchestra.run.smithi163.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43587.log.gz 2024-04-01T17:08:18.863 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41498.log 2024-04-01T17:08:18.863 INFO:teuthology.orchestra.run.smithi163.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41435.log.gz 2024-04-01T17:08:18.864 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48678.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48678.log.gz 2024-04-01T17:08:18.865 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41316.log 2024-04-01T17:08:18.867 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41498.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47378.log 2024-04-01T17:08:18.867 INFO:teuthology.orchestra.run.smithi163.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41498.log.gz 2024-04-01T17:08:18.867 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48350.log 2024-04-01T17:08:18.868 INFO:teuthology.orchestra.run.smithi163.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41316.log.gz 2024-04-01T17:08:18.868 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47378.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47378.log.gz 2024-04-01T17:08:18.869 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47420.log 2024-04-01T17:08:18.870 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43643.log 2024-04-01T17:08:18.870 INFO:teuthology.orchestra.run.smithi163.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48350.log.gz 2024-04-01T17:08:18.872 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47420.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-01T17:08:18.872 INFO:teuthology.orchestra.run.smithi163.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47420.log.gz 2024-04-01T17:08:18.873 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37160.log 2024-04-01T17:08:18.873 INFO:teuthology.orchestra.run.smithi163.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43643.log.gz 2024-04-01T17:08:18.874 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43758.log 2024-04-01T17:08:18.876 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.37160.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37160.log.gz 2024-04-01T17:08:18.877 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43758.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43758.log.gz 2024-04-01T17:08:18.877 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42678.log 2024-04-01T17:08:18.879 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47759.log 2024-04-01T17:08:18.880 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42678.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42678.log.gz 2024-04-01T17:08:18.881 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47759.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47759.log.gz 2024-04-01T17:08:18.882 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-01T17:08:18.883 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47462.log 2024-04-01T17:08:18.886 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.47462.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47462.log.gz 2024-04-01T17:08:18.887 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41678.log 2024-04-01T17:08:18.889 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41678.log: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-01T17:08:18.890 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-01T17:08:18.891 INFO:teuthology.orchestra.run.smithi163.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41678.log.gzgzip 2024-04-01T17:08:18.891 INFO:teuthology.orchestra.run.smithi163.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48888.log 2024-04-01T17:08:18.894 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.48888.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48888.log.gz 2024-04-01T17:08:18.894 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-01T17:08:18.895 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43841.log 2024-04-01T17:08:18.897 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44759.log 2024-04-01T17:08:18.898 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43841.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43841.log.gz 2024-04-01T17:08:18.902 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43046.log 2024-04-01T17:08:18.904 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44759.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44759.log.gz 2024-04-01T17:08:18.905 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43071.log 2024-04-01T17:08:18.906 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43046.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43046.log.gz 2024-04-01T17:08:18.909 INFO:teuthology.orchestra.run.smithi163.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-01T17:08:18.911 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.43071.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43071.log.gz 2024-04-01T17:08:18.911 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47887.log 2024-04-01T17:08:18.914 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48434.log 2024-04-01T17:08:18.914 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44429.log 2024-04-01T17:08:18.914 INFO:teuthology.orchestra.run.smithi163.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47887.log.gz 2024-04-01T17:08:18.915 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42665.log 2024-04-01T17:08:18.920 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.48434.log: 88.4%/var/log/ceph/ceph-client.admin.44429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42185.log 2024-04-01T17:08:18.921 INFO:teuthology.orchestra.run.smithi163.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44429.log.gz 2024-04-01T17:08:18.921 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42665.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42665.log.gz 2024-04-01T17:08:18.922 INFO:teuthology.orchestra.run.smithi163.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48434.log.gz 2024-04-01T17:08:18.922 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-01T17:08:18.924 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.42185.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42185.log.gz 2024-04-01T17:08:18.925 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41540.log 2024-04-01T17:08:18.927 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44573.log 2024-04-01T17:08:18.928 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.41540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47675.log 2024-04-01T17:08:18.930 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.44573.log: 88.6% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41540.log.gz -- replaced with /var/log/ceph/ceph-client.admin.44573.log.gz 2024-04-01T17:08:18.930 INFO:teuthology.orchestra.run.smithi163.stderr: 2024-04-01T17:08:18.936 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.47675.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47675.log.gz 2024-04-01T17:08:18.938 INFO:teuthology.orchestra.run.smithi163.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-01T17:08:19.160 INFO:teuthology.orchestra.run.smithi163.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-01T17:08:19.405 INFO:teuthology.orchestra.run.smithi189.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-01T17:08:19.508 INFO:teuthology.orchestra.run.smithi189.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-01T17:08:19.558 INFO:teuthology.orchestra.run.smithi189.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-01T17:08:19.615 INFO:teuthology.orchestra.run.smithi189.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-01T17:08:19.774 INFO:teuthology.orchestra.run.smithi163.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-01T17:08:19.834 INFO:teuthology.orchestra.run.smithi163.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-01T17:08:19.861 INFO:teuthology.orchestra.run.smithi189.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-01T17:08:19.869 INFO:teuthology.orchestra.run.smithi189.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-01T17:08:19.955 INFO:teuthology.orchestra.run.smithi163.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-01T17:08:20.054 INFO:teuthology.orchestra.run.smithi163.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-01T17:08:20.092 INFO:teuthology.orchestra.run.smithi163.stderr: 89.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-01T17:08:23.487 INFO:teuthology.orchestra.run.smithi163.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.45195.log.gz 2024-04-01T17:08:23.492 INFO:teuthology.orchestra.run.smithi163.stderr: 2024-04-01T17:08:23.492 INFO:teuthology.orchestra.run.smithi163.stderr:real 0m4.792s 2024-04-01T17:08:23.492 INFO:teuthology.orchestra.run.smithi163.stderr:user 0m9.847s 2024-04-01T17:08:23.492 INFO:teuthology.orchestra.run.smithi163.stderr:sys 0m1.148s 2024-04-01T17:08:28.406 INFO:teuthology.orchestra.run.smithi189.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-01T17:08:28.410 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-04-01T17:08:28.410 INFO:teuthology.orchestra.run.smithi189.stderr:real 0m9.705s 2024-04-01T17:08:28.410 INFO:teuthology.orchestra.run.smithi189.stderr:user 0m13.855s 2024-04-01T17:08:28.410 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m1.200s 2024-04-01T17:08:28.411 INFO:tasks.ceph:Archiving logs... 2024-04-01T17:08:28.412 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958/remote/smithi163/log 2024-04-01T17:08:28.413 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T17:08:30.075 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958/remote/smithi189/log 2024-04-01T17:08:30.076 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T17:08:32.217 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-01T17:08:32.218 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-01T17:08:32.232 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-01T17:08:32.233 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-01T17:08:32.233 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T17:08:32.242 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T17:08:32.394 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-01T17:08:32.405 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-01T17:08:32.405 DEBUG:teuthology.orchestra.run.smithi163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T17:08:32.413 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T17:08:32.460 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: ntpq: command not found 2024-04-01T17:08:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T17:08:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2024-04-01T17:08:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 44 +48us[ +48us] +/- 85ms 2024-04-01T17:08:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:^* hv02.front.sepia.ceph.com 3 6 377 45 -838us[ -729us] +/- 56ms 2024-04-01T17:08:32.470 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +978us[+1087us] +/- 62ms 2024-04-01T17:08:32.471 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T17:08:32.471 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-04-01T17:08:32.480 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T17:08:32.480 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-04-01T17:08:32.480 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 109 +115us[ +156us] +/- 84ms 2024-04-01T17:08:32.481 INFO:teuthology.orchestra.run.smithi189.stdout:^* hv02.front.sepia.ceph.com 3 7 377 45 -854us[ -812us] +/- 56ms 2024-04-01T17:08:32.481 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +964us[+1006us] +/- 62ms 2024-04-01T17:08:32.481 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T17:08:32.482 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-01T17:08:32.493 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-01T17:08:32.494 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-01T17:08:32.525 DEBUG:teuthology.orchestra.run.smithi163:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T17:08:32.750 DEBUG:teuthology.orchestra.run.smithi189:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T17:08:32.967 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T17:08:33.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T17:08:33.068 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T17:08:33.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T17:08:33.168 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-01T17:08:33.178 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-01T17:08:33.238 INFO:teuthology.task.internal:Duration was 3127.643420 seconds 2024-04-01T17:08:33.239 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-01T17:08:33.285 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-01T17:08:33.285 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T17:08:33.294 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T17:08:33.442 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T17:08:33.458 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T17:08:33.844 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-01T17:08:33.844 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi163.front.sepia.ceph.com 2024-04-01T17:08:33.844 DEBUG:teuthology.orchestra.run.smithi163:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T17:08:33.915 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-04-01T17:08:33.915 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T17:08:33.987 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-01T17:08:33.987 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T17:08:33.994 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T17:08:34.087 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-01T17:08:34.088 DEBUG:teuthology.orchestra.run.smithi163:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T17:08:34.093 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T17:08:34.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-01T17:08:34.296 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-01T17:08:34.296 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T17:08:34.379 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T17:08:34.476 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-01T17:08:34.486 DEBUG:teuthology.orchestra.run.smithi163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T17:08:34.493 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T17:08:34.590 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = core 2024-04-01T17:08:34.601 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-04-01T17:08:34.667 DEBUG:teuthology.orchestra.run.smithi163:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T17:08:34.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T17:08:34.721 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T17:08:34.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T17:08:34.777 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-01T17:08:34.787 INFO:teuthology.task.internal:Transferring archived files... 2024-04-01T17:08:34.787 DEBUG:teuthology.misc:Transferring archived files from smithi163:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958/remote/smithi163 2024-04-01T17:08:34.788 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T17:08:34.896 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958/remote/smithi189 2024-04-01T17:08:34.896 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T17:08:35.000 INFO:teuthology.task.internal:Removing archive directory... 2024-04-01T17:08:35.001 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T17:08:35.009 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T17:08:35.066 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-01T17:08:35.077 INFO:teuthology.task.internal:Not uploading archives. 2024-04-01T17:08:35.077 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-01T17:08:35.107 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-01T17:08:35.107 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T17:08:35.116 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T17:08:35.164 INFO:teuthology.orchestra.run.smithi163.stdout: 395173 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 17:08 /home/ubuntu/cephtest 2024-04-01T17:08:35.174 INFO:teuthology.orchestra.run.smithi189.stdout: 395193 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 17:08 /home/ubuntu/cephtest 2024-04-01T17:08:35.177 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-01T17:08:35.188 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-01T17:08:35.220 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-01T17:08:35.220 INFO:teuthology.nuke:Checking targets against current locks 2024-04-01T17:08:35.248 DEBUG:teuthology.nuke:shortname: smithi163 2024-04-01T17:08:35.248 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T17:08:35.275 DEBUG:teuthology.nuke:shortname: smithi189 2024-04-01T17:08:35.275 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T17:08:35.279 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 16:04:20.263931', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJNvpDfk19B0IUi/Ydj37n1HFdeQY3OxFWAhXFZv1fl8FYopydoy5Ji0WHVb26kKxtbbjpwS0aUGEumLQtbfZk='} 2024-04-01T17:08:35.297 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633958', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 16:04:20.265381', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJyTDvOq7o62e63FZnD5vzScSY0bwTAzRp4xkzsYzrKUQ5o6ZKPGwWm1wdvoi5OnOWlSxfi0Az3Ty0BGDfgi440='} 2024-04-01T17:08:35.328 INFO:teuthology.orchestra.console.smithi163:Power off 2024-04-01T17:08:35.329 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T17:08:35.354 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2024-04-01T17:08:35.354 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:08:35.371 INFO:teuthology.orchestra.console.smithi189:Power off 2024-04-01T17:08:35.371 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T17:08:35.381 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-04-01T17:08:35.393 DEBUG:teuthology.orchestra.console.smithi189:power off output: Chassis Power Control: Down/Off 2024-04-01T17:08:35.393 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:08:35.416 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on 2024-04-01T17:08:39.382 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:08:39.416 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:08:39.492 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-04-01T17:08:39.526 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on 2024-04-01T17:08:43.496 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:08:43.527 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:08:43.607 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-04-01T17:08:43.636 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on 2024-04-01T17:08:43.709 INFO:teuthology.orchestra.console.smithi163:Power off completed 2024-04-01T17:08:47.638 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:08:47.747 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-04-01T17:08:47.848 INFO:teuthology.orchestra.console.smithi189:Power off completed 2024-04-01T17:08:47.953 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind} duration: 3127.6434197425842 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default mon.a-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 mon.b-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 owner: scheduled_vshankar@teuthology status: fail success: false 2024-04-01T17:08:47.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T17:08:48.032 INFO:teuthology.run:FAIL